Related Experiment Video
Updated: Jul 16, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Reliability and confidence in using a paired comparison paradigm in perceptual voice quality evaluation
Edwin M-L Yiu1, Karen M K Chan, Rosa S-M Mok
1Voice Research Laboratory, Division of Speech and Hearing Sciences, Centre for Communication Disorders, The University of Hong Kong, Pokfulam, Hong Kong, PR China. eyiu@hku.hk
Abstract:
One of the ways to improve the reliability in perceptual voice quality rating is to provide listeners with external anchors. A paired comparison matching paradigm using synthesized Cantonese voice stimuli that covered a range of rough and breathy qualities were used to investigate the rating reliability. Twenty-five speech pathology students rated the severity of roughness and breathiness of natural pathological voice samples using two paradigms: an eight-point anchored matching (paired comparison) paradigm and an eight-point non-anchored equal-appearing-interval (EAI) scale paradigm. The listeners also rated their confidence in judging each testing stimulus on a seven-point EAI scale. The results showed that the paired comparison method specifically improved the inter-rater reliability in rating male rough stimuli and mildly dysphonic female stimuli. The intra-rater agreement and confidence ratings remained similar across the two rating paradigms. These results suggest that the paired comparison paradigm may be used as an alternative perceptual voice quality evaluation tool.
Related Concept Videos
Reliability and Validity
Factors Affecting Perception
An illustrative example of a perceptual set is the scenario where an airline pilot told...
Auditory Perception
Causes of Similarity-Dissimilarity Effect
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Comparison Tests

