Related Experiment Videos
Interobserver reliability and perceptual ratings: more than meets the ear
1Audiology/Speech Pathology Service, VA Medical Center, North Chicago, IL 60064.
Journal of Speech and Hearing Research
|March 1, 1988
Summary
This study found that overall agreement for perceptual ratings of ataxic dysarthria is reliable, even with minimally trained judges. However, reliability decreases when focusing only on deviant speech parameters.
Area of Science:
- Speech-Language Pathology
- Neurology
- Biomedical Engineering
Background:
- Ataxic dysarthria, a motor speech disorder, presents challenges in accurate perceptual assessment.
- Reliability of perceptual ratings is crucial for clinical diagnosis and research in dysarthria.
Purpose of the Study:
- To evaluate the interobserver reliability of perceptual ratings for ataxic dysarthria.
- To investigate how the presence of deviant speech parameters affects reliability calculations.
Main Methods:
- Ten subjects with ataxic dysarthria participated in the study.
- Minimally trained judges provided perceptual ratings of speech characteristics.
- Interobserver agreement and occurrence reliability coefficients were calculated.
Main Results:
- Overall interobserver agreement was favorable and exceeded chance levels.
- Reliability coefficients were lower when calculated for "deviant dimensions" alone.
- Occurrence reliability for deviant dimensions still surpassed chance levels.
Conclusions:
- Standard practices for interobserver reliability in perceptual speech ratings may need modification.
- The study provides recommendations for improving reliability assessments in ataxic dysarthria.