Observer Agreement for Measurements in Videolaryngostroboscopy

Area of Science:

• Otolaryngology
• Speech-Language Pathology
• Medical Imaging Analysis

Background:

• Videolaryngostroboscopy (VLS) is essential for evaluating voice disorders.
• Accurate interpretation of VLS findings relies on consistent observer agreement.
• Variability in visuoperceptual assessments can impact patient diagnosis and treatment.

Purpose of the Study:

• To assess intraobserver and interobserver agreement in VLS visuoperceptual measurements.
• To compare observer behavior during independent versus consensus panel ratings.
• To identify factors influencing observer agreement in VLS assessments.

Main Methods:

• Retrospective analysis of standardized VLS examinations from 64 dysphonia patients.
• Two experienced observers independently rated visuoperceptual variables and clinical diagnoses.
• Observers then convened for a consensus panel rating session.
• Descriptive and kappa statistics were employed to analyze agreement levels.

Main Results:

• Intraobserver agreement generally surpassed interobserver agreement for most VLS variables.
• Agreement within the consensus panel slightly exceeded independent intraobserver agreement.
• Observers significantly altered their initial independent ratings when participating in the consensus panel.

Conclusions:

• Observer agreement in VLS is critical for accurate diagnosis, treatment, and research interpretation.
• Understanding factors affecting agreement enhances the reliability of VLS assessments.
• Consensus panel ratings may offer a strategy to improve observer agreement in VLS visuoperceptual evaluations.