The Effect of Experience on Videolaryngostroboscopic Ratings Using Two Different Rating Tools

Area of Science:

• Laryngology and Voice Disorders
• Speech-Language Pathology
• Medical Imaging Analysis

Background:

• Videolaryngostroboscopy (VLS) is crucial for assessing laryngeal function.
• Standardized rating tools are needed to improve the reliability of VLS interpretation.
• Understanding differences in VLS interpretation between trainees and experienced clinicians is important for training and practice.

Purpose of the Study:

• To compare videolaryngostroboscopy (VLS) ratings between speech-language pathologist (SLP) trainees and experienced SLPs.
• To evaluate the intrarater and interrater reliability of two VLS rating tools: the Voice Vibratory Assessment of Laryngeal Imaging (VALI) and a visual analog scale (VAS).
• To determine if rater experience influences the perception of laryngeal parameter severity.

Main Methods:

• Nine SLP trainees and eight experienced SLPs rated 16 VLS exams using the VALI tool for free edge, amplitude, and mucosal wave parameters.
• Participants also used a VAS to rate parameter deviation from normal and overall severity.
• Intrarater and interrater reliability were calculated, and average ratings were compared between groups.

Main Results:

• Interrater reliability was similar between trainees and experienced SLPs for both VALI and VAS tools across all parameters.
• Trainees rated laryngeal amplitude as significantly higher than experienced SLPs using the VALI tool.
• Trainees consistently rated VLS parameters and overall severity as more deviant from normal compared to experienced SLPs using the VAS.

Conclusions:

• Both trainee and experienced SLPs can achieve similar interrater reliability when interpreting VLS using standardized tools.
• SLP trainees tend to perceive laryngeal parameters and overall severity as more abnormal than experienced clinicians.
• Further training may be needed to align VLS severity ratings between novice and expert clinicians.