Current Technical Skills Assessment Tools in Otolaryngology Residency: A Scoping Review

To review and synthesize the literature on technical skills assessment tools in otolaryngology residency programs.

A comprehensive search of Medline, Embase, PubMed, and Google Scholar was performed from inception to January 2025.

Following PRISMA guidelines, studies reporting on technical skills assessment tools in otolaryngology residency training were screened and abstracted independently in duplicate. Data were extracted on study characteristics, subspecialty, procedure type, training modality (simulation, cadaveric, operating room), assessment tool design, scoring scale, number of residents, and tool validity. Study quality was assessed using the Modified Educational Oxford Centre for Evidence-Based Medicine framework.

Of 1270 screened studies, 146 met inclusion criteria, encompassing 3231 trainees across six otolaryngology subspecialties. Most studies were from the United States (59.6%), Canada (18.5%), and Denmark (10.3%). The largest subspecialty represented was otology and neurotology (42.5%), followed by rhinology and skull base surgery (21.2%), head and neck surgery (12.3%), general otolaryngology (11.6%), pediatric otolaryngology (7.5%), and laryngology (4.8%). Common assessment frameworks included Objective Structured Assessment of Technical Skills, Task-Specific Checklists, and Global Rating Scales. Tools demonstrated construct, face, and content validity, with strong interrater reliability and sensitivity to training level. Innovations included automated performance analysis and 3D-printed models.

The synthesized list of procedures and their assessment tools can serve as a road map for otolaryngology residency programs. They support competency-based medical education, differentiate skill levels, and guide feedback. Future work should focus on multicenter validation, standardization across programs, and integration of technology-driven assessment methods to enhance surgical training outcomes.