Related Experiment Videos
Assessing and documenting general competencies in otolaryngology resident training programs.
Rick M Roark1, Steven D Schaefer, Guo-Pei Yu
1Department of Otolaryngology, The New York Eye & Ear Infirmary, Manhattan, New York 10003, USA.
The Laryngoscope
|May 3, 2006
Summary
This study implemented a web-based system for otolaryngology resident education assessment, finding it efficient for tracking competencies and program insufficiencies. The online tool facilitated educational management, though validation challenges remain.
Area of Science:
- Medical Education
- Surgical Training
- Otolaryngology
Background:
- Accreditation Council of Graduate Medical Education (ACGME) mandates general competencies for otolaryngology residents.
- Effective assessment tools are crucial for monitoring resident progress and identifying training program weaknesses.
Purpose of the Study:
- To implement web-based instruments for assessing otolaryngology resident competencies.
- To evaluate the validity and utility of an online system for measuring educational outcomes and identifying training program insufficiencies.
Main Methods:
- Developed and implemented an online assessment system for a postgraduate surgical program over three years.
- Collected online evaluations from faculty, peers, and nonphysician professionals for 26 residents.
- Compared resident performance scores with American Board of Otolaryngology in-service examination (ISE) scores.
Main Results:
- The online system was user-friendly and efficient, collecting 1,336 evaluations.
- Faculty scores were significantly lower than those of nonphysician professionals and resident peers.
- Resident ISE scores correlated with faculty perceptions of medical knowledge.
Conclusions:
- The system achieved 97% compliance and aided educational management.
- Validation was challenging due to small perceptual differences among residents.
- Further study and inter-program consultation are recommended for system improvement.