Early detection of factual knowledge deficiency and remediation in otolaryngology residency education

Within otolaryngology residency training, the annual Otolaryngology Training Examination (OTE) is the primary method used to assess, quantify, and compare the factual knowledge acquired by each resident. The objective of this study was to develop a more frequent method for tracking of factual knowledge to prevent educational delay.

Retrospective analysis of educational scores.

For each didactic lecture within a single otolaryngology residency training program, multiple choice questions were provided before and after each lecture. Questions were based on lecture objectives that were derived from the American Board of Otolaryngology curriculum. Scores were tracked over the course of 1 academic year and compared to the scores of residents on the OTE administered in that year to determine correlation with a validated measure of factual knowledge. The effect of remedial measures on improvement in OTE scores was determined.

Over the course of 1 academic year, there were 328 questions presented to 12 residents before and after 32 lectures in the didactic program. Ten residents completed an average of 244 questions. Overall OTE scores demonstrated a significant and very strong correlation to lecture question scores (Pearson r = 0.86, P = .002). Remedial measures for residents during the previous 5 years who had inadequate OTE scores were successful in improving scores (P = .002).

A structured didactic program that uses review questions to assess knowledge can be used to track acquisition of factual knowledge. Early identification of residents with deficiencies facilitates the development of individualized learning plans that result in successful remediation.