The failure rate of candidates for board certification: an educational outcome measure

Because most residents eventually become board certified, the overall certification rate for the American Board of Ophthalmology (ABO) is not a discriminating educational outcome measure. We have evaluated two related measures: (1) first-time failure (FTF) in the written examination, or FTF in the oral examination after passing the written examination the first time, and (2) failure to certify within 2 years of graduation (FC2).

We used the tracking system at the ABO to access and analyze information from 1998-2005 on resident performance from program match to certification.

Ninety-seven percent of graduates entered the certification process. The FTF rate was 28%. The program FTF rate ranged from 0% to 89% (median, 28%). Programs with fewer than 16 graduates per 5 years were significantly more likely to have higher FTF rates than larger programs. The FC2 rate was 21%. Thirty-two programs accounted for 50% of the FTFs and 27 for 50% of the FC2s. Residents who voluntarily transferred programs performed significantly worse than nontransferring residents by both measures.

The FTF and FC2 rates are potentially useful outcome measures. However, the small size of many programs contributes to some imprecision. The rates should be used only in conjunction with other factors when assessing programs. These data provide an insight into the state of ophthalmic education in the United States. Although the eventual certification rate was high, graduates from a substantial minority of programs appeared inadequately prepared to sit the Board's examinations.