A novel comprehensive in-training examination course can improve residency-wide scores

The annual American Board of Emergency Medicine (ABEM) in-training examination is a tool to assess resident progress and knowledge. We implemented a course at the New York-Presbyterian Emergency Medicine Residency Program to improve ABEM scores and evaluate its effect. Previously, the examination was not emphasized and resident performance was lower than expected.

As an adjunct to required weekly residency conferences, an intensive 14-week in-training examination preparation program was developed that included lectures, pre-tests, high-yield study sheets, and a remediation program. We compared each residents in-training examination score to the postgraduate year-matched national mean. Scores before and after course implementation were evaluated by repeat measures regression modeling. Residency performance was evaluated by comparing residency average to the national average each year and by tracking ABEM national written examination pass rates.

Following the course's introduction, odds of a resident scoring higher than the national average increased by 3.9 (95% CI 1.9-7.3) and percentage of residents exceeding the national average increased by 37% (95% CI 23%-52%). In the time since the course was started the overall residency mean score has outperformed the national average and the first-time ABEM written examination board pass rate has been 100%.

A multifaceted residency-wide examination curriculum focused around an intensive 14-week course was associated with marked improvement on the in-training examination.