Subtest scores from the in-training examination: an evaluation tool for an obstetric-anesthesia rotation

To evaluate resident performance in the obstetric-anesthesia rotation using resident portfolios and their In-Training Examination scores, which are provided by the American Board of Anesthesiology/American Society of Anesthesiologists.

We reviewed academic portfolios for second- and third-year anesthesiology residents at a single institution from 2006-2008 to examine United States Medical Licensing Exam Step 1 and 2 scores, grade for obstetrics-gynecology in medical school, and performance on the In-Training Examination. Faculty evaluation of medical knowledge and correlations for the various scores were obtained.

We examined scores for 43 residents. The subtest score for obstetric anesthesia increased after completing a rotation in obstetric anesthesia, 26.1 ± 10.3 versus 36.3 ± 10.6 (P  =  .02). The subtest score correlated with United States Medical Licensing Exam Step 2, r  =  0.46 (P  =  .027) but not with United States Medical Licensing Exam Step 1 or with the grade obtained in medical school. There was no correlation between faculty evaluations of medical knowledge and resident subtest scores in obstetric anesthesia.

Subtest scores in obstetric anesthesia are valid and provide a tool for the assessment of the educational program of a rotation. Knowledge as assessed by a faculty member is different from the knowledge assessed on a written examination. Both methods can help provide a more complete assessment of the resident and the rotation.