Improving outcomes on the ABS Certifying Examination: can monthly mock orals do it?

Area of Science:

• Medical Education
• Surgical Training
• Assessment Methods

Background:

• First-time pass rates on the American Board of Surgery Certifying Examination (ABSCE) are a key metric for evaluating surgical residency programs.
• The implementation of novel educational interventions is crucial for enhancing resident performance and program excellence.

Purpose of the Study:

• To investigate the impact of monthly simulated and critiqued oral examinations (MSCE) on ABSCE first-time pass rates.
• To assess the perceived benefits of the MSCE intervention among surgical residents.

Main Methods:

• A prospective study with historical controls compared ABSCE performance of residents who underwent MSCE (2003-2006) with those who did not (2001-2002).
• Statistical analysis using the Fisher exact test was employed to compare pass rates between the intervention and control groups.
• A structured questionnaire assessed the perceived value of MSCE by residents in the intervention group.

Main Results:

• The intervention group demonstrated a statistically significant improvement in ABSCE first-time pass rates compared to the historical control group (p = 0.038).
• All examinees in the intervention group reported that the MSCE was beneficial.
• Key perceived benefits included enhanced clinical reasoning skills and the promotion of self-directed study.

Conclusions:

• Monthly simulated and critiqued oral examinations are an effective strategy for improving first-time pass rates on the ABSCE.
• The MSCE intervention offers additional advantages, such as fostering clinical reasoning and encouraging self-study among surgical residents.