The impact of postgraduate training on USMLE® step 3® and its computer-based case simulation component

Area of Science:

• Medical Education
• Licensure Examinations

Background:

• The United States Medical Licensing Examination (USMLE) Step 3 includes multiple-choice questions (MCQ) and unique interactive patient-care simulations (Computer-based Case Simulations - CCS).
• Understanding factors influencing performance on the CCS component is crucial for medical licensure.

Purpose of the Study:

• To determine if the type and duration of postgraduate training influence performance on the USMLE Step 3 CCS.
• To compare CCS performance based on residency training focus (broad vs. narrow).

Main Methods:

• Retrospective cohort study of 40,588 US and Canadian medical school graduates taking Step 3 for the first time (March 2007-December 2009).
• Postgraduate training was categorized as broadly focused (general medicine) or narrowly focused (specialized medicine).
• Statistical analysis included a three-way MANOVA and regression analysis of CCS scores against Step 1 and Step 2 CK scores.

Main Results:

• A significant difference in CCS scores was observed between broadly focused (mean=216) and narrowly focused (mean=211) residencies (p < 0.001).
• Examinees in broadly focused residencies demonstrated better overall performance, with scores increasing with training length compared to narrowly focused residencies.
• USMLE Step 1 and Step 2 CK scores explained 55% of overall Step 3 variability and 9% of CCS score variability.

Conclusions:

• Performance on the USMLE Step 3 CCS may be influenced by similar factors as overall Step 3 performance.
• The findings support the validity of the USMLE Step 3 program.
• Results can inform program directors and residents regarding examination readiness.