Objective Measures Needed: Dermatology Program Directors' Perspectives on the USMLE Step 1 Pass/Fail Transition

Area of Science:

• Medical Education
• Residency Admissions
• Licensing Examinations

Background:

• The United States Medical Licensing Examination (USMLE) Step 1 transitioned to a pass/fail scoring system in January 2022.
• This change necessitates adjustments in how medical residency programs evaluate applicants.

Purpose of the Study:

• To survey Dermatology residency program directors regarding their evaluation strategies post-USMLE Step 1 pass/fail implementation.
• To identify anticipated changes in candidate assessment criteria.

Main Methods:

• An online survey was administered to Dermatology program directors.
• Statistical analyses, including Chi-squared and paired t tests, were performed using R and MATLAB.
• Response data were analyzed to compare pre- and post-change evaluation criteria.

Main Results:

• Program directors plan to place greater emphasis on USMLE Step 2 CK (Clinical Knowledge) scores.
• Consideration of National Board of Medical Examiners (NBME) shelf exam scores and medical school ranking is anticipated.
• Some directors expressed a need for medical schools to disclose NBME shelf exam scores.

Conclusions:

• Increased reliance on Step 2 CK scores, NBME shelf exams, and institutional rank may affect holistic review.
• This transition presents an opportunity for programs to refine and potentially broaden their evaluation methods.
• Balancing new metrics with existing criteria is crucial for comprehensive candidate assessment.