Predicting Medical Student Performance With a Situational Judgment Test in Admissions.

Area of Science:

• Medical Education
• Admissions Testing
• Psychometrics

Background:

• Traditional medical school admissions rely on metrics like MCAT scores and GPAs.
• Situational Judgment Tests (SJTs) assess non-cognitive skills crucial for medical practice.
• The AAMC SJT is a prototype tool designed to evaluate these essential competencies.

Purpose of the Study:

• To investigate the correlation between AAMC SJT scores and medical student performance.
• To determine if SJT scores provide incremental predictive validity over existing admissions data (MCAT, GPA).
• To assess the SJT's utility in predicting various aspects of medical school success.

Main Methods:

• A prototype AAMC SJT was administered to first- and second-year medical students across 8 US institutions.
• Student performance data included faculty ratings, course grades, and professionalism evaluations.
• Bivariate correlations and hierarchical regressions were employed to analyze the data.

Main Results:

• SJT scores showed small positive correlations with first-year faculty ratings, particularly for social skills.
• Second-year correlations were higher, especially for social skills and cultural competence.
• SJTs improved prediction of faculty ratings for specific competencies, offering unique value over MCAT and GPA.

Conclusions:

• Initial evidence suggests AAMC SJT scores can enhance medical school admissions.
• SJT scores correlate with faculty assessments of professional behaviors.
• The SJT provides valuable information beyond traditional admissions metrics.