The Validity of Scores From the New MCAT Exam in Predicting Student Performance: Results From a Multisite Study

Area of Science:

• Medical Education Research
• Admissions Testing Validity

Background:

• The Medical College Admission Test (MCAT) is a standardized exam for medical school admissions.
• Assessing the predictive validity of new examination formats is crucial for admissions processes.

Purpose of the Study:

• To evaluate the validity of scores from the new MCAT exam in predicting first-year medical school (M1) performance.
• To determine if MCAT scores predict M1 performance comparably across different demographic groups.

Main Methods:

• Analysis of data from 7,970 national 2016 matriculants and 955 participants from 16 medical schools.
• Correlations between MCAT scores, undergraduate GPAs (UGPAs), and M1 summative performance.
• Assessment of on-time progression to the second year of medical school (M2).

Main Results:

• MCAT scores demonstrated medium to large correlations with M1 performance.
• MCAT scores and UGPAs showed similar predictive power individually, but combined prediction was superior.
• MCAT scores provided comparable M1 performance prediction across various race/ethnicity, socioeconomic, and gender groups.
• Students with a broad range of MCAT scores successfully progressed to M2 on time.

Conclusions:

• The new MCAT exam scores show early evidence of validity in predicting first-year medical student performance.
• MCAT scores are a valuable tool for predicting academic success in the initial year of medical school.
• Further research is needed to assess MCAT validity for predicting performance in later medical school years.