Can admissions interviews predict performance in residency?

Area of Science:

• Medical Education
• Psychiatry Residency Training
• Predictive Analytics in Healthcare

Background:

• Residency selection relies on various admission metrics.
• The predictive validity of these metrics, particularly interviews, requires ongoing evaluation.
• Understanding predictors of resident performance is crucial for program development.

Purpose of the Study:

• To assess the predictive accuracy of admission interviews and other data for resident performance.
• To determine if interview scores correlate with performance in postgraduate years 2-4.
• To identify factors influencing resident retention in a psychiatry program.

Main Methods:

• Analysis of admission data, including interviews and letters of reference, for 544 psychiatry residents.
• Correlation of admission data with performance ratings in postgraduate years 2, 3, and 4.
• Assessment of prediction for resident program completion.

Main Results:

• Admission data explained 13% of performance variance in postgraduate year 2 and 5% in postgraduate year 4.
• Interview scores showed moderate to no correlation with performance across postgraduate years.
• Letters of reference demonstrated moderate correlation with early postgraduate performance but limited predictive power overall.

Conclusions:

• Current admission interview formats lack sufficient power to predict residency performance.
• Letters of reference may offer some predictive value, but differences are not substantial enough for sole decision-making.
• The primary utility of interviews may lie in applicant engagement rather than performance prediction.