The role of academic achievements and psychometric measures in the ranking process

Ranking candidates for residency positions is challenging. We hypothesize that applicant academic achievements and performance during the interview are equally important in the ranking process.

This is a retrospective study. Of 53 candidates interviewed during 2016-2017 cycle, 44 (83%) were ranked for 3 PGY1 positions. Each candidate was interviewed and scored in each of the following: USMLE Step 1 score, USMLE Step 2 score, research (RS), letters of recommendation (LOR), personal statement (PS), the way the candidate represented him/herself (RP), interest in the area (IN), answers to standardized questions (SQ), and degree of connection between the candidate and the interviewer (CN).

Correlation and multiple regression analyses indicated an inverse relationship between ranking the candidates and USMLE2 (r = -0.14, p = -0.364), LOR (r = -0.513, p < 0.001), PS (r = -0.414, p = 0.006), RP (r = -0.485, p = 0.001), CN (r = -0.605, p < 0.001), IN (r = -0.349, p = 0.022), and SQ (r = -0.480, p = 0.001), USMLE1 (r = -0.036, p = 0.838) and RS (r = -0.008, p = 0.96). After controlling for the other variables, only CN reached statistical significance (p = 0.033).

Candidate non-cognitive measures during the interview weigh higher than academic performance in the ranking process.