Hybrid residency interviews: using standardized questions to promote consistent evaluation

There are conflicting guidelines on whether residency programs should use all virtual or hybrid interview approaches, with limited evidence to support either approach. Applicants also have indicated a preference to visit places in person before they rank them highly.

The Department of Emergency Medicine at the Southern Illinois University School of Medicine developed standardized interview questions and trained interviewers on their use for both virtual and in-person interview days for the 2023 to 2024 residency interview cycle. The scores of those questions were the sole quantitative assessment of an applicant's interview. The authors then assessed whether there was any evidence of preferential scoring for in-person or virtual applicants.

For the academic year 2023 to 2024 interview cycle, 159 applicants were interviewed, 109 virtually and 50 in person. No significant association was found between applicant sex and their choice of interviewing in person or virtually. However, a statistically significant association was found between being a rotator and the type of interview chosen. Among the 23 applicants who rotated with the department, 19 (83%) selected to interview in person, whereas only 31 of 136 nonrotators (23%) chose the in-person interview (P < .001). There was no statistically significant difference in mean scores between in-person and virtual interview groups, which suggests the scoring was consistent whether the interview was conducted in person or virtually. A hybrid approach to residency interviews may appeal to both programs and applicants by providing geographic flexibility while maintaining an equitable and impartial interview process.

Next steps would be to expand this study to multiple institutions and specialties to understand the generalizability of the study better and the impact of this interview method on the construction of a rank list.