Related Experiment Video
Updated: Jun 28, 2025

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
Published on: August 26, 2018
Changes in Residency Applicant Cancellation Patterns with Virtual Interviews: A Single-site Analysis
Meryll Bouldin1, Carly Eastin1,2, Rachael Freeze-Ramsey1
1University of Arkansas for Medical Sciences, Department of Emergency Medicine, Little Rock, Arkansas.
Background:
Residency programs transitioned to primarily virtual interviews due to the COVID-19 pandemic. This shift raised questions regarding expectations and patterns of applicant cancellation timeliness. The purpose of this study was to examine changes in applicant cancellations after transitioning to virtual interviews.
Methods:
This was a retrospective cohort study of interview data from a three-year emergency medicine residency at a tertiary-care academic medical center. Using archived data from Interview Broker, we examined scheduling patterns between one in-person (2019-2020) and two virtual interview cohorts (2020-2021 and 2021-2022). Our outcomes were the overall cancellation rates relative to interview slots as well as the proportion of cancellations that occurred within 7 or 14 days of the interview date.
Results:
There were 453 interview slots and 568 applicants invited. Overall, applicants canceled 17.1% of scheduled interviews. Compared with in-person interviews, applicants canceled significantly fewer virtual interviews (in person: 40/128 (31.3%), virtual year 1: 22/178 (12.4%), virtual year 2: 15/143 (10.5%), P = 0.001). Conversely, applicants canceled significantly more virtual interviews within both the 14-day threshold (in person: 8/40 (20%), virtual year 1: 12/22 (55.5%), virtual year 2: 12/15 (80%), P < 0.001) and the 7-day threshold (in person: 0/40 (0%), virtual year 1: 3/22 (13.6%), virtual year 2: 4/15 (26.7%), P = 0.004).
Conclusion:
While limited, at our site, changing to a virtual interview format correlated with fewer cancellations overall. The proportion of cancellations within 14 days was much higher during virtual interview seasons, with most cancellations occurring during that time frame. Additional studies are needed to determine the effects of cancellation patterns on emergency medicine recruitment.
Related Concept Videos
Confirmation Biases
Surveys
Archival Research
Cross-Sectional Research

