Preference Signaling: Does It Work? A MultispecialtyReview of the Data

Area of Science:

• Medical Education
• Residency Selection
• Application Trends

Background:

• Preference signaling was implemented in 2021 to combat application inflation and enhance alignment between residency applicants and programs.
• This study investigates the effects of preference signaling on residency application data across various medical specialties.

Purpose of the Study:

• To analyze the impact of preference signaling on application numbers and match rates in residency programs.
• To compare application trends before and after the introduction of preference signaling.

Main Methods:

• Analysis of Electronic Residency Application Service (ERAS) and National Resident Matching Program (NRMP) data from 2020 to 2024.
• Comparison of metrics including applicant numbers, applications per applicant, signals utilized, and match rates using mean differences, distinguishing between pre-signaling and post-signaling eras.

Main Results:

• Specialties with high signal usage, such as otolaryngology (ENT) and neurosurgery, saw significant reductions in applications per applicant (-23.8% and -12.8%).
• Orthopedics and dermatology experienced minimal changes (-7.8% and -0.1%), while anesthesiology and obstetrics/gynecology saw increases (+5.8% and +2.2%).
• Several specialties, including ENT, anesthesiology, orthopedic surgery, and neurosurgery, demonstrated concurrent increases in match rates.

Conclusions:

• Preference signaling shows potential for reducing application inflation and improving residency match rates.
• Confounding factors, such as shifts in application trends post-COVID-19, may influence observed data.
• The long-term impact of preference signaling will depend on its continued use and program-specific implementation strategies.