Assessing the Accuracy of Otomatch.com Data for Individuals Applying to Otolaryngology Residency

Otomatch.com is an online forum for residency applicants to discuss the otolaryngology match process including academic metrics. The purpose of this study is to assess the accuracy of self-reported match data on Otomatch relative to official data reported by the National Residency Match Program (NRMP) and the Association of American Medical Colleges (AAMC).

Data was collected from publicly editable Otomatch forums (2017-2018, 2018-2019, 2019-2020) and curated Otomatch survey responses (2018-2019, 2019-2020) whose results are released after Match Day. Aggregated data was collected from the NRMP 2018 and 2020 Charting Outcomes in the Match and AAMC Report on Residents (2017-2018, 2018-2019). Measures of interest included Step 1 scores, Step 2 CK scores, publications, number of interview invitations, number of interviews attended, and AOA status. ANOVA and 2 tailed T tests were performed to compare variables within each match year.

Average Step 2 CK score was significantly higher on publicly editable Otomatch forums than AAMC in 2017-2018 (257vs 253, P < .05) and 2018-2019 (258vs 252, P < .05). Interviews attended were significantly higher on Otomatch survey responses than the publicly editable forum in 2019-2020 (13vs 9, P-value < .05). Step 1 scores, interview invitations, and AOA status were not statistically significantly different when data was available.

Applicant statistics from online forums, online surveys, NRMP, and AAMC are consistent, except for Step 2 CK scores. Self-reported data on the Otomatch forum is an accurate estimate of academic metrics of otolaryngology residency applicants.