Related Experiment Video
Updated: Jun 14, 2026
A Unified Methodological Framework for Vestibular Schwannoma Research
Published on: June 20, 2017
Generative AI in Otolaryngology Residency Personal Statement Writing: A Mixed-Methods Analysis
Jacob G J Wihlidal1, Nikolaus E Wolter1,2, Evan J Propst1,2
1Department of Otolaryngology-Head and Neck Surgery, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.
Objective:
Generative Artificial Intelligence (GAI) interfaces have rapidly integrated into various societal domains. Widespread accessibility of GAI for drafting personal statements poses challenges for evaluators to gauge writing ability and personal insight. This study aims to compare the quality of GAI-generated personal statements to those written by successful applicants in OHNS residency programs, via integration of statistical and qualitative thematic analyses.
Methods:
Personal statements were collected from successful OHNS residency applicants. Characteristic extraction from submitted statements was used to generate GAI-written personal statements using ChatGPT 4.0. All statements were blindly reviewed by 21 experienced evaluators on a 10-point Likert scale of authenticity, readability, personability, and overall quality. Thematic analysis of qualitative reviewer comments was conducted to extract deeper insights into evaluators' perceptions. Quantitative results were compared using independent t-tests, while thematic coding was performed inductively using NVivo software.
Results:
GAI-generated personal statements significantly outperformed applicant-written statements in all assessed domains, including authenticity (7.67 vs. 7.05, p = 0.002), readability (8.03 vs. 7.49, p = 0.002), personability (7.33 vs. 6.72, p = 0.004), and overall score (7.49 vs. 6.90, p = 0.005). Thematic analysis revealed that GAI statements were seen as "well-constructed but generic," while applicant statements were often "verbose and lacked focus." Additionally, reviewers noted concerns regarding personal insight and engagement in AI-generated statements.
Conclusion:
GAI-generated personal statements were rated more favorably across all domains, raising critical questions about the future of personal statements in the residency application process. While AI in medical education continues to evolve, clear guidelines on its ethical use in residency applications are essential.
Level Of Evidence:
N/A.
