Related Experiment Video
Updated: Sep 11, 2025
08:48
Adapted Resistance Training Improves Strength in Eight Weeks in Individuals with Multiple Sclerosis
Published on: January 29, 2016
16.9K
Detecting Artificial Intelligence-Generated Text in Personal Statements of Adult Reconstruction Fellowship Applicants
Jonathan M Stern1, Antonio Fernandez-Perez1, Natalia Cruz-Ossa1
1Department of Orthopaedic Surgery, University of Miami Miller School of Medicine, Miami, Florida.
The Journal of Arthroplasty
|August 13, 2025
Summary
The use of artificial intelligence (AI) in personal statements for adult reconstruction fellowship applications significantly increased after ChatGPT
Area of Science:
- Medical Education
- Artificial Intelligence
- Surgical Fellowships
Background:
- Large language models (LLMs) like ChatGPT are increasingly used in various professional fields.
- The impact of AI on personal statement (PS) writing for adult reconstruction fellowship applications is not well understood.
- This study investigates the prevalence of AI-generated text in PSs before and after ChatGPT's release.
Purpose of the Study:
- To quantify the increase in AI-generated text in personal statements for adult reconstruction fellowship applications.
- To compare AI text prevalence in personal statements submitted before and after the widespread availability of advanced AI writing tools.
- To identify demographic differences in AI utilization among fellowship applicants.
Main Methods:
- Retrospective review of 421 personal statements for adult reconstruction fellowship applications (2021-2022 and 2024-2025).
- Exclusion of 2023 applications due to uncertain AI adoption rates.
- Analysis using GPTZero AI detection software to differentiate AI-generated from human-generated text.
Main Results:
- A significant increase in AI-generated text was observed in the post-ChatGPT release cohort (15.1% AI) compared to the pre-release cohort (0.4% AI).
- International medical graduates and those from non-U.S. residencies showed a higher proportion of AI-generated text.
- The difference in AI text prevalence between the pre- and post-release cohorts was statistically significant (P < 0.001).
Conclusions:
- AI use in personal statement writing for fellowship applications has markedly increased post-ChatGPT.
- Findings suggest a need for transparency and standardized guidelines for AI-assisted writing in medical applications.
- Re-evaluation of personal statements' role in candidate selection is warranted, with potential expansion of research to other specialties.
Related Concept Videos
01:16Non-equilibrium in the Cell
4.8K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.8K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.3K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.3K
02:05Self-Presentation: Self-Monitoring and Self-Handicapping
40.2K
People can go to great lengths to protect their self-image and present themselves in ways that they want others to see them. Sociologist Erving Goffman presented the idea that a person is like an actor on a stage. Calling his theory dramaturgy, Goffman believed that we use “impression management” to present ourselves to others as we hope to be perceived. Each situation is a new scene, and individuals perform different roles depending on who is present (Goffman, 1959). Think about...
40.2K
01:00Detection of Gross Error: The Q Test
6.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.4K