在成人重建奖学金申请人的个人陈述中检测人工智能生成的文本
Jonathan M Stern1, Antonio Fernandez-Perez1, Natalia Cruz-Ossa1
1Department of Orthopaedic Surgery, University of Miami Miller School of Medicine, Miami, FL, USA.
The Journal of arthroplasty
|August 13, 2025
概括
在成人重建奖学金申请的个人陈述中,人工智能 (AI) 的使用在ChatGPT之后显著增加.
科学领域:
- 医学教育 医学教育
- 人工智能的人工智能
- 手术奖学金 手术奖学金
背景情况:
- 像ChatGPT这样的大型语言模型 (LLM) 在各种专业领域越来越多地使用.
- 人工智能对写成年重建奖学金申请的个人陈述 (PS) 的影响尚不清楚.
- 本研究调查了在ChatGPT发布之前和之后的PS中人工智能生成文本的流行程度.
研究的目的:
- 量化成人重建奖学金申请的个人陈述中人工智能生成文本的增加.
- 为了比较AI文本在提交的个人陈述中的普及率,在先进的AI写作工具普及之前和之后.
- 在奖学金申请者中识别人工智能利用的人口差异.
主要方法:
- 对于成人重建奖学金申请 (2021-2022年和2024-2025年) 的421个个人陈述的回顾性审查.
- 由于人工智能采用率不确定,排除了2023年的应用.
- 使用GPTZeroAI检测软件进行分析,以区分人工智能生成的文本和人类生成的文本.
主要成果:
- 在ChatGPT发布后的队列中 (15.1%的AI) 与发布前队列 (0.4%的AI) 相比,观察到人工智能生成文本的显著增加.
- 国际医学毕业生和来自非美国住院的毕业生显示,人工智能生成文本的比例更高.
- 释放前和释放后队列之间的AI文本流行率的差异在统计学上是显著的 (P < 0.001).
结论:
- 人工智能在为奖学金申请撰写个人陈述中的使用在ChatGPT之后显著增加.
- 研究结果表明,医疗应用中人工智能辅助写作需要透明度和标准化指南.
- 重新评估个人陈述在候选人选择中的作用是合理的,研究可能扩展到其他专业.
相关概念视频
01:16Non-equilibrium in the Cell
4.8K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.8K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.3K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.3K
02:05Self-Presentation: Self-Monitoring and Self-Handicapping
40.2K
People can go to great lengths to protect their self-image and present themselves in ways that they want others to see them. Sociologist Erving Goffman presented the idea that a person is like an actor on a stage. Calling his theory dramaturgy, Goffman believed that we use “impression management” to present ourselves to others as we hope to be perceived. Each situation is a new scene, and individuals perform different roles depending on who is present (Goffman, 1959). Think about...
40.2K
01:00Detection of Gross Error: The Q Test
6.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.4K