个人陈述的死亡:人类撰写的和人工智能生成的医学院招生之间的定性比较 论文
Matthew J Vaccaro1, Ishpriya Sharma2, Andrea P Espina-Rey1
1From the, University of Central Florida College of Medicine, Orlando, FL (Vaccaro, Espina-Rey, Lyman, Zhang).
Journal of the American College of Surgeons
|October 6, 2025
概括
医学院招生可能会受到人工智能 (AI) 的影响. 人工智能生成的论文比人类撰写的论文得分更高,读者很难区分,这引发了人们对入学诚信的担忧.
科学领域:
- 医学教育 医学教育
- 在学术界的人工智能.
背景情况:
- 医学院招生依赖于个人陈述进行主观的申请人评估.
- 越来越多的人工智能 (AI) 在学术环境中的使用,需要了解它对招生的影响.
- 人工智能产生的个人陈述在医学院招生中所带来的区分能力和优势仍未得到审查.
研究的目的:
- 评估医学院招生读者的能力,以区分人工智能生成和人类撰写的个人陈述.
- 确定人工智能生成的个人陈述是否在医学院申请过程中提供了优势.
- 评估人工智能检测工具 (ZeroGPT) 在识别人工智能撰写文章方面的性能.
主要方法:
- 进行了一项前性,单盲,随机对照试验.
- 从2019年开始的人类撰写的文章被用作基线;ChatGPT 4.0从这些中生成AI文章.
- 医学院申请阅读器和ZeroGPT对文章的质量,作者和信心进行了评估.
主要成果:
- 读者在识别作者时获得了56%的准确性,而ZeroGPT获得了91%的准确性.
- 与人类撰写的论文 (4.67) 相比,人工智能生成的论文获得了更高的质量评分 (5.02).
- 读者更有可能将得分更高的文章评价为人类作者的文章.
结论:
- 人工智能生成的个人陈述的评分更高,几乎无法与人类评估者区分.
- 虽然ZeroGPT显示了高准确度,但其假阳性率对于当前的入院使用来说太高了.
- 由于人工智能的进步,在医学院招生中个人陈述的可信性需要紧急重新评估.
相关概念视频
Non-equilibrium in the Cell
5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K
Reliability and Validity
13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
The Sense of Self: Reflected Self-Appraisal and Social Comparison
55.4K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
55.4K
Comparing Experimental Results: Student's t-Test
4.9K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
4.9K
Comparing the Survival Analysis of Two or More Groups
553
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
553
What is Genetic Engineering?
79.6K
Overview
79.6K

