评估人类区分ChatGPT生成和原始科学摘要的能力
Kylie J Nabata1,2, Yasir AlShehri3, Abdullah Mashat1,2
1Department of Surgery, St. Paul's Hospital, 1081 Burrard St., Vancouver, BC, V6Z 1Y6, Canada.
Updates in surgery
|January 24, 2025
概括
人类审稿人很难识别人工智能生成的科学摘要. 一项研究发现,参与者更喜欢ChatGPT摘要,突出了AI.
科学领域:
- 医学教育 医学教育
- 研究中的人工智能.
- 科学沟通科学沟通
背景情况:
- 人工智能 (AI) 的快速发展需要了解它对学术写作的影响.
- 评估像ChatGPT这样的AI工具在生成科学内容方面的能力对于学术完整性至关重要.
研究的目的:
- 评估人类审查员在区分人工智能生成 (ChatGPT) 和原始科学摘要的准确性.
- 在学术写作中探索审稿人的偏好和对AI产生的内容的看法.
主要方法:
- 通过在线调查进行了一项观察性,横截面研究.
- 参与者 (外科实习生和教师) 获得了一个原始和一个ChatGPT生成的摘要.
- 受访者确定了人工智能生成的摘要,并提供了关于偏好和感知的反.
主要成果:
- 只有40%的参与者正确识别了原来的摘要.
- 大多数 (63.4%) 的人更喜欢ChatGPT生成的摘要 (p=0.0001).
- 对原始摘要的偏好与正确的识别相关 (OR 7.46).
结论:
- 人类审稿人在区分人工智能产生的原始科学摘要方面表现出有限的准确性.
- 在学术评论家中,人们明显喜欢人工智能生成的摘要.
- 这些发现强调了需要解决人工智能在手稿制作中的影响和伦理考虑.
相关概念视频
Synthetic Biology
4.7K
Synthetic biology is an interdisciplinary science that involves using principles from disciplines such as engineering, molecular biology, cell biology, and systems biology. It involves remodeling existing organisms from nature or constructing completely new synthetic organisms for applications such as protein or enzyme production, bioremediation, value-added macromolecule production, and the addition of desirable traits to crops, to name a few.
Golden rice
Golden rice is a genetically modified...
Golden rice
Golden rice is a genetically modified...
4.7K
Leaky Scanning
5.1K
During most eukaryotic translation processes, the small 40S ribosome subunit scans an mRNA from its 5' end until it encounters the first start AUG codon. The large 60S ribosomal subunit then joins the smaller one to initiate protein synthesis. The location of the translation initiation is largely determined by the nucleotides near the start codon as there may be multiple translation initiation sites present on the mRNA. Marilyn Kozak discovered that the sequence RCCAUGG (where R...
5.1K
Types of Genetic Transfer Between Organisms
27.0K
Genetic transfer occurs when genetic information is passed from one organism to another. It occurs via two mechanisms: vertical gene transfer and horizontal gene transfer. Vertical gene transfer occurs when genetic information is transferred from one generation to the next, which happens much more frequently than horizontal gene transfer. Both sexual and asexual reproduction are forms of vertical gene transfer, where one or more organisms pass some or all of their genome onto their progeny.
27.0K
Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
Single Nucleotide Polymorphisms-SNPs
13.9K
A single nucleotide polymorphism or SNP is a single nucleotide variation at a specific genomic position in a large population. It is the most prevalent type of sequence variation found in the human genome. Point mutations that occur in more than 1% of the population qualify as SNPs. These are present once every 1000 nucleotides on an average in the human genome. Replacement of a purine with another purine (A/G) or a pyrimidine with another pyrimidine (C/T) is known as a transition. In contrast,...
13.9K
Framing Effects
7.3K
Information is everywhere and its presentation—such as how and when items are presented—can impact our perceptions and decisions surrounding the info. This broad concept umbrellas framing effects—influences that occur due to the way information is framed in its appearance, whether it’s purely the order or the specific wording of a message. Let’s take a look at numerous ways in which two versions of something can objectively say the same thing, yet we respond in...
7.3K


