可以在科学摘要中识别自己的文字吗?
1Internal Medicine, University Institute for Primary Care, Geneva University Hospital, Geneva, CHE.
Cureus
|August 27, 2025
概括
聊天GPT-4.0努力区分人类和人工智能生成的科学摘要. 这项研究发现错误分类率很高,表明需要更好的工具来确保学术作者透明度.
科学领域:
- 科学文献中的人工智能
- 学术出版的诚信
背景情况:
- 生成性AI的扩散在区分人工智能产生的科学内容方面带来了挑战.
- 评估像ChatGPT-4.0这样的先进人工智能模型的自我识别人工智能生成文本的能力对于维持学术标准至关重要.
研究的目的:
- 评估ChatGPT-4.0在区分人类撰写和人工智能生成的科学摘要方面的准确性.
- 确定ChatGPT-4.0是否可以在科学环境中可靠地识别自己的输出.
主要方法:
- 从具有影响力的内科杂志中选择了2000年的100篇原始研究摘要.
- 从这些文章的全文中生成新的摘要.
- ChatGPT-4.0对原始和人工智能生成的摘要进行了两次评估,在0-10级别上对作者概率进行了评分.
主要成果:
- 在两轮评估中都发现错误分类率很高 (49%和47.5%).
- 没有任何摘要被赋予中性分数 (5),表明缺乏不确定性.
- 统计分析显示得分分布的重叠和差异一致 (科恩卡帕=0.33,加权卡帕=0.24).
结论:
- 聊天GPT-4.0显示无法可靠地区分人类和人工智能生成的科学摘要.
- 这些发现强调需要开发先进的外部工具来验证作者身份并确保学术出版的透明度.
相关概念视频
Genetic Lingo
104.6K
Overview
104.6K
Proofreading
54.9K
Overview
54.9K
GPCRs Regulate Adenylyl Cylase Activity
5.9K
Some GPCRs transmit signals through adenylyl cyclase (AC), a transmembrane enzyme. AC helps synthesize second messenger cyclic adenosine monophosphate (cAMP). AC catalyzes cyclization reaction and converts ATP to cAMP by releasing a pyrophosphate. The pyrophosphate is further hydrolyzed to phosphate by the enzyme pyrophosphatase, which drives cAMP synthesis to completion. However, cAMP is rapidly degraded to 5′ AMP by the enzymes phosphodiesterase (PDE), preventing overstimulation of...
5.9K
Improving Translational Accuracy
11.9K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.9K
GTPases and their Regulation
2.4K
2.4K
Scanning Electron Microscopy
4.4K
A scanning electron microscope (SEM) is used to study the surface features of a sample by using an electron beam that scans the sample surface in a two-dimensional manner. Typically, areas between ~1 centimeter to 5 micrometers in width can be imaged. SEM can be used to image bacteria, viruses, tissues as well as larger samples like insects. Conventional SEM gives a magnification ranging from 20X to 30,000X and spatial resolution of 50 to 100 nanometers.
Fundamental Principles
Accelerated...
Fundamental Principles
Accelerated...
4.4K


