比较人工智能生成和人类同行评价:对11篇文章的研究
Domenico Marrella1, Su Jiang2, Kyros Ipaktchi3
1Department of Hand Surgery, Strasbourg University Hospitals, FMTS, 1 Avenue Molière, 67200 Strasbourg, France.
Hand surgery & rehabilitation
|July 22, 2025
概括
与人类审稿人相比,ChatGPT表现出优越的同行评审能力,为科学手稿提供更高质量的评估和更快的决策. 仔细实施是利用人工智能提高出版标准的关键.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 科学出版科学出版
背景情况:
- 科学文章的传统同行评审过程面临重大挑战,包括提交量增加和审查持续时间延长.
- 评估手稿的质量和适用性对于保持科学完整性和推进医学知识至关重要.
研究的目的:
- 评估大型语言模型,特别是ChatGPT (4o和o1版本) 在执行编辑决策和生成外科手稿的同行评审方面的有效性.
- 为了测试这个假设,ChatGPT的同行评审质量超过了人类评审者的质量.
主要方法:
- 十一篇匿名,先前发表的手术文章被ChatGPT 4o和o1评估,以获得出版资格和同行评审.
- 一位经验丰富的手术医生利用ARCADIA评分来评估人类生成和ChatGPT生成的同行评价的质量.
主要成果:
- 聊天GPT模型的接受率很高 (4o的95%,o1的98%),并且与影响因素较低的期刊的一致性更高.
- 与人类评论 (2.8-3.2) 相比,ChatGPT生成的同行评论获得了显著更高的ARCADIA评分 (4.8为4o,4.9为o1).
结论:
- 聊天GPT显示了增强科学同行评审过程的潜力,比人类评审者提供更高的质量和效率.
- 为了减轻人工智能"幻觉",需要准确的指令,对人工智能局限性的严格管理对于提高科学出版物质量至关重要.
关键词:
人工智能的人工智能是人工智能.聊天GPT 聊天 在GPT 聊天手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手术手 ...大型语言模型.同行评审是一项同行评审.科学文章 科学文章.更多相关视频
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
690
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
586
相关概念视频
The Sense of Self: Reflected Self-Appraisal and Social Comparison
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
Stereotype Content Model
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence categorization, a person will feel...
Empathy
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
Non-equilibrium in the Cell
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
Review and Preview
In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...
Percentiles are a type of fractile that partition data into...
Causes of Similarity-Dissimilarity Effect
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
