人类和人工智能 (AI) 在撰写和评分修复牙科论文中的比较
Afnan O Al-Zain1, Abdulrahman A Alghamdi1, Bashair Alansari2
1Department of Restorative Dentistry, Faculty of Dentistry, King Abdulaziz University, Jeddah, Saudi Arabia.
概括
人工智能写作工具显示,与学生的论文相比,科学内容存在差异. 教师可以识别人工智能撰写的作品,双子座比ChatGPT-4更接近人类写作质量.
科学领域:
- 医学教育 医学教育
- 人工智能在写作中的应用
- 科学沟通科学沟通
背景情况:
- 学术界越来越多地使用人工智能写作工具,因此需要了解它们的输出质量.
- 评估人类专家和人工智能在区分人工智能生成的内容和人类写作的可靠性至关重要.
- 评估AI写作表现与既定标签相比,对于学术诚信至关重要.
研究的目的:
- 将人工智能生成的论文 (ChatGPT-4,Gemini) 的写作质量与学生撰写的论文进行比较.
- 评估教师在区分AI和学生写作方面的准确性.
- 通过使用标准化标题来评估人类和人工智能评级者之间的评分一致性.
主要方法:
- 在四个临床前牙科主题上生成了48篇文章,由学生和两个AI工具 (ChatGPT-4,Gemini) 撰写.
- 文章由盲目的教师专家和AI评分员使用修改后的通用科学写作类型进行评估.
- 统计分析包括沙皮罗-威尔克,克鲁斯卡尔-瓦利斯,恩的对称,威尔科克森的签名等级和弗里德曼测试 (α=0.05).
主要成果:
- 人工智能和学生撰写的论文在科学内容和解释方面存在显著差异.
- 与双子座和学生论文相比,ChatGPT-4论文在科学内容上显示出显著的差异.
- 教师正确识别了75%的人工智能撰写的论文;人工智能评级者没有显著差异,而人类评级者在总体得分上存在边际差异.
结论:
- 双子座的文章分数比ChatGPT-4更接近人类撰写的文章,这表明与人类写作更好地对齐.
- 虽然人工智能可以模仿人类的写作,但训练有素的教师可以识别内容质量和组织方面的差异.
- 人工智能产生的学术写作与人类撰写的学术写作之间存在科学内容和组织结构的差异.
相关概念视频
01:16Non-equilibrium in the Cell
5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K
01:20Introduction to Cognitive Psychology
2.2K
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
2.2K
01:15Teeth
1.6K
The formation of teeth, also known as odontogenesis, is a complex process that begins in utero, around the sixth week of embryonic development. There are three stages to this process: the bud stage, the cap stage, and the bell stage.
In the bud stage, the tooth germ (an aggregation of cells) starts to form in the developing jawbone. During the cap stage, the tooth germ differentiates into enamel organ, dental papilla, and dental sac, which will later develop into the tooth's enamel, dentin...
In the bud stage, the tooth germ (an aggregation of cells) starts to form in the developing jawbone. During the cap stage, the tooth germ differentiates into enamel organ, dental papilla, and dental sac, which will later develop into the tooth's enamel, dentin...
1.6K