探索人工智能的极限,用于引用科学文章
Emily M Graf1, Jordan A McKinney1, Alexander B Dye1
1Department of Obstetrics and Gynecology, University of Florida College of Medicine, Jacksonville, Florida.
American journal of perinatology
|April 23, 2024
概括
像谷歌Bard,ChatGPT和Chatsonic这样的人工智能 (AI) 聊天机器人与准确的产科文献参考作斗争. 谷歌Bard显示了最高的准确性,但所有模型都经常产生不正确或不存在的引用.
科学领域:
- 产科和妇科 产科和妇科
- 人工智能在医学中的应用
- 科学出版 科研出版
背景情况:
- 人工智能 (AI) 聊天机器人越来越多地用于信息检索和科学写作.
- 在诸如产科之类的专业医疗领域,人工智能生成的参考资料的可靠性尚未得到充分证实.
- 准确的引用对于科学完整性和可重复性至关重要.
研究的目的:
- 评估三种流行的人工智能聊天机器人 (ChatGPT,Google Bard,Chatsonic) 在生成产科随机对照试验 (RCT) 的参考资料中的准确性.
- 为了比较这些AI模型在正确引用关键参考组件 (作者,标题,期刊,DOI) 的性能.
主要方法:
- 三个人工智能聊天机器人 (ChatGPT,Google Bard,Chatsonic) 被提示提供2020年发表的44个产科RCT的参考资料.
- 根据正确引用作者,标题,期刊和数字对象标识符 (DOI) 来评估参考准确性.
- 为了对人工智能模型性能进行统计比较,使用了一种排列测试.
主要成果:
- 谷歌Bard取得了最高的准确性,正确引用了13.6%的引用.
- 聊天GPT和Chatsonic的准确性分别为2.4%和0%,显著降低.
- 所有人工智能模型生成的大多数引用包含不正确或不存在的数字对象标识符 (DOI).
结论:
- 作者必须谨慎使用人工智能聊天机器人进行文献搜索和科学写作,因为引用不准确.
- 尽管目前存在局限性,但AI聊天机器人有可能与研究人员进行协同合作,以推进患者护理.
- 负责任的AI实施对于保持科学信息传播的完整性至关重要.
相关概念视频
Non-equilibrium in the Cell
4.4K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.4K
Introduction to Cognitive Psychology
477
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
477
Natural and Artificial Concepts
155
In psychology, concepts can be divided into two categories: natural and artificial. Natural concepts are formed through direct or indirect experiences. For example, consider the concept of snow. If you live in a place with regular snowfall, such as Essex Junction, Vermont, you know snow through direct experiences. You’ve seen it fall, touched it, shoveled it, and played in it. You recognize its texture, appearance, and even its smell. In contrast, if you live on an island like Saint...
155


