聊天GPT-4知道它的ABCDE,但不能引用它的来源
Diane Ghanem1, Alexander R Zhu2, Whitney Kagabo1
1Department of Orthopaedic Surgery, The Johns Hopkins Hospital, Baltimore, Maryland.
JB & JS open access
|September 6, 2024
概括
在创伤外科手术中,ChatGPT-4为气道,呼吸,循环,残疾,暴露 (ABCDE) 方法提供了不准确或不存在的参考. 超过一半的参考资料是不可靠的,这引起了医疗决策的担忧.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 创伤外科 手术 创伤外科
背景情况:
- 像ChatGPT这样的人工智能语言模型显示出在骨科手术中可访问的教育工具的希望.
- 然而,人工智能模型提供的引用的准确性是医疗内容完整性的关键问题.
- 这项研究重点关注ChatGPT-4对ABCDE创伤协议的引用的可靠性.
研究的目的:
- 评估ChatGPT-4为创伤外科手术中的气道,呼吸,循环,残疾,暴露 (ABCDE) 方法生成的引用的准确性.
- 评估人工智能生成的医学参考文献的可靠性和可重复性.
主要方法:
- 两个独立的审稿人评估了30个ChatGPT-4生成的引用,用于ABCDE创伤协议.
- 引用被评为不存在,不准确或准确.
- 科恩的卡帕系数和描述统计数据被用来分析评价者之间的一致性和平均准确性.
主要成果:
- 聊天GPT-4的平均参考准确度得分为66.7%.
- 在30个引用中,只有43.3%是准确的,56.7%是不准确或不存在的.
- 在五个创伤协议类别 (p = 0.437) 中,参考准确性是一致的.
结论:
- 聊天GPT-4的不准确或不存在的引用率很高 (57%),这引起了专业医疗决策的安全问题,而没有验证.
- 人工智能模型可以作为辅助学习工具,如果谨慎地使用交叉引用来增强知识排练.
相关概念视频
Sources of Law
1.1K
Laws form the essential rules set by governing authorities to shape and control societal behavior. In nursing, laws guide actions, safeguard patient rights, define nurses' scope of practice, and maintain professional standards. Understanding the legal framework governing nursing involves recognizing four primary sources of law: constitutional, statutory, administrative (regulatory), and common law.
Constitutional law is foundational, deriving from federal and state constitutions, and...
Constitutional law is foundational, deriving from federal and state constitutions, and...
1.1K
Methods of Documentation III: PIE
1.4K
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
1.4K
GTPases and their Regulation
2.2K
2.2K
The Availability Heuristic
5.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
5.9K
Methods of Documentation I: Source-Oriented Records
1.1K
Source-oriented records, or SOR, are medical record-keeping organized by the data source. The SOR system was first developed in the mid-1900s to organize the growing patient data in hospitals and other healthcare facilities.
In an SOR, each discipline involved in patient care maintains a separate medical record section. This record-keeping method enables easy tracking of patient progress and ensures healthcare staff have access to up-to-date information.
Key Attributes include the following:
In an SOR, each discipline involved in patient care maintains a separate medical record section. This record-keeping method enables easy tracking of patient progress and ensures healthcare staff have access to up-to-date information.
Key Attributes include the following:
1.1K
Independent and Dependent Sources
1.1K
In electrical circuits, sources play a crucial role in providing power for the operation of the circuit. These sources can be broadly categorized into two types: independent and dependent.
Independent voltage or current sources supply a fixed amount of voltage or current, respectively, which is unaffected by other elements within the circuit. These are represented using specific symbols. Independent voltage sources are symbolized with polarities (+ and -), indicating the direction of the...
Independent voltage or current sources supply a fixed amount of voltage or current, respectively, which is unaffected by other elements within the circuit. These are represented using specific symbols. Independent voltage sources are symbolized with polarities (+ and -), indicating the direction of the...
1.1K


