评估GPT,Bard和Bing聊天机器人在基本生命支持场景中的响应的正确性和可靠性
Saeed Aqavil-Jahromi1, Mohammad Eftekhari2,3, Hamideh Akbari2
1Department of Emergency Medicine, Imam Khomeini Hospital Complex, Tehran University of Medical Sciences, Tehran, Iran. saeedaqavil@gmail.com.
Scientific reports
|April 3, 2025
概括
像GPT-4这样的AI聊天机器人对成人基本生命支持 (BLS) 指导有希望,但在儿科和婴儿场景中扎. 人类监督对于人工智能辅助的应急响应至关重要.
科学领域:
- 医学教育 医学教育
- 医疗保健中的人工智能
- 紧急医疗 紧急医疗
背景情况:
- 基本生命支持 (BLS) 对于改善紧急情况下的生存和神经结果至关重要.
- 生成性AI聊天机器人越来越多地用于健康信息,这促使评估其在重症监护指导中的可靠性.
- 该研究解决了评估人工智能聊天机器人在提供即时BLS指令方面的性能需求.
研究的目的:
- 评估领先的人工智能聊天机器人 (GPT-3.5,GPT-4,Bard,Bing) 响应基本生命支持 (BLS) 场景的准确性和可靠性.
- 在成年,儿科和婴儿BLS情况中比较不同AI模型的性能.
- 确定当前人工智能聊天机器人是否适合通过紧急生命支持程序指导非专业人士.
主要方法:
- 一项横截面研究使用了从客观结构化临床检查 (OSCE) 改编的六个BLS场景.
- 涵盖成人,儿科和婴儿紧急情况的场景在两个不同的场合向GPT-3.5,GPT-4,Bard和Bing提出.
- 应答被紧急医学的教授评估,使用基于BLS-OSCE标准的检查清单,测量正确性和可靠性 (科恩的卡帕).
主要成果:
- 在成人BLS场景中,GPT-4实现了最高的正确性 (85%),而Bard显示了60%.
- 所有的聊天机器人在儿科 (Bard 52.17%) 和婴儿场景 (所有 <44%的正确性) 中表现不佳.
- 可靠性各不相同,GPT-4和GPT-3.5显示实质性协议,Bing中度,Bard公平.
结论:
- 在测试的AI聊天机器人中,GPT-4显示了成年BLS指导准确度的最大潜力.
- 当前的人工智能聊天机器人在儿科和婴儿BLS场景中表现出显著的局限性,并且不一致地遵守指南.
- 由于目前的可靠性问题,人工智能聊天机器人需要人类监督来指导旁观者执行救生程序.
相关概念视频
Mechanical Ventilation III: Noninvasive Ventilation
66
Noninvasive positive-pressure ventilation (NIPPV), continuous positive airway pressure (CPAP), and bilevel positive airway pressure (BiPAP) are essential methods in respiratory care. These ventilation techniques offer unique benefits for patients with various respiratory conditions, providing adequate support without requiring intubation. Let's explore how each method is crucial in improving patient outcomes and enhancing respiratory therapy.
Noninvasive Positive-Pressure Ventilation...
Noninvasive Positive-Pressure Ventilation...
66
Errors occurring during blood pressure monitoring
574
Blood pressure monitoring is a crucial clinical procedure in diagnosing and managing various cardiovascular conditions. Despite its significance, the accuracy of blood pressure measurements can be compromised by multiple factors, potentially leading to either falsely high or low readings. These inaccuracies are critical as they can significantly impact patient care. So, it is vital to understand these challenges deeply and adopt strategic approaches to minimize errors.
Several factors...
Several factors...
574
Pre-Procedural Guidelines for Assessing Blood Pressure
517
Accurate blood pressure assessment is crucial for diagnosing and managing various health conditions. To ensure the reliability of these measurements, healthcare professionals must adhere to standardized pre-procedural guidelines. These guidelines enhance patient safety and improve the overall quality of healthcare. The following steps are essential for obtaining accurate and consistent blood pressure readings, from using the appropriate tools to ensuring effective communication with the...
517
SBAR II: Application of SBAR
4.2K
SBAR is an effective communication tool used by healthcare professionals to communicate patient information accurately. SBAR stands for Situation, Background, Assessment, and Recommendation. For a better understanding, an example is given below.
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
4.2K
Assessment of Airway, Skin Color, and Use of Accessory Muscles
941
A thorough assessment of respiratory health is paramount in clinical settings to identify and manage respiratory distress and ensure adequate oxygenation. This article elaborates on the critical aspects of respiratory evaluation, including airway assessment, skin color examination, and the observation of accessory muscle use, which are integral to effectively diagnosing and managing patients with respiratory conditions.
Introduction
The initial evaluation of a patient's respiratory system...
Introduction
The initial evaluation of a patient's respiratory system...
941


