采用ChatGPT,Gemini和DeepSeek的性能,用于在紧急部门使用现实对话进行非关键的分类支持
Sukyo Lee1, Sumin Jung2, Jong-Hak Park1
1Department of Emergency Medicine, Korea University Ansan Hospital, Ansan-si, 15355, Republic of Korea.
BMC emergency medicine
|September 1, 2025
概括
大型语言模型 (LLM) 显示出急诊室 (ED) 选的前景,通过现实对话准确评估患者的紧迫性. 几种模型具有高灵敏度和快速响应时间,支持它们在非关键分类工具中的使用.
科学领域:
- 医疗保健中的人工智能
- 临床决策支持系统
- 紧急医疗信息学
背景情况:
- 准确的急诊室分类对于患者的护理至关重要.
- 大型语言模型 (LLM) 正在探索以帮助分类决策.
- 现有的LLM评估通常使用模拟数据,而不是真实世界的临床病例.
研究的目的:
- 评估商业LLM在非关键性ED患者的分组中的性能.
- 使用真实世界的临床对话, 而不是模拟的场景来评估LLM的准确性.
- 在零射击和少数射击提示条件下比较多个LLM.
主要方法:
- 分析了来自韩国医院的 1,057 个真实世界诊断对话.
- 对商业LLM (例如GPT-4o,Gemini 2.5 flash/pro) 进行基于对话的紧急分类的评估.
- 与韩国分辨率和敏度尺度 (KTAS) 作为黄金标准进行比较.
主要成果:
- 双子 2.5 闪光实现了最高的精度 (73. 8%) 和特异性 (88. 9%).
- 双子 2.5 pro显示了最高的灵敏度 (90. 9%) 和F1得分 (82. 4%).
- GPT-4.1提供了平衡的准确性 (70.6%),灵敏度 (81.3%) 和快速的响应时间 (1.79秒);少数射击提示改善了大多数模型.
结论:
- 医生可以从实际的临床对话中准确地分类ED患者的紧急情况.
- 模型展示了非关键分类支持的可行性,具有高灵敏度和可接受的响应时间.
- 需要进一步研究以整合客观数据和非危急患者的实时工作流程 (KTAS 3-5).
相关概念视频
Pulmonary Embolism II: Diagnostic Studies and Interprofessional Care
44
Diagnosing Pulmonary EmbolismDiagnosing pulmonary embolism (PE) involves clinical assessment and advanced imaging tests. The preferred diagnostic tool is the spiral (helical) CT scan or CT angiography (CTA), which uses intravenous contrast media to visualize the pulmonary vasculature and identify emboli.A ventilation-perfusion (V/Q) scan is an alternative for patients unable to receive contrast media. This scan includes both perfusion and ventilation scanning. Perfusion scanning involves...
44
Types of Reports III: Telephone and Verbal Reports
807
Telephone and Verbal Reports in healthcare settings are two communication methods for conveying therapeutic instructions from healthcare providers to nurses or other healthcare staff.
Here's an overview of each type:
Telephone Orders
Here's an overview of each type:
Telephone Orders
807
Aneurysm III: Interprofessional Care
24
Aneurysm management involves either conservative medical therapy or surgical intervention, depending on the size and symptoms of the aneurysm. Conservative management is generally reserved for smaller, asymptomatic aneurysms, while larger or symptomatic aneurysms often necessitate surgical repair.Conservative Medical TherapyFor small, asymptomatic aneurysms, particularly abdominal aortic aneurysms (AAA) less than 5.5 centimeters in diameter, conservative medical therapy is recommended. This...
24
Acute Kidney Injury V: Interprofessional Care
44
Acute Kidney Injury (AKI) requires a collaborative healthcare approach to restore renal function and prevent complications. Essential management strategies involve monitoring fluid and electrolyte balance, adjusting medications, initiating dialysis when necessary, and providing nutritional support.Fluid and Electrolyte ManagementFluid Monitoring: Regularly monitoring body weight, central venous pressure, and urine output helps detect fluid imbalances early. Patient intake and output are...
44
Interdisciplinary Care: The Health Care Team-II
1.5K
An interdisciplinary team includes many healthcare professionals working together and utilizing their skills, knowledge, and expertise to provide holistic and quality patient care. Here are a few more healthcare professionals.
Physical Therapist
A physical therapist (PT) aims to restore function or prevent additional impairment in a patient following an injury or disease. Massage, heat, cold, water, sonar waves, exercises, and electrical stimulation are some treatments used by PTs to treat...
Physical Therapist
A physical therapist (PT) aims to restore function or prevent additional impairment in a patient following an injury or disease. Massage, heat, cold, water, sonar waves, exercises, and electrical stimulation are some treatments used by PTs to treat...
1.5K
Techniques of Therapeutic Communication II: Focusing, Paraphrasing, and Summarizing
9.0K
Focusing involves centering a conversation on a message's critical elements or concepts. Focusing is valuable if the talk is vague or patients begin to repeat themselves. Sometimes, when patients are asked about their symptoms, they may go off-topic and try to tell their entire life story. Respectfully, the nurse should bring the conversation back into focus.
This therapeutic technique can also be used when a patient brings up pertinent information during a health-related conversation. The...
This therapeutic technique can also be used when a patient brings up pertinent information during a health-related conversation. The...
9.0K


