评估ChatGPT在日本内科医学中的有效性和趋势
Yudai Kaneda1, Akari Tayuinosho2, Rika Tomoyose1
1School of Medicine, Hokkaido University, Hokkaido, Japan.
Journal of evaluation in clinical practice
|May 20, 2024
概括
聊天GPT在内部医学中显示出潜力,但不如人类专家那么准确. 它的表现因问题类型而异,表明它应该增强,而不是取代医生的专业知识.
科学领域:
- 医疗保健中的人工智能
- 医疗信息学 医疗信息学
- 临床决策支持 临床决策支持
背景情况:
- 像ChatGPT这样的大型语言模型展示了AI的医疗保健潜力.
- 与医生相比,了解ChatGPT的准确性对于临床整合至关重要.
- 本研究评估了ChatGPT在日本专家的内科问题上的表现.
研究的目的:
- 评估ChatGPT在回答内科问题的准确性和局限性.
- 为了比较ChatGPT与日本内科专家的表现.
- 在ChatGPT的正确和不正确响应中识别模式.
主要方法:
- 使用的ChatGPT回答了2020-2023年内科自我训练问题.
- 进行了每组问题三次试验,以评估整体和非图像准确性.
- 将问题分类为一致正确的 (CCA) 和不正确的 (CIA) 答案进行分析.
主要成果:
- 整体准确率为59.05%,在非图像问题上升到65.76%.
- 24.87%的答案在不同试验的正确性上有所不同.
- 聊天GPT的准确性虽然超过了非图像值,但落后于人类专家.
结论:
- 在内部医学中,ChatGPT具有实用性但有局限性;它应该补充医生的判断.
- 性能取决于问题类型和背景.
- 为了有效地将人工智能整合到专业医疗实践中,需要进一步的研究.
相关概念视频
Assessment of the Gastrointestinal System II: Health Perception Pattern
103
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
103
Assessment of the Gastrointestinal System I: Subjective Data
180
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
180


