对ChatGPT对广泛疾病的症状检查能力进行基准测试
Anjun Chen1,2, Drake O Chen2, Lu Tian3
1Health Sciences, ELHS Institute, Palo Alto, CA 94306, United States.
Journal of the American Medical Informatics Association : JAMIA
|December 18, 2023
概括
聊天GPT在检查多种疾病的症状方面表现出很强的准确性,GPT-4模型的表现优于GPT-3.5-turbo. 这凸显了它作为一个有价值的医疗培训工具的潜力.
科学领域:
- 医疗保健中的人工智能
- 医疗信息学 医疗信息学
- 临床决策支持 临床决策支持
背景情况:
- 患者越来越多地使用症状检查器进行初步健康评估.
- 评估人工智能 (AI) 工具的准确性,如ChatGPT用于医疗症状分析至关重要.
研究的目的:
- 评估ChatGPT在根据所呈现的症状识别疾病时的准确性.
- 为了对ChatGPT的性能进行比较,与一项声誉良好的现有症状检查器进行比较.
主要方法:
- 聊天GPT被提示的症状与194种不同的疾病相符.
- 计算了相对比较得分 (RCS) 来量化ChatGPT的诊断准确性.
主要成果:
- 聊天GPT的GPT-4版本实现了78.8%的平均RCS.
- GPT-4的性能明显超过了GPT-3.5-turbo模型的10.5%.
- 某些医学专业的准确率超过了90%.
结论:
- 聊天GPT在广泛范围的基于症状的疾病识别中表现出相当大的准确性.
- 人工智能工具在学习卫生系统中显示出作为医学教育资源的前景.
- 潜在的应用包括提高患者护理质量和减轻健康差异.
相关概念视频
Assessment of the Gastrointestinal System I: Subjective Data
200
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems...
200
Assessment of the Gastrointestinal System II: Health Perception Pattern
120
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
120
Generalized Anxiety Disorder
135
Generalized Anxiety Disorder (GAD) is a chronic condition characterized by excessive and uncontrollable worry that persists for at least six months, significantly interfering with daily functioning. Unlike situational anxiety, which arises in response to specific stressors, GAD often occurs without a clear cause. Individuals may experience disproportionate worry about work, health, or relationships. For instance, a person might continuously fear poor health despite normal medical evaluations or...
135
Assessment of the Cardiovascular System I: Subjective Data
343
A thorough health history and physical assessment are essential for identifying cardiovascular disease (CVD) symptoms and distinguishing them from other health issues.
Initial Enquiry
Ask the patient about their primary concern and thoroughly explore all reported symptoms.
Medical History
Investigate past illnesses affecting the cardiovascular system, such as angina, anemia, rheumatic fever, congenital heart disease, stroke, thrombophlebitis, dysrhythmias, varicosities
Inquire about symptoms...
Initial Enquiry
Ask the patient about their primary concern and thoroughly explore all reported symptoms.
Medical History
Investigate past illnesses affecting the cardiovascular system, such as angina, anemia, rheumatic fever, congenital heart disease, stroke, thrombophlebitis, dysrhythmias, varicosities
Inquire about symptoms...
343


