评估成人鼻炎指南:对AAO-HNS和AI聊天机器人的比较分析
Shaun Edalati1, Shiven Sharma1, Rahul Guda1
1Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
American journal of otolaryngology
|January 30, 2025
概括
人工智能聊天机器人显示出健康信息的潜力,但需要提高成人鼻炎指南的准确性和完整性. 需要进一步开发才能达到临床标准.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 遵守临床指南 遵守临床指南
背景情况:
- 基于大型语言模型的聊天机器人越来越多地用于健康信息检索.
- 美国耳鼻喉学会 - 头部和部外科基金会 (AAO-HNS) 提供了成人鼻炎的临床指南.
研究的目的:
- 评估受欢迎的人工智能聊天机器人 (ChatGPT-3.5,ChatGPT-4.0,Bard,Llama 2) 如何遵守AAO-HNS成人鼻炎指南.
- 评估聊天机器人响应的准确性,过度结论性,补充信息和完整性.
主要方法:
- 来自四个聊天机器人的答案与12个AAO-HNS指南 (30个问题) 进行了比较.
- 对准确性,过度结论性,补充数据和不完整性进行了定量分析.
- 使用Fisher的精确测试进行的统计分析发现了与指导标准的显著偏差.
主要成果:
- 坚持程度各不相同:拉玛2 (80%),巴德 (83.3%),聊天GPT-4.0 (80%),聊天GPT-3.5 (73.3%). 这就是为什么我们会这样做.
- 值得注意的是不完整的反应,范围从23.3% (Bard) 到40% (Llama 2).
- 所有聊天机器人在准确性,附加数据的包含和完整性方面都显示出统计学上显著的偏差 (p < 0.05).
结论:
- 目前的人工智能聊天机器人显示出潜力,但不符合成人鼻炎确定的临床指南的标准.
- 未来的人工智能开发必须优先考虑准确性,完整性和与基于证据的医学实践保持一致.
- 需要进行改进,以确保AI在临床信息传播中的可靠和安全使用.
相关概念视频
01:23Chronic Pharyngitis
989
Chronic pharyngitis refers to persistent inflammation of the pharyngial mucosa.
Etiology
It often arises from persistent viral or bacterial infections affecting sinuses and tonsils.
Additional contributing factors include inadequate dental hygiene, mouth breathing, recurring tonsillitis, allergic rhinitis, laryngopharyngeal reflux, and exposure to smoke, chemicals, and other environmental pollutants. Allergic reactions to pollen, mold, and pet dander, chronic cough, excessive voice usage,...
Etiology
It often arises from persistent viral or bacterial infections affecting sinuses and tonsils.
Additional contributing factors include inadequate dental hygiene, mouth breathing, recurring tonsillitis, allergic rhinitis, laryngopharyngeal reflux, and exposure to smoke, chemicals, and other environmental pollutants. Allergic reactions to pollen, mold, and pet dander, chronic cough, excessive voice usage,...
989
01:26Tonsillitis II: Management
102
This lesson will focus on the different treatment options for managing tonsillitis, which typically depend on the cause and severity.
102
01:30Acute Pharyngitis
379
Introduction
Acute pharyngitis is the inflammation of the back of the throat (pharynx), commonly resulting in a sore throat. It is a frequently encountered condition that prompts individuals to seek medical advice.
Classification
Acute pharyngitis can be categorized based on its underlying cause:
Acute pharyngitis is the inflammation of the back of the throat (pharynx), commonly resulting in a sore throat. It is a frequently encountered condition that prompts individuals to seek medical advice.
Classification
Acute pharyngitis can be categorized based on its underlying cause:
379
01:30Tonsillitis I: Introduction
201
Tonsillitis is inflammation of the tonsils, which are two lymphoid tissue masses at the back of the throat. This condition can cause discomfort and irritation in the throat.
Etiology
Three primary contributing factors have been identified.
Etiology
Three primary contributing factors have been identified.
201