聊天GPT是否准确地回答耳鼻喉科的问题?
Matthew Maksimoski1,2, Anisha Rhea Noble1,2, David F Smith1,2,3
1Division of Pediatric Otolaryngology, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, U.S.A.
The Laryngoscope
|March 28, 2024
概括
聊天GPT在耳鼻喉科的医学问题上表现出有限的准确性,在不到一半的时间内提供正确答案. 患者层面的查询比基于临床实践指南 (CPG) 的查询更准确.
科学领域:
- 人工智能在医学中的应用
- 耳鼻喉科 耳鼻喉科 耳鼻喉科
- 医疗信息学 医疗信息学
背景情况:
- 像ChatGPT这样的公开可用的人工智能 (AI) 软件在各种应用中越来越受欢迎.
- 了解AI在专业医疗领域的准确性对于安全有效的使用至关重要.
- 耳鼻喉科 (ENT) 是一个复杂的医学专业,具有大量的临床实践指南 (CPG).
研究的目的:
- 调查ChatGPT对耳鼻喉科领域的医学问题的答案的准确性.
- 为了比较ChatGPT对患者层面问题的答案的准确性,与来自临床实践指南 (CPG) 的问题进行比较.
主要方法:
- 启动了一个聊天GPT会话,并提出了93个耳鼻喉科相关的问题.
- 问题涵盖了耳鼻喉学的主要领域,并基于CPG的关键行动声明 (KAS).
- 还包括了21个患者级别的问题,所有答案被分类为正确,部分正确,不正确或没有答案.
主要成果:
- 总体而言,ChatGPT对45.5%的问题提供了正确的答案 (基于CPG的37.3%,患者级的71.4%).
- 部分正确的答案是31.8%的时间,错误的答案是21.6%的时间.
- 基于CPG的问题比患者层面的问题正确回答的可能性明显低 (p=0.003).
结论:
- 在为耳鼻喉科提供准确的医疗信息方面,ChatGPT存在重大局限性.
- 医生和患者在使用人工智能获取医疗信息时应谨慎,并意识到这些局限性.
- 未来的人工智能开发应该优先考虑来自知名来源的信息和专家撰写的内容.
相关概念视频
01:30Acute Pharyngitis
6.6K
Introduction
Acute pharyngitis is the inflammation of the back of the throat (pharynx), commonly resulting in a sore throat. It is a frequently encountered condition that prompts individuals to seek medical advice.
Classification
Acute pharyngitis can be categorized based on its underlying cause:
Acute pharyngitis is the inflammation of the back of the throat (pharynx), commonly resulting in a sore throat. It is a frequently encountered condition that prompts individuals to seek medical advice.
Classification
Acute pharyngitis can be categorized based on its underlying cause:
6.6K
01:23Chronic Pharyngitis
16.9K
Chronic pharyngitis refers to persistent inflammation of the pharyngial mucosa.
Etiology
It often arises from persistent viral or bacterial infections affecting sinuses and tonsils.
Additional contributing factors include inadequate dental hygiene, mouth breathing, recurring tonsillitis, allergic rhinitis, laryngopharyngeal reflux, and exposure to smoke, chemicals, and other environmental pollutants. Allergic reactions to pollen, mold, and pet dander, chronic cough, excessive voice usage,...
Etiology
It often arises from persistent viral or bacterial infections affecting sinuses and tonsils.
Additional contributing factors include inadequate dental hygiene, mouth breathing, recurring tonsillitis, allergic rhinitis, laryngopharyngeal reflux, and exposure to smoke, chemicals, and other environmental pollutants. Allergic reactions to pollen, mold, and pet dander, chronic cough, excessive voice usage,...
16.9K