临床传染病咨询中的生成人工智能模型:专家和居民实习生之间的横截面分析
Edwin Kwan-Yeung Chiu1, Siddharth Sridhar1,2,3, Samson Sai-Yin Wong1
1Department of Microbiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China.
Healthcare (Basel, Switzerland)
|April 12, 2025
概括
生成型人工智能 (GenAI) 显示出临床微生物学和传染病 (ID) 的潜力,但目前的模型对于直接部署并不安全. 专家临床医生在识别有害的人工智能输出方面表现出脆弱性,突出了对人类监督的需求.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 临床微生物学和传染病
背景情况:
- 生成型人工智能 (GenAI) 具有增强传染病 (ID) 和微生物学临床咨询的潜力.
- 在现实世界临床场景中评估GenAI聊天机器人的性能至关重要.
研究的目的:
- 评估四个GenAI聊天机器人在临床微生物学和ID设置中的性能.
- 为了比较人工智能产生的反应的事实一致性,全面性,连贯性和医疗危害性.
主要方法:
- 一项涉及40个独特临床场景的横截面研究.
- 评估了四个GenAI聊天机器人 (GPT-4.0,自定义GPT-4.0,Gemini Pro,Claude 2),并进行了测试.
- 六名专家和居民实习生进行了盲目的随机评估.
主要成果:
- 在综合分数,事实一致性,全面性和没有医疗危害方面,GPT-4.0显著优于Gemini Pro和Claude 2.
- 专家们对人工智能反应的评价高于实习生,但也更容易受到潜在的有害结果的影响.
- 只有不到五分之二的人工智能产生的反应被认为是无害的,这表明存在重大风险.
结论:
- 临床经验影响GenAI输出的解释,专家显示出意想不到的漏洞.
- 目前的GenAI模型对于在微生物学和ID.无监督的临床部署是不安全的.
- 人类监督对于减轻AI在临床决策中的风险至关重要.
更多相关视频
08:20Author Spotlight: AI-Driven Trypanosome Species Detection from Microscopic Images
Published on: October 27, 2023
1.3K
12:21A Mouse Model for the Transition of Streptococcus pneumoniae from Colonizer to Pathogen upon Viral Co-Infection Recapitulates Age-Exacerbated Illness
Published on: September 28, 2022
2.3K
相关概念视频
Steps in Outbreak Investigation
95
In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
95
Synthetic Biology
4.7K
Synthetic biology is an interdisciplinary science that involves using principles from disciplines such as engineering, molecular biology, cell biology, and systems biology. It involves remodeling existing organisms from nature or constructing completely new synthetic organisms for applications such as protein or enzyme production, bioremediation, value-added macromolecule production, and the addition of desirable traits to crops, to name a few.
Golden rice
Golden rice is a genetically modified...
Golden rice
Golden rice is a genetically modified...
4.7K
