在整个临床工作流程中评估ChatGPT的实用性:开发和可用性研究
Arya Rao1,2,3, Michael Pang1,2,3, John Kim1,2,3
1Medically Engineered Solutions in Healthcare Incubator, Innovation in Operations Research Center (MESH IO), Massachusetts General Hospital, Boston, MA, United States.
Journal of medical Internet research
|August 22, 2023
概括
像ChatGPT这样的大型语言模型在临床决策支持方面表现有前途,在标准化图片上达到71.7%的准确性. 虽然它在最终诊断方面很强大,但在初始差异诊断方面却很困难,这表明AI在医学推理方面的改进领域.
科学领域:
- 人工智能在医学中的应用
- 临床决策支持系统 临床决策支持系统
- 大型语言模型 (LLM)
背景情况:
- 大型语言模型 (LLM) 利用广泛的数据集来处理复杂的,连续的任务,而不是人工智能来处理单个实例的问题.
- 在代临床推理中应用LLM,模拟医生角色,仍然在很大程度上未被评估.
研究的目的:
- 评估ChatGPT对持续临床决策支持的能力.
- 为了评估ChatGPT在标准化临床图表上的表现.
主要方法:
- 在ChatGPT中输入了所有36个默克夏普和多姆 (MSD) 临床手册的简介.
- 对比了ChatGPT在差异诊断,诊断测试,最终诊断和管理方面的准确性与人类得分器.
- 使用线性回归来识别影响ChatGPT临床任务性能的因素.
主要成果:
- 在36个临床细节中,ChatGPT实现了71.7%的整体准确率.
- 最高的准确性是在最终诊断 (76.9%) 中观察到的,在初始差异诊断 (60.3%) 中最低.
- 在差异诊断和临床管理方面的表现低于一般医学知识任务.
结论:
- 聊天GPT在临床决策中表现出显著的准确性,随着更多临床数据的改善.
- 与初始诊断步骤相比,该模型在最终诊断任务中表现出色.
- 限制包括AI幻觉的可能性和不透明的训练数据组成.
关键词:
在这里,我们可以看到AIAIAI.聊天GPT 聊天 在GPT 聊天在 GPT 中,GPT 必须是 GPT.发电预训练变压器 预训练变压器在法律上,LLMs.准确度 准确度 准确度 准确度人工智能的人工智能是人工智能.聊天机器人 聊天机器人临床决策支持 临床决策支持临床记载 临床记载在决策过程中做出决定.发展发展发展发展发展.大型语言模型.可用性可用性可用性公用事业公用事业公司更多相关视频
05:04Author Spotlight: Evaluating Clinicians' Adoption of Ultrasound-Guided Vascular Cannulation Through Simulation Training
Published on: August 9, 2024
985
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
8.4K
相关概念视频
Clinical Trials
6.8K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
6.8K
Clinical Trials: Overview
3.0K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
3.0K
Methods of Documentation III: PIE
1.4K
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
1.4K
