适应的大型语言模型可以在临床文本总结方面的表现优于医学专家
Dave Van Veen1,2, Cara Van Uden3,4, Louis Blankemeier5,3
1Department of Electrical Engineering, Stanford University, Stanford, CA, USA. vanveen@stanford.edu.
Nature medicine
|February 27, 2024
概括
大型语言模型 (LLM) 在总结临床文本方面表现有前途,减少了临床医生的文档负担. 适应的LLM在多个总结任务中表现得与医学专家一样好,甚至比他们更好.
科学领域:
- 医疗信息学 医疗信息学
- 自然语言处理自然语言处理.
- 医疗保健中的人工智能
背景情况:
- 临床医生在分析电子健康记录时面临着相当大的时间负担.
- 大型语言模型 (LLM) 显示了自然语言处理 (NLP) 的潜力,但其临床总结效率尚未被证明.
研究的目的:
- 评估适应的LLM在各种临床文本总结任务中的有效性.
- 将LLM生成的摘要与医学专家制作的摘要进行比较.
主要方法:
- 适应方法应用于八个LLM的四个任务:放射学报告,患者问题,进展记录和医生与患者对话.
- 量化NLP指标和一项与10名医生参与的读者研究评估了摘要质量 (完整性,正确性,简洁性).
主要成果:
- 定量NLP指标揭示了LLM模型和适应方法之间的权衡.
- 医生评估发现LLM生成的摘要相当于 (45%) 或优于 (36%) 专家摘要.
- 安全分析确定了LLM和专家的错误类型和潜在的医疗危害.
结论:
- 适应的LLM在临床文本总结方面表现强,经常与医学专家质量相匹配或超过.
- 将LLM整合到临床工作流中可以显著减少文档负担,并提高患者护理的重点.
相关概念视频
Clinical Trials: Overview
2.9K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
2.9K
Methods of Documentation VI: Case Management Model
573
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
573
Clinical Trials
6.7K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
6.7K
Improving Translational Accuracy
2.6K
2.6K


