专用大型语言模型与CT和MRI放射学GPT-4o的比较报告摘要
Sunyi Zheng1, Nannan Zhao2, Jing Wang3
1Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, State Key Laboratory of Druggability Evaluation and Systematic Translational Medicine, Tianjin Key Laboratory of Digestive Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, West Huan-Hu Rd, Ti Yuan Bei, Hexi District, 300060 Tianjin, China.
一个专门用于放射学报告总结的大型语言模型 (LLM) 超过了通用GPT-4o. 在生成准确和临床有用的放射学报告摘要方面,LLM-RadSum表现出卓越的表现.
科学领域:
- 放射学
- 人工智能
- 自然语言处理
背景情况:
- 像GPT-4o这样的通用大型语言模型在放射学中显示出潜力.
- 专用LLM与通用LLM在放射学报告总结方面的比较性能尚未得到充分证实.
研究的目的:
- 将专门的LLM (LLM-RadSum) 与放射学报告的GPT-4o进行比较.
- 评估生成的摘要的实际一致性,一致性,安全性和临床实用性.
主要方法:
- 使用回顾性医院数据集 (培训/内部测试集) 开发了LLM-RadSum.
- 在内部和外部测试组 (CT/MRI报告) 中评估的F1分数.
- 对1800份报告进行人体评估,使用事实一致性和临床安全性等标准比较LLM-RadSum和GPT-4o输出.
主要成果:
- 与GPT-4o (0. 30; P <. 001) 相比,LLM-RadSum在人类评估中获得了更高的F1中位数.
- 超过81.5%的LLM-RadSum输出符合专家标准,而27.8%的GPT-4o输出需要调整.
- 在各种模式,解剖区域和患者人口统计学方面,LLM-RadSum表现出卓越的表现.
结论:
- 一个专门的LLM (LLM-RadSum) 在总结放射学报告方面显著优于通用GPT-4o.
- 提供更具事实一致性,连贯性,安全性和临床有用性的摘要.
- 专门的LLM对于特定的医学NLP任务比如放射学报告总结更有效.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
02:09Multi-modal Pulmonary Imaging: Using Complementary Information from CT and Hyperpolarized 129Xe MRI to Evaluate Lung Structure-Function
Published on: April 12, 2024
相关概念视频
Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
Brain Imaging
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
Magnetic Resonance Imaging
