视觉语言模型用于报告生成和CT肺血管图像中结果预测
Zhusi Zhong1,2, Yuli Wang3, Jing Wu4
1Department of Diagnostic Imaging, Brown University Health, Providence, RI, USA.
NPJ digital medicine
|July 12, 2025
概括
一个新的AI框架使用视觉语言模型来改善肺栓塞 (PE) 检测和CTPA扫描报告,提高诊断准确性和患者结果预测.
科学领域:
- 医疗成像中的人工智能
- 放射学和诊断成像 放射学和诊断成像
- 计算病理学计算病理学
背景情况:
- 从CTPA扫描中解释肺栓塞 (PE) 是当前AI的挑战.
- 现有的AI工具缺乏具体性和结构化报告能力.
- 准确的PE诊断对于患者的治疗结果至关重要.
研究的目的:
- 开发基于代理的AI框架,以加强PE检测和报告.
- 整合视觉语言模型 (VLM) 和大型语言模型 (LLM) 进行全面分析.
- 改善PE患者的结构化报告和结果预测.
主要方法:
- 开发了一个基于代理的框架,将VLM和LLM结合起来.
- 该模型在来自多个机构的69000多个CTPA研究中接受了培训.
- 评估了异常分类,报告生成和生存预测.
主要成果:
- 该框架在分类32个与PE相关的异常方面取得了强的表现.
- 以异常为导向的报告表现优于基线方法.
- 一个多式融合模型比传统得分提高了生存预测.
结论:
- 拟议的AI框架为PE诊断提供了一个临床上有意义的解决方案.
- 它可以实现端到端的解释,结构化的报告和结果预测.
- 这种方法推进了PE管理医疗成像中的AI应用.
更多相关视频
05:56Author Spotlight: Enhancing Diagnostic Strategies and Biomarker Development for Comprehensive Lung Function Analysis
Published on: August 9, 2024
1.8K
08:05Lung CT Segmentation to Identify Consolidations and Ground Glass Areas for Quantitative Assesment of SARS-CoV Pneumonia
Published on: December 19, 2020
14.3K
相关概念视频
Radiological Investigation III: Pulmonary Angiogram and PET Scan
171
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
171
Imaging Studies for Cardiovascular System V: CT
68
Cardiac computed tomography (CT) scanning is an advanced cardiac imaging technique that utilizes CT technology, with or without intravenous (IV) contrast, to produce accurate cross-sectional virtual slices of specific areas of the heart, coronary circulation, and major blood vessels such as the aorta, pulmonary veins, and arteries. The computer processes these slices to generate three-dimensional images. Multidetector CT (MDCT) is a rapid form of CT scanning that captures multiple slices...
68
Computed Tomography
6.3K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
6.3K
Radiological Investigation II: MRI and Ventilation Perfusion Scan
226
Description
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
226
