R2GenCSR:采矿上下文和残留信息用于基于LLMs的放射学报告生成
IEEE journal of biomedical and health informatics
|March 3, 2026
概括
本研究引入了一个新的框架,用于高效的放射学报告生成,使用Mamba进行视觉特征提取和上下文检索,以增强大型语言模型 (LLM). 该方法提高了报告质量,同时降低了计算复杂性.
科学领域:
- 人工智能的人工智能
- 医疗成像医学成像
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 在放射学报告生成方面表现有前途.
- 目前的方法使用变压器来提取视觉特征,这导致了高的计算成本.
- 为LLM提取有效的视觉信息仍然是一个挑战.
研究的目的:
- 开发一种新的,以上下文为导向的,高效的放射学报告生成框架.
- 解决高计算复杂性和现有方法中低于最佳特征提取的局限性.
主要方法:
- 推出了Mamba作为具有线性复杂性的视觉支柱,实现了与变压器相比的性能.
- 在培训期间使用正负相关样本实现上下文检索,以增强特征表示.
- 集成的视觉令牌,上下文信息和提示声明以指导基于LLM的报告生成.
主要成果:
- 拟议的框架在生成高质量的医疗报告方面表现出有效性.
- 在IU X-Ray,MIMIC-CXR和CheXpert Plus数据集上的实验验验证了模型的性能.
- 马巴骨干提供了与变压器相当的性能,计算复杂性大大降低.
结论:
- 基于环境指导的高效放射学报告生成框架有效地提高了LLM的性能.
- 使用Mamba作为视觉骨干,为变形金刚提供了一个有效的替代方案.
- 该方法成功生成了高质量的放射学报告,在多个数据集中得到验证.
相关概念视频
Computed Tomography
7.6K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
7.6K
Radiological Investigation I: X-ray and CT
1.8K
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
1.8K
Radiological Investigation II: MRI and Ventilation Perfusion Scan
1.0K
Description
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
1.0K


