交互式双流对比学习用于放射学报告生成
1College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan 030600, China.
Journal of biomedical informatics
|August 29, 2024
概括
这项研究引入了一种新的放射学报告生成模型,该模型以解剖学术语为指导. 它通过利用多式联网预训练模型和新的视觉增强模块来提高报告的准确性和效率.
科学领域:
- 医学成像和人工智能 医学成像和人工智能
- 在医疗保健中的自然语言处理.
背景情况:
- 当前的放射学报告生成方法往往忽视了知识图的解释性.
- 从多式联运事先训练的模型中对稳定的模式对齐的有限使用阻碍了报告生成.
- 从医学成像数据中自动合成诊断叙述至关重要.
研究的目的:
- 以解剖学术语为指导,开发一个实用的放射学报告生成模型.
- 提高知识图表在报告生成中的可解释性和指导功能.
- 为了提高自动化放射学报告合成的准确性和效率.
主要方法:
- 拟议的术语指导放射学报告生成 (TGR) 模型.
- 使用双流视觉特征提取模块 (细节提取和冷的多式模式预训练模型).
- 引入了视觉增强模块 (VEM) 和与结文本嵌入的对比学习,以改善模态对齐.
主要成果:
- 该TGR-S模型减少了38.9%的培训参数,性能与最先进的模型相提并论.
- 在多个指标上,TGR-B模型超过了现有的基线模型.
- 在生成准确的放射学报告方面表现出有效性,包括针对重点领域的手动输入功能.
结论:
- TGR模型为放射学报告生成提供了有效和高效的方法.
- 该方法增强了模式对齐,并利用解剖学术语来提高报告准确性.
- 该模型的实用设计和性能改进为临床应用提供了巨大的潜力.
相关概念视频
Positron Emission Tomography
4.1K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.1K
Imaging Studies for Cardiovascular System II:Types of Echocardiography
238
Echocardiography plays a role in assessing cardiac health and detecting heart conditions, with various types providing critical insights for diagnosis and treatment.
Types of Echocardiography
Transthoracic Echocardiography (TTE)
TTE is the most common type of echocardiogram which involves placing a transducer on the patient's chest, emitting sound waves to create heart images. TTE is invaluable for evaluating the heart's size, structure, and motion, making it particularly useful for...
Types of Echocardiography
Transthoracic Echocardiography (TTE)
TTE is the most common type of echocardiogram which involves placing a transducer on the patient's chest, emitting sound waves to create heart images. TTE is invaluable for evaluating the heart's size, structure, and motion, making it particularly useful for...
238
Radiological Investigation I: X-ray and CT
218
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
218


