走向心血管磁共振基础模型,用于多任务心脏图像分析
Athira J Jacob1, Indraneel Borgohain2, Teodora Chitiboi3
1Digital Technology and Innovation, Siemens Healthineers, Princeton, New Jersey, USA; AI in Healthcare and Medicine, Technical University of Munich, Munich, Germany.
概括
为自动化图像分析开发了一种新的心血管磁共振 (CMR) 基础模型 (FM). 这种CMR特定的FM显示了对各种成像任务的提高准确性和稳定性,即使数据有限.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 心血管成像 - 心血管成像
背景情况:
- 心血管磁共振 (CMR) 分析是复杂的,涉及各种图像处理任务.
- 基础模型 (FM) 在自然图像 (NI) 中显示了自动图像分析的前景.
- 为应对这些挑战,开发了一个CMR特定的愿景FM.
研究的目的:
- 开发和评估一个CMR特定的视觉基础模型.
- 微调FM用于九个常见的CMR成像任务,包括分类,细分,地标定位和病理检测.
- 将FM的性能与最先进的方法和基线模型进行比较.
主要方法:
- 一个视觉变压器 (ViT-S/8) 在3600万张CMR图像上使用DINO进行自我监督预训.
- 预训练的模型被微调为9个CMR任务使用不同的数据集.
- 绩效与最先进的方法和基线进行了评估,对预训练策略,概括和少量学习进行了分析.
主要成果:
- 与现有方法相比,CMR特定的FM在大多数任务中实现了可比或更好的性能.
- 该模型的表现超过了基线,在电影视图分类 (6.8% pp) 和疾病检测 (14% pp) 中显示出显著的改进.
- FM表现出更好的概括性和少数射击性能,突出显示了预训练策略的重要性.
结论:
- 专门用于医学成像的视觉FM提高了对自然图像FM的准确性和稳定性.
- 自主监督预培训为CMR评估提供了一个高效,统一的框架.
- 这种方法加速了对CMR图像分析的深度学习解决方案的开发,即使注释数据有限.
相关概念视频
Imaging Studies for Cardiovascular System IV: CMRI
311
Cardiovascular magnetic resonance imaging, or CMRI, is a non-invasive diagnostic test that employs a magnetic field and radiofrequency waves to create precise images of the heart and arteries. It provides comprehensive information about cardiac anatomy, function, perfusion, and tissue characterization without ionizing radiation.IndicationsCMRI diagnoses various heart conditions, including tissue damage from heart attacks, ischemic heart disease, myocarditis, aortic issues (tears, aneurysms,...
311
Magnetic Resonance Imaging
9.0K
Magnetic resonance imaging (MRI) is a noninvasive medical imaging technique based on a phenomenon of nuclear physics discovered in the 1930s, in which matter exposed to magnetic fields and radio waves was found to emit radio signals. In 1970, a physician and researcher named Raymond Damadian noticed that malignant (cancerous) tissue gave off different signals than normal body tissue. He applied for a patent for the first MRI scanning device in clinical use by the early 1980s. The early MRI...
9.0K
Imaging Studies for Cardiovascular System V: CT
280
Cardiac computed tomography (CT) scanning is an advanced cardiac imaging technique that utilizes CT technology, with or without intravenous (IV) contrast, to produce accurate cross-sectional virtual slices of specific areas of the heart, coronary circulation, and major blood vessels such as the aorta, pulmonary veins, and arteries. The computer processes these slices to generate three-dimensional images. Multidetector CT (MDCT) is a rapid form of CT scanning that captures multiple slices...
280
Imaging Studies for Cardiovascular System I:Echocardiography
725
Cardiac imaging studies encompass a wide range of noninvasive and minimally invasive techniques designed to visualize the heart's structure and function in detail. One such technique is echocardiography, which uses high-frequency ultrasound waves to produce detailed images of the heart, known as echocardiograms.
Indications: Echocardiography is utilized to diagnose heart failure, valve disorders, and myocardial infarction. It also assesses cardiac structures' size, shape, and motion,...
Indications: Echocardiography is utilized to diagnose heart failure, valve disorders, and myocardial infarction. It also assesses cardiac structures' size, shape, and motion,...
725
Imaging Studies IV: Magnetic Resonance Imaging
221
Introduction:Magnetic Resonance Imaging, or MRI, can include a specialized imaging technique of the urinary system known as Magnetic Resonance Urography (MRU). This radiation-free technique uses strong magnetic fields and radio waves to produce detailed images with the help of a computer. MRU is particularly effective for visualizing fluid-filled structures like the kidneys, ureters, and bladder.Applications of MRI in the Genitourinary SystemKidneys and Ureters: MRI detects tumors, cysts,...
221
Imaging Studies for Cardiovascular System III: X-Ray
466
The most common cardiovascular diagnostic test is an X-ray. It produces images of the heart, blood vessels, and adjacent structures.
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
466


