一个视觉语言基础模型,用于生成现实的胸部X射线图像
Christian Bluethgen1,2,3, Pierre Chambon4,5, Jean-Benoit Delbrouck4,5
1Center for Artificial Intelligence in Medicine and Imaging, Stanford University, Palo Alto, CA, USA. bluethgen@stanford.edu.
Nature biomedical engineering
|August 26, 2024
概括
机器学习可以为训练创建多样化的医疗图像,克服在自然图像上训练的模型的局限性. 这种新方法产生了由医学文本控制的现实合成胸部X射线,有助于数据集增强.
科学领域:
- 人工智能的人工智能
- 医疗成像医学成像
- 计算机视觉 计算机视觉
背景情况:
- 高质量的医学成像数据集很少,阻碍了机器学习模型的开发.
- 在自然图像上训练的大视觉语言模型与医疗数据的独特特征作斗争.
- 医学语言需要专门的词汇,对当前的模型构成挑战.
研究的目的:
- 开发大视觉语言模型的域适应策略,以生成现实的医疗图像.
- 为了克服自然和医疗图像数据集之间的分布转移.
- 创建一种使用文字提示生成可控,多样化的合成医疗图像的方法.
主要方法:
- 利用公开可用的胸部X射线图像和放射学报告.
- 适应了在自然图像-文本对上预训练的潜在扩散模型.
- 使用域调整,使模型输出与医疗图像特征保持一致.
主要成果:
- 生成多样化和视觉上可信的合成胸部X射线图像.
- 由董事会认证的放射科医生确认合成图像的质量.
- 通过使用自由形式的医疗文本提示,对图像外观进行了证明控制.
结论:
- 域适应策略有效生成高质量的合成医学图像.
- 这种方法克服了仅在自然图像上训练的模型的局限性.
- 该方法为增强医疗培训数据集提供了可行的替代方案,而无需共享真实患者数据.
相关概念视频
Imaging Studies for Cardiovascular System III: X-Ray
160
The most common cardiovascular diagnostic test is an X-ray. It produces images of the heart, blood vessels, and adjacent structures.
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
Definition and Purpose
An X-ray, or radiograph, is a non-invasive method that uses ionizing radiation to take images of internal structures. It is mainly used in cardiac imaging to examine the heart, lungs, and major blood vessels, aiming to identify abnormalities in the heart's size, shape, and position, such as heart failure, congenital defects, and vascular...
160
X-ray Imaging
5.4K
German physicist Wilhelm Röntgen (1845–1923) was experimenting with electrical current when he discovered that a mysterious and invisible "ray" would pass through his flesh but leave an outline of his bones on a screen coated with a metal compound. In 1895, Röntgen made the first durable record of the internal parts of a living human: an "X-ray" image (as it came to be called) of his wife’s hand. Scientists worldwide quickly began their own experiments with...
5.4K
Radiological Investigation I: X-ray and CT
219
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
219
Computed Tomography
4.4K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.4K


