冷的大规模预训练视觉语言模型是多模式乳腺癌预测的有效基础骨干
IEEE journal of biomedical and health informatics
|March 3, 2025
概括
这项研究引入了一种用于乳腺癌预测的多式联络深度学习模型,利用结视觉语言模型与乳房影像数据. 该方法显著提高了预测准确性,特别是在有限的数据场景中,优于传统方法.
科学领域:
- 医学成像分析 医学成像分析
- 医疗保健中的人工智能
- 在瘤学瘤学.
背景情况:
- 乳腺癌是女性的主要全球健康问题.
- 来自图像存档和通信系统 (PACS) 和电子健康记录 (EHR) 的多式数据集成显示了改善乳腺癌预测的潜力.
- 传统的图像表格模型在非对齐的临床数据方面面临挑战.
研究的目的:
- 开发和评估一种多式联络深度学习模型,用于使用乳腺造影仪预测乳腺癌.
- 评估结合冷大规模预训练的视觉语言模型与临床数据的性能.
- 将拟议的模型与传统方法进行比较,并在有限的数据场景中调查其有效性.
主要方法:
- 开发了一种多式联机深度学习模型,将冷预训练的视觉语言模型与乳腺扫描数据集集集成在一起.
- 该模型使用轻量级可训练分类器与结视觉语言组件一起.
- 在两个公开的乳腺癌数据集 (CBIS-DDSM和EMBED) 上评估了表现,包括数据有限的场景 (BI-RADS 3个案例).
主要成果:
- 与传统的图像表格模型相比,多式模式模型表现出优越的性能和稳定性.
- 在曲线下的面积 (AUC) 中观察到显著改善:CBIS-DDSM验证 (0.867到0.902) 和测试 (0.803到0.830);EMBED验证 (0.780到0.805).
- 在有限的数据场景 (BI-RADS 3) 中,AUC从0.91增加到0.96 (CBIS-DDSM测试) 和0.79增加到0.83 (验证集).
结论:
- 冷大规模预训练的视觉语言模型对于多模式乳腺癌预测是有效的.
- 拟议的方法比传统方法提供了更高的性能和稳定性,特别是在多种多机构的医疗保健数据中.
- 这项研究强调了视觉语言模型的潜力,以提高乳腺癌预测的准确性和解决数据整合挑战.
相关概念视频
Mouse Models of Cancer Study
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
Mouse Models of Cancer Study
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...


