一项关于将放射学与视觉变压器集成的探索性研究,以提高医学成像分类准确度
Zhenyu Yang1,2, Rihui Zhang1,2, Haiming Zhu1,2,3
1Medical Physics Graduate Program, Duke Kunshan University, Kunshan, China.
Medical physics
|January 7, 2026
概括
本研究介绍了一种放射学嵌入式视觉变压器 (RE-ViT),用于医学图像分类. 新的框架整合了放射学和深度学习,在各种数据集中表现优于现有模型.
科学领域:
- 人工智能的人工智能
- 医学图像分析 医学图像分析
- 计算机视觉 计算机视觉
背景情况:
- 深度学习 (DL) 模型,特别是视觉转换器 (ViTs),在医学图像分析中显示出前景.
- 然而,ViTs需要大量的数据,并且缺乏诱导偏差,限制了它们在医学成像中的使用.
- 无线电学提供可解释的功能,但在可扩展性和DL集成方面存在困难.
研究的目的:
- 开发和评估一个放射学嵌入式视觉变压器 (RE-ViT) 框架.
- 为了整合radiomics与补丁智能的ViT嵌入,以增强功能表示.
- 改进跨异质数据集的医疗图像分类.
主要方法:
- 设计了一个统一的RE-ViT框架,将手工制作的放射性特征与数据驱动的视觉嵌入相结合.
- 输入图像被分为补丁;放射性特征和标准补丁嵌入被提取和结合.
- 组合的嵌入被一个ViT编码器处理,并使用可学习的令牌进行最终分类. 评估使用了三个数据集 (BUSI,ChestXray2017,视网膜OCT) 进行了10倍的交叉验证.
主要成果:
- 在所有测试的医学成像数据集中,RE-ViT表现出强大而一致的分类性能.
- 在BUSI,ChestXray2017和视网膜OCT数据集中实现了高精度,AUC,灵敏度和特异性.
- RE-ViT与CNN和混合模型相匹配或表现优于CNN; 废弃研究证实了放射学和学习嵌入的重要性.
结论:
- 开发的RE-ViT有效地整合了放射学和ViT用于医学图像分类.
- 该框架显示了推进基于变压器的医疗图像分析任务的潜力.
- 注意地图显示了模式特定特征的利用和相关地区的改进本地化.
相关概念视频
01:30Radiological Investigation II: MRI and Ventilation Perfusion Scan
Description
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
01:14Imaging Studies I: CT and MRI
Introduction: MRI and CT scans are crucial advancements in medical imaging techniques, playing a vital role in diagnosing conditions related to the gastrointestinal (GI) system. Each scan serves distinct purposes, targets specific areas, and requires unique nursing duties.
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...