医学超光谱成像中的蒙面图像建模:重建评估和下游任务
Kelden Pruitt1,2, Hemanth Pasupuleti1,2, James Yu1,2,3
1University of Texas at Dallas, Department of Bioengineering, Richardson, TX.
Proceedings of SPIE--the International Society for Optical Engineering
|November 21, 2025
概括
自主监督的预训练增强了医学成像的深度学习. 这项研究引入了超光谱图像的蒙面自编码框架,将ex vivo组织分类准确度提高到87.9%.
科学领域:
- 医疗成像医学成像
- 深度学习 (Deep Learning) 是一种深度学习.
- 计算机视觉 计算机视觉
背景情况:
- 自主监督的预训可以提高NLP和计算机视觉中的深度学习性能.
- 有限的研究存在于医学成像预训练,可能会阻碍下游任务执行.
- 超光谱成像 (HSI) 捕获丰富的光谱和空间信息,对于组织分析至关重要.
研究的目的:
- 开发和评估用于预训练高光谱图像 (HSI) 的掩盖自编码框架.
- 评估这种预训练模型对ex vivo组织分类的有效性.
- 改进医疗成像应用中的空间和光谱特征的编码.
主要方法:
- 在内部HSI数据集上使用了先进的预训练架构,并采用了面具图像建模方案.
- 实现了一个具有顺序光谱和空间注意力的网络,以实现高效的特征编码.
- 评估了使用重建可视化和平均绝对误差 (MAE) 的预训练,并对未见的验证数据集上的腹部组织分类进行了微调.
主要成果:
- 在验证数据集的预训练中,获得了0.0294的平均绝对误差 (MAE).
- 微调网络在用冷重量对17类腹部组织进行分类时,达到87.9%的准确率.
- 从ex vivo组织中证明了空间和光谱特征的有效编码.
结论:
- 拟议的蒙面自动编码框架有效地预训练了用于医疗应用的超光谱图像.
- 这种方法显示出改善下游任务 (如组织分类和细分) 的巨大潜力.
- 强调对医学成像学预培训策略进行彻底评估的重要性.
相关概念视频
01:10Computed Tomography
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
01:14Imaging Studies I: CT and MRI
Introduction: MRI and CT scans are crucial advancements in medical imaging techniques, playing a vital role in diagnosing conditions related to the gastrointestinal (GI) system. Each scan serves distinct purposes, targets specific areas, and requires unique nursing duties.
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
01:27Imaging Studies III: Computed Tomography
DefinitionComputed Tomography (CT) of the genitourinary (GU) tract is a non-invasive imaging modality that utilizes X-rays and computer processing to generate detailed cross-sectional images of the urinary system, encompassing the kidneys, ureters, bladder, and adjacent structures such as the adrenal glands.PurposeCT scans of the GU tract serve several diagnostic and therapeutic purposes, including:Diagnosis of Urinary Tract Diseases: Detects kidney stones, tumors, cysts, and congenital...