纯视觉变压器 (CT-ViT) 带有Noise2Neighbors插曲,用于低剂量CT图像去除
Luella Marcos1, Paul Babyn2, Javad Alirezaie3
1Department of Electrical, Biomedical and Computer Engineering, Toronto Metropolitan University (formerly Ryerson University), 350 Victoria Street, Toronto, M5B 2K3, Ontario, Canada.
Journal of imaging informatics in medicine
|April 15, 2024
概括
视觉转换器 (ViT) 通过克服卷积神经网络 (CNN) 的局限性来增强医疗图像的否定. 这种纯粹的ViT模型在低剂量CT扫描中显著提高了图像质量和细节保存.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 计算机视觉 计算机视觉
背景情况:
- 卷积神经网络 (CNN) 面临医疗图像处理方面的挑战,包括有限的特征表示和计算成本.
- 变压器提供了一个有希望的替代方案,以解决医疗图像分析中的这些CNN限制.
- 准确的患者诊断依赖于医疗图像中保存精细的空间细节.
研究的目的:
- 为低剂量计算机断层扫描 (LDCT) 图像处理引入基于纯视觉变压器 (ViT) 的无噪模型.
- 评估ViT模型与基于CNN和混合CNN-ViT模型对LDCT宣传的有效性.
- 评估模型能够保存高频和低频信息以及细节结构细节的能力.
主要方法:
- 开发了一个U-Net框架,包含视觉变压器 (ViT) 模块和Noise2Neighbor (N2N) 插值.
- 拟议的纯ViT模型在五个不同的低剂量和正常剂量CT图像对数据集上进行了训练和测试.
- 与已建立的CNN和混合模型进行了定量 (SSIM,PSNR) 和视觉比较.
主要成果:
- 与纯CNN模型相比,纯ViT模型在结构相似性指数测量 (SSIM) 和峰值信号对噪声比率 (PSNR) 中显示出15-20%的增加.
- 变压器中的自我注意力机制在定量指标中表现优于传统的CNN.
- 视觉分析证实了ViT模型在CT图像中重建精细结构细节方面的卓越性能.
结论:
- 纯视觉转换器有效地解决了CNN在医学图像否定方面的局限性.
- 拟议的基于ViT的U-Net模型在LDCT图像质量和诊断细节保存方面提供了显著的改进.
- 这项研究强调了变压器在推进医疗图像处理技术方面的潜力.
相关概念视频
Deconvolution
159
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
159
Computed Tomography
4.5K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.5K
Downsampling
154
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
154
Difference from Background: Limit of Detection
6.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.4K
Trimmed Mean
2.9K
While measuring the mean of a data set, care needs to be taken when associating the mean to its central tendency. The same goes for the arithmetic mean, the geometric mean, or the harmonic mean. This is because the presence of a single outlier data value can significantly affect the mean. That is, the mean is sensitive to fluctuations in the data set.
Although certain measures of central tendency are not sensitive to outliers, there are alternative versions of the mean that get around the...
Although certain measures of central tendency are not sensitive to outliers, there are alternative versions of the mean that get around the...
2.9K


