PSCAT:一种轻量级的变压器,用于同时消除CTN图像的阴影和超分辨率
Bin Yao1,2, Lujia Jin3,4,5,6, Jiakui Hu3,5,6
1Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China.
Biomedical optics express
|June 10, 2024
概括
我们开发了PSCAT,一种轻量级的变压器模型,通过减少噪音和增加分辨率来增强光学连贯断层扫描 (OCT) 图像. 这种方法可以有效地改善短扫描中的图像质量.
科学领域:
- 医疗成像医学成像
- 生物医学工程 生物医学工程
- 计算机视觉 计算机视觉
背景情况:
- 光学一致性断层扫描 (OCT) 是一种广泛用于临床诊断的非侵入性成像技术.
- 海外海外国家的图像质量往往受到斑点噪声和低分辨率的限制,阻碍了准确的分析.
- 现有的方法很难从不理想的采集中有效地重建高质量的OCT图像.
研究的目的:
- 提出一种名为PSCAT的新型轻型变压器模型,用于从噪音和低分辨率的OCT扫描中高效高质量的图像重建.
- 探索变压器架构在OCT成像中的应用,以实现同时消噪和超分辨率.
- 为了降低计算成本,并提高OCT图像增强的处理速度.
主要方法:
- 开发了PSCAT,一个轻量级的变压器,结合了并行空间窗口自我注意力和通道注意力机制.
- 利用在空间和频率领域运行的混合损失函数来恢复高频细节.
- 评估了通过短扫描获得的噪音和低分辨率OCT图像的模型.
主要成果:
- 通过PSCAT,OCT图像质量显著改善,有效降低噪音并提高分辨率.
- 该模型与最先进的方法相比,实现了具有竞争力的定性和定量性能.
- 在PSCAT中,网络参数较少,计算成本较低,这表明效率提高.
结论:
- PSCAT提供了一种高效和有效的解决方案,用于从具有挑战性的采集中重建高质量的OCT图像.
- 基于变压器的方法显示出对在临床环境中推进OCT图像处理的巨大希望.
- 拟议的方法提供了一种有价值的工具,可以通过提高海上和海外国家的图像质量来提高诊断准确性.
相关概念视频
01:37Super-resolution Fluorescence Microscopy
7.0K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.0K
01:22Upsampling
227
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
227
01:20Downsampling
153
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
153