通过知识驱动的深度展开和转换器嵌入的卷积反复神经网络来实现高光谱图像超分辨率.
概括
这项研究引入了一种新的深度展开技术,用于单个超光谱 (HS) 图像超分辨率. 该方法有效地提高了空间分辨率,而不需要辅助图像,优于现有的技术.
科学领域:
- 遥感 遥感 遥感 遥感
- 计算机视觉 计算机视觉
- 图像处理 图像处理
背景情况:
- 超光谱 (HS) 成像提供了丰富的光谱信息,但由于硬件限制,其空间分辨率往往较低.
- 现有的HS图像融合方法需要共同注册的高分辨率辅助图像,这在现实世界中并不总是可用.
- 高频图像中的低空间分辨率在各种应用中显著降低了性能.
研究的目的:
- 开发一种新的单一高光谱 (HS) 图像超分辨率方法.
- 解决传统的HS图像融合技术中需要辅助图像的局限性.
- 通过基于知识的深度展开方法来增强HS图像的空间分辨率.
主要方法:
- 提出了一个以后最大 (MAP) 能源模型为基础的隐性先验模型,通过交替优化解决.
- 使用嵌入式变压器的卷积循环神经网络 (CRNN) 展开代优化机制.
- 集成视觉转换器和3D卷积用于空间光谱先前学习和代重建的反复连接.
主要成果:
- 实现有效的知识驱动,端到端和数据依赖的HS图像超分辨率.
- 与最先进的方法相比,在三个HS图像数据集上表现出优异的性能.
- 成功地提高了没有辅助数据的HS图像的空间分辨率.
结论:
- 提出的基于知识的深度展开技术为单个高清图像超分辨率提供了强大的解决方案.
- 该方法克服了对辅助图像的依赖,扩大了在现实世界的场景中的适用性.
- 集成的变压器和CRNN架构有效地捕获空间光谱信息,以提高分辨率.
相关概念视频
01:37Super-resolution Fluorescence Microscopy
7.1K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.1K
01:20Deconvolution
191
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
191
01:22Upsampling
265
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
265