通过空间光谱交叉注意力驱动网络进行计算光谱成像重建
概括
计算光谱成像 (CSI) 从2D数据中重建3D超光谱图像. 我们的新型网络SSCA-DN通过整合多尺度特征和交叉注意力机制来增强空间光谱重建,以提高准确性.
科学领域:
- 计算机成像成像技术
- 超光谱成像技术的使用.
- 计算机视觉 计算机视觉 计算机视觉
背景情况:
- 计算光谱成像 (CSI) 提供了具有高空间和时间分辨率的快照成像,超过了传统的高光谱成像.
- 在CSI的一个关键挑战是从单个2D测量中重建3D空间超谱图像 (HSI).
- 现有的方法在空间-光谱交叉相关性和多尺度特征重建方面扎,导致扭曲和质量降低.
研究的目的:
- 解决CSI重建的局限性,特别是空间频谱扭曲和不充分的多尺度特征处理.
- 提出一个新的网络,空间频谱交叉注意力驱动网络 (SSCA-DN),用于准确的HSI重建.
- 改进CSI中的空间光谱交叉相关性和多尺度特征的建模.
主要方法:
- 开发了一个空间-光谱交叉注意 (SSCA) 模块,包含多尺度特征聚合 (MFA) 和光谱智能变压器 (SpeT).
- 构建SSCA-DN网络,包括一个监督的初步重建子网络 (SPRNet) 对于一般的priors和一个无监督的多级特征融合和精炼子网络 (UMFFRNet) 对于特定的priors.
- 在UMFFRNet中引入了一个多尺度的融合和精细化机制,以建模相邻水平特征和多尺度空间频谱信息之间的相关性.
主要成果:
- 在SSCA模块有效地建模空间光谱交叉相关性,同时考虑多尺度特征.
- SSCA-DN网络利用学到的一般化和特定的先验来捕捉复杂的空间频谱关系.
- 多尺度的融合和精炼机制通过建模跨层次的特征相关性,显著提高了重建的准确性.
结论:
- 拟议的SSCA-DN网络在超光谱图像重建方面实现了最先进的性能.
- 该方法在模拟和现实数据集上都表现出卓越的准确性.
- 通过集成先进的注意力和多层次处理,SSCA-DN有效地克服了现有的CSI重建技术的局限性.
相关概念视频
Reconstruction of Signal using Interpolation
337
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
337
Aliasing
227
Accurate signal sampling and reconstruction are crucial in various signal-processing applications. A time-domain signal's spectrum can be revealed using its Fourier transform. When this signal is sampled at a specific frequency, it results in multiple scaled replicas of the original spectrum in the frequency domain. The spacing of these replicas is determined by the sampling frequency.
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
227
Computed Tomography
6.2K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
6.2K


