通过合低级次空间表示和自我监督的深度网络进行超光谱压缩快照重建.
概括
这项研究引入了一种用于从2D测量中重建3D超光谱图像 (HSI) 的新方法,使用编码光圈快照光谱成像 (CASSI). 这种方法提高了准确性和概括性,而不需要配对的训练数据.
科学领域:
- 光学和光子学 在光学和光子学.
- 计算机视觉 计算机视觉
- 信号处理 信号处理
背景情况:
- 编码孔口快照光谱成像 (CASSI) 可以捕获3D超光谱图像 (HSI),但面临重建挑战.
- 现有的方法与隐含的HSI特征作斗争,需要广泛的培训数据,并提供有限的解释性.
研究的目的:
- 开发一种新的HSI重建方法,克服当前方法的局限性.
- 为了提高重建准确性,概括性能和3DHSI的解释性.
主要方法:
- 一个模型驱动的低级子空间表示分解了HSI.
- 一个数据驱动的深度引导空间注意网络 (DGSAN) 学习深度系数先验 (DCP).
- 自主监督培训将先验集成到代优化框架中,而不需要配对数据.
主要成果:
- 拟议的方法证明了3DHSI的增强重建精度.
- 在不同的数据集和成像系统中观察到更好的概括能力.
- 与现有技术相比,这种方法提供了更好的解释性.
结论:
- 新的HSI重建方法有效地利用了光谱相关性和深度先验.
- 自主监督,数据驱动的方法为CASSI提供了一个强大的解决方案.
- 这项工作推进了具有卓越性能和可解释性的3D HSI重建.
相关概念视频
Deconvolution
160
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
160
Upsampling
238
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
238
Downsampling
158
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
158
Reconstruction of Signal using Interpolation
203
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
203
Aliasing
136
Accurate signal sampling and reconstruction are crucial in various signal-processing applications. A time-domain signal's spectrum can be revealed using its Fourier transform. When this signal is sampled at a specific frequency, it results in multiple scaled replicas of the original spectrum in the frequency domain. The spacing of these replicas is determined by the sampling frequency.
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
If the sampling frequency is below the Nyquist rate, these replicas overlap, preventing the original...
136
Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K


