通过深度低等级张量表示的光谱超分辨率
IEEE transactions on neural networks and learning systems
|March 11, 2024
概括
这项研究引入了一个新的低级 Tensor 重建网络 (LTRN) 用于光谱超分辨率. 在LTRN实现高质量的高光谱图像重建的参数较少,超越现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 机器学习 机器学习
背景情况:
- 超光谱成像 (HSI) 提供了丰富的光谱信息,但获得高分辨率数据是具有挑战性的.
- 目前基于卷积神经网络 (CNN) 的光谱超分辨率方法往往忽略了HSI固有的低级别属性,导致了高计算和存储需求.
- 美国有线电视新闻网的受感范围有限,限制了他们捕捉全球信息相关性的能力.
研究的目的:
- 开发一种用于光谱超分辨率的新型网络,解决现有的基于CNN的方法的局限性.
- 为了利用高光谱图像的低等级先验,实现高效和有效的光谱超分辨率.
- 为了降低与超光谱图像超分辨率相关的计算和存储成本.
主要方法:
- 提出了一个低级 Tensor 重建网络 (LTRN),将 HSI 特性视为低级 3D 张量.
- 一个自适应的低级预先学习 (ALPL) 模块结合了正规多元 (CP) 分解与神经网络,用于1D特征学习.
- 该ALPL模块包含一个适应向量学习 (AVL) 模块用于HSI压缩和一个多维多头自我注意 (MMSA) 模块来捕获远程依赖.
主要成果:
- 该LTRN有效地重建高光谱图像,增强光谱分辨率.
- 在CAVE和哈佛数据集上的实验结果表明,LTRN的效率与最先进的方法相美.
- 与现有方法相比,拟议的LTRN显著减少了参数的数量.
结论:
- LTRN为光谱超分辨率提供了一个计算高效和有效的解决方案.
- 低级张量分解和自我注意机制的整合对HSI重建有好处.
- 该方法为获得高质量的超光谱图像提供了有希望的替代方案,资源需求减少.
相关概念视频
Super-resolution Fluorescence Microscopy
7.0K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
7.0K
Attenuated Total Reflectance (ATR) Infrared Spectroscopy: Overview
363
Attenuated total reflectance (ATR) infrared spectroscopy is a powerful analytical technique used to study the composition of materials. It is widely employed in chemistry, materials science, forensic science, and other fields where sample characterization is required. ATR has several advantages over traditional transmission IR spectroscopy, including the requirement of little to no sample preparation and the ability to analyze a wide range of samples.
The ATR process begins by directing a beam...
The ATR process begins by directing a beam...
363
Upsampling
236
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
236
Deconvolution
159
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
159
Downsampling
157
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
157


