对于盲人高光谱图像融合的空间变化的先前学习
概括
这项研究引入了一种深盲超光谱图像融合 (HIF) 方法,可以在没有配对训练数据的情况下恢复高分辨率的超光谱图像. 它有效地处理未知的空间退化,优于现有技术.
科学领域:
- 遥感 遥感 遥感 遥感
- 计算机视觉 计算机视觉
- 图像处理 图像处理
背景情况:
- 超光谱图像融合 (HIF) 旨在从低分辨率超光谱 (LR-HSI) 和高空间分辨率多光谱 (HR-MSI) 数据中创建高分辨率超光谱图像 (HR-HSI).
- 传统和深度学习方法通常依赖于已知的退化或配对训练数据,这些数据通常无法在现实世界中使用.
- 现有的HIF方法可能无法充分利用物理模型或充分解决空间变化的退化.
研究的目的:
- 提出一种新的深盲HIF方法,克服现有方法的局限性.
- 开发一种不需要配对HR-LR训练数据的方法,并且可以处理未知,空间变化的降解.
- 为了提高重建HR-HSI的准确性和视觉质量.
主要方法:
- 将基于模型的后期最大估计 (MAP) 展开为盲人HIF的深度网络.
- 使用拉普拉斯分布 (LD) 之前,消除对配对训练数据的需求.
- 开发一个观察模块,直接从LR-HSI数据中学习空间退化.
- 使用基于Swin变压器的化器来学习LD模型中的不确定性,并估计从剩余错误中降解的图像差异.
- 通过端到端的培训,共同优化MAP估计参数和观察模块.
主要成果:
- 拟议的深盲HIF方法与现有方法相比,显示出更高的性能.
- 客观评估指标显示,重建的HR-HSI质量显著改善.
- 视觉评估证实了合成和真实数据集上的融合图像的增强细节和真实性.
结论:
- 开发的深盲HIF方法有效地重建HR-HSI,而不需要配对的训练数据或对退化事先的知识.
- 该方法通过学习观察模块成功解决了空间变化的退化挑战.
- 该方法为高光谱图像融合提供了强大而高效的解决方案,性能优于当前最先进的技术.
更多相关视频
07:12Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss
Published on: April 11, 2025
461
00:07Excitation-Scanning Hyperspectral Imaging Microscopy to Efficiently Discriminate Fluorescence Signals
Published on: August 22, 2019
8.1K
相关概念视频
Depth Perception and Spatial Vision
726
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
726
Vision
53.6K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.6K
