PHFuse:无监督的可见色和红外图像融合与保存色调
ChuHeng Zhuang1,2, HaiPeng Kuang3,4, Hao Wang1,5
1Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, 130033, PR China.
Scientific reports
|August 26, 2025
概括
这项研究引入了PHFuse,一种新的可见和红外图像融合方法,可保存丰富的色彩信息. 与现有方法相比,PHFuse可以增强合图像的色彩和细节.
科学领域:
- 计算机视觉
- 图像处理
- 人工智能
背景情况:
- 可见和红外图像融合 (VIF) 结合了可见和红外图像的互补数据.
- 现有的VIF方法往往忽略了色彩信息,专注于灰度细节.
- 这限制了融合图像的感知质量和信息丰富性.
研究的目的:
- 提出一种新的VIF方法,PHFuse,
- 通过详细的强度/梯度和丰富的色彩信息来增强融合图像.
- 为了实现无人监督的色彩信息融合训练.
主要方法:
- 使用HSV颜色空间来定位色彩和强度的融合.
- 为代融合策略设计了一个自适应通道融合分支.
- 引入了无监督训练的光谱角度映射损失.
主要成果:
- 它成功地融合了强度,渐变和丰富的色彩信息.
- 与最先进的方法相比, 融合图像呈现出更丰富的色彩.
- 强度和梯度融合性能与现有的领先方法相美.
结论:
- 在VIF中提供卓越的颜色保存.
- 这种方法增强了融合图像的视觉感知和信息内容.
- PHFuse 代表了可见和红外图像融合技术的重大进展.
相关概念视频
Infrared (IR) Spectroscopy: Overview
2.3K
When electromagnetic radiation passes through a material, atoms or molecules transition from a lower to a higher energy state by absorbing radiation corresponding to the energy difference between the two states. The absorption of infrared (IR) radiation causes transitions between vibrational energy levels in a molecule. Therefore, IR spectroscopy is a useful analytical tool for determining the molecular structure of molecules.
Different compounds display unique properties due to their...
Different compounds display unique properties due to their...
2.3K
Ultraviolet and Visible (UV–Vis) Spectroscopy: Overview
3.0K
Ultraviolet–visible (UV–visible or UV–Vis) spectroscopy is an analytical technique that investigates the interaction between matter and UV–Vis light within the electromagnetic spectrum. This method is widely used for its versatility, simplicity, and relatively quick data acquisition, making it valuable for both qualitative and quantitative analysis. When UV–Vis radiation passes through a material, molecules absorb light depending on the energy required for...
3.0K
Color Vision
695
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
695
Attenuated Total Reflectance (ATR) Infrared Spectroscopy: Overview
536
Attenuated total reflectance (ATR) infrared spectroscopy is a powerful analytical technique used to study the composition of materials. It is widely employed in chemistry, materials science, forensic science, and other fields where sample characterization is required. ATR has several advantages over traditional transmission IR spectroscopy, including the requirement of little to no sample preparation and the ability to analyze a wide range of samples.
The ATR process begins by directing a beam...
The ATR process begins by directing a beam...
536
IR Frequency Region: Fingerprint Region
1.1K
IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the...
1.1K
IR Frequency Region: X–H Stretching
1.1K
In IR spectroscopy, signals produced by the X−H bonds (such as C−H, O−H, or N−H) can be observed in the frequency range of 2700–4000 cm–1. The C−H stretching vibration forms sharp bands in the region 2850–3000 cm–1. The presence of the O−H stretching vibration leads to the forming of an absorption band in the frequency range 3650–3200 cm−1. At the same time, N−H stretching can be confirmed by absorption bands in...
1.1K


