纹理保护和信息损失最小化方法用于红外和可见图像融合
Qiyuan He1,2, Yongdong Huang3
1Institute of Image Understanding Research, North Minzu University, Yinchuan, 750021, China.
Scientific reports
|July 23, 2025
概括
通过保留纹理和最大限度地减少信息丢失,TPFusion增强了红外和可见图像的融合. 这种新的方法在聚变质量和下游任务 (如物体检测) 中实现了卓越的性能.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 人工智能的人工智能
背景情况:
- 红外和可见图像的融合旨在将不同模式的互补信息结合起来.
- 现有的融合方法往往无法平衡纹理保护,信息保留和对比度增强.
- 纹理退化和信息丢失是当前图像融合技术中常见的问题.
研究的目的:
- 提出TPFusion,一种用于红外和可见图像融合的新方法.
- 通过保持细粒度纹理和尽量减少信息丢失来解决现有方法的局限性.
- 为了增强对比度并保持合图像中的清晰边缘.
主要方法:
- 对于全面的特征捕获,TPFusion采用一个多尺度特征提取模块.
- 它包含纹理和对比度增强模块,以保存细节和突出特征.
- 双重注意力融合模块集成了功能,由基于信息内容的丢失函数指导,以尽量减少差异和信息丢失.
主要成果:
- 在TNO,MSRS和M3FD数据集中,TPFusion展示了优越的融合性能,超过了现有方法.
- 在诸如平均梯度 (AG),混合/化的质量 (QAB/F),相关系数 (CC),空间相关度 (SCD) 和能量 (EN) 等指标中观察到显著改善.
- 在下游任务中,TPFusion在对象检测中获得了最高的平均精度,在语义细分中获得了第二高的精度.
结论:
- TPFusion有效地保留了纹理,并最大限度地减少了红外和可见图像融合中的信息损失.
- 拟议的方法在图像融合质量和下游应用方面取得了最先进的结果.
- TPFusion提供了一个强大的解决方案,可以提高融合红外和可见图像的解释性和实用性.
相关概念视频
Infrared (IR) Spectroscopy: Overview
2.4K
When electromagnetic radiation passes through a material, atoms or molecules transition from a lower to a higher energy state by absorbing radiation corresponding to the energy difference between the two states. The absorption of infrared (IR) radiation causes transitions between vibrational energy levels in a molecule. Therefore, IR spectroscopy is a useful analytical tool for determining the molecular structure of molecules.
Different compounds display unique properties due to their...
Different compounds display unique properties due to their...
2.4K
Attenuated Total Reflectance (ATR) Infrared Spectroscopy: Overview
567
Attenuated total reflectance (ATR) infrared spectroscopy is a powerful analytical technique used to study the composition of materials. It is widely employed in chemistry, materials science, forensic science, and other fields where sample characterization is required. ATR has several advantages over traditional transmission IR spectroscopy, including the requirement of little to no sample preparation and the ability to analyze a wide range of samples.
The ATR process begins by directing a beam...
The ATR process begins by directing a beam...
567
IR Frequency Region: Fingerprint Region
1.1K
IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the...
1.1K
Reducing Line Loss
194
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
194
IR Frequency Region: X–H Stretching
1.1K
In IR spectroscopy, signals produced by the X−H bonds (such as C−H, O−H, or N−H) can be observed in the frequency range of 2700–4000 cm–1. The C−H stretching vibration forms sharp bands in the region 2850–3000 cm–1. The presence of the O−H stretching vibration leads to the forming of an absorption band in the frequency range 3650–3200 cm−1. At the same time, N−H stretching can be confirmed by absorption bands in...
1.1K
IR Spectrometers
1.5K
There are two main infrared (IR) spectrophotometers: dispersive IR spectrometers and Fourier transform infrared (FTIR) spectrometers. In a dispersive IR spectrometer, a beam of infrared radiation produced by a hot wire is divided into two parallel equal-intensity beams using mirrors. One beam passes through the sample, while another is a reference beam. The beams then move through the monochromator, which separates the radiations into a continuous spectrum of different frequencies. The...
1.5K


