免费融合:通过交叉重建进行红外和可见图像融合学习
概括
这项研究引入了一种用于红外和可见图像融合的新型交叉重建学习方法,消除了手工制作的损失. 该方法有效地对齐图像域,并融合语义信息,提高高级任务性能.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 人工智能的人工智能
背景情况:
- 现有的图像融合方法依赖于经验,手工制作的损失,由于缺乏基本真相,可能无法捕捉所有重要特征.
- 图像融合的挑战包括源图像之间的域差异和高级任务中的语义不匹配.
研究的目的:
- 通过交叉重建学习提出一种新的红外和可见图像融合方法.
- 克服手工融合损失的局限性,解决域差异和语义不匹配的问题.
主要方法:
- 交叉重建学习模型旨在解融合特征以重建源图像,迫使域适应性表示学习和潜在空间对齐.
- 引入了一个动态的交互式融合策略,利用融合和语义特征之间的相关矩阵来增强相关信息并抑制无关紧要的细节.
主要成果:
- 与最先进的技术相比,拟议的方法在三个数据集中展示了优越的融合性能.
- 融合方法显著提高后续高级任务的准确性,例如图像细分.
结论:
- 交叉重建学习为红外和可见图像融合提供了一种有效的,无损的方法.
- 该方法成功地对准了功能域,并解决了语义不匹配,从而提高了下游应用程序的性能.
相关概念视频
Infrared (IR) Spectroscopy: Overview
2.4K
When electromagnetic radiation passes through a material, atoms or molecules transition from a lower to a higher energy state by absorbing radiation corresponding to the energy difference between the two states. The absorption of infrared (IR) radiation causes transitions between vibrational energy levels in a molecule. Therefore, IR spectroscopy is a useful analytical tool for determining the molecular structure of molecules.
Different compounds display unique properties due to their...
Different compounds display unique properties due to their...
2.4K
IR Frequency Region: Fingerprint Region
1.2K
IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the...
1.2K
IR Frequency Region: X–H Stretching
1.1K
In IR spectroscopy, signals produced by the X−H bonds (such as C−H, O−H, or N−H) can be observed in the frequency range of 2700–4000 cm–1. The C−H stretching vibration forms sharp bands in the region 2850–3000 cm–1. The presence of the O−H stretching vibration leads to the forming of an absorption band in the frequency range 3650–3200 cm−1. At the same time, N−H stretching can be confirmed by absorption bands in...
1.1K
IR Spectrometers
1.5K
There are two main infrared (IR) spectrophotometers: dispersive IR spectrometers and Fourier transform infrared (FTIR) spectrometers. In a dispersive IR spectrometer, a beam of infrared radiation produced by a hot wire is divided into two parallel equal-intensity beams using mirrors. One beam passes through the sample, while another is a reference beam. The beams then move through the monochromator, which separates the radiations into a continuous spectrum of different frequencies. The...
1.5K
Attenuated Total Reflectance (ATR) Infrared Spectroscopy: Overview
591
Attenuated total reflectance (ATR) infrared spectroscopy is a powerful analytical technique used to study the composition of materials. It is widely employed in chemistry, materials science, forensic science, and other fields where sample characterization is required. ATR has several advantages over traditional transmission IR spectroscopy, including the requirement of little to no sample preparation and the ability to analyze a wide range of samples.
The ATR process begins by directing a beam...
The ATR process begins by directing a beam...
591
IR Absorption Frequency: Hybridization
781
Hydrocarbons such as alkanes, alkenes, and alkynes show characteristic C–H stretching absorption bands. These IR stretching frequencies depend on the hybridization of the involved carbon atom and can be explained in terms of the s character of each hybridized atomic orbital.
Among the sp, sp2, and sp3 hybridized orbitals, sp orbitals have the maximum s character (50%). Consequently, the electrons are held more closely to the nucleus, resulting in stronger and shorter C–H bonds that...
Among the sp, sp2, and sp3 hybridized orbitals, sp orbitals have the maximum s character (50%). Consequently, the electrons are held more closely to the nucleus, resulting in stronger and shorter C–H bonds that...
781


