红外和可见图像融合网络与联合变压器和Resnet的逐步分解
1Department of Mathematics, Ministry of General Education, Anhui Xinhua University, Hefei, China.
PloS one
|August 22, 2025
概括
这项研究引入了红外和可见图像融合 (IVIF) 的渐进分解网络. 这种新的方法提高了细节提取效率, 优于现有的深度学习方法.
科学领域:
- 计算机视觉
- 人工智能
- 图像处理
背景情况:
- 图像融合旨在从多个来源创建一个单一的,信息丰富的图像.
- 目前的深度学习方法在融合过程中难以平衡基本和详细特征.
- 现有的网络往往忽视了源图像的独特特征.
研究的目的:
- 开发一个用于红外和可见图像融合的渐进分解网络 (IVIF).
- 为了改善融合图像的基本和细节特征之间的平衡.
- 增强机器感知和人类视觉解释能力.
主要方法:
- 一个集成Lite Transformer (LT) 和ResNet架构的渐进分解网络.
- 使用CNN进行初始粗放特征提取.
- 用于将特征分为基本和详细组件的LT模块.
- 级联 LT 操作和专门的融合子网络进行层间处理.
- 一个用于特征对齐的新型相关损失函数.
主要成果:
- 拟议的网络有效地提取和融合基本和详细特征.
- 与现有的深度学习方法相比,在细节提取方面表现优越.
- 实现了高级视觉任务的增强合图像质量.
结论:
- 逐步分解网络为IVIF提供了显著的进步.
- 整合LT和ResNet架构优化了特征提取和融合.
- 该方法显示了改善下游图像相关任务的巨大潜力.
相关概念视频
Deconvolution
251
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
251
Infrared (IR) Spectroscopy: Overview
2.3K
When electromagnetic radiation passes through a material, atoms or molecules transition from a lower to a higher energy state by absorbing radiation corresponding to the energy difference between the two states. The absorption of infrared (IR) radiation causes transitions between vibrational energy levels in a molecule. Therefore, IR spectroscopy is a useful analytical tool for determining the molecular structure of molecules.
Different compounds display unique properties due to their...
Different compounds display unique properties due to their...
2.3K
Convolution Properties II
281
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
281
Reconstruction of Signal using Interpolation
335
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
335
Convolution Properties I
236
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
236
Transformers in Distribution System
156
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
156


