SharDif:用于图像融合的共享和差异学习
Lei Liang1,2, Zhisheng Gao3
1College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China.
Entropy (Basel, Switzerland)
|January 22, 2024
概括
这项研究通过提取共享和差异特征,引入了一种新的红外和可见光图像融合方法. 这种方法提高了融合精度和视觉感知,同时保留了原始图像结构.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 人工智能的人工智能
背景情况:
- 图像融合将来自多个传感器的信息结合在一起,但现有的方法往往忽视了共享功能.
- 红外和可见光图像融合在有效整合互补数据方面提出了挑战.
研究的目的:
- 为红外和可见光图像融合提出一种新的共享和差异学习方法.
- 通过保留源图像之间的共同点和互补差异来增强图像融合.
主要方法:
- 使用共享重量编码器用于共同特征提取和单独的编码器用于差异性特征.
- 员工重量分配和特定损失功能,以实现有效的特征学习.
- 实施了以为权重的注意力机制,用于共享和差异性特征的加权融合.
主要成果:
- 拟议的模型成功地提取了共享和差异特征,以改善图像融合.
- 实验结果表明,与最先进的方法相比,性能优越.
- 该方法保留了原始图像的结构信息.
结论:
- 提出的共享和差异学习方法显著改善了红外和可见光图像融合.
- 该方法提供了更好的融合精度和增强的视觉感知.
- 这种技术有效地保留了基本的结构信息,推动了多模式图像融合领域的发展.
相关概念视频
Difference from Background: Limit of Detection
6.4K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.4K
Deconvolution
160
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
160
Associative Learning
375
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
375
Differential Leveling
181
Differential leveling is a precise method in surveying used to determine the elevation difference between two points. Its primary goal is to establish accurate vertical measurements to create level surfaces or grade lines critical for designing and constructing infrastructures such as roads, bridges, and buildings.The procedure for differential leveling begins with setting up and leveling the instrument at a point where the benchmark can be seen. The level rod is held on the benchmark (BM), and...
181


