通过增强的多尺度编码器和基于注意力的网络,推进红外和可见图像融合
Jiashuo Wang1,2,3, Yong Chen4, Xiaoyun Sun4,3
1School of Mechanical Engineering, Shijiazhuang Tiedao University, Shijiazhuang 050043, Hebei, China.
iScience
|October 9, 2024
概括
通过使用先进的自动编码解码器网络,EMAFusion 增强了红外和可见图像的融合. 这种新的方法改善了目标检测和纹理细节,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 人工智能的人工智能
背景情况:
- 红外和可见图像融合结合了热和纹理细节,以提高目标可见性.
- 现有的自动编码器-解码器融合方法由于手动的融合策略而缺乏灵活性.
研究的目的:
- 推出EMAFusion,一种新的融合方法,具有增强的多尺度编码器和可学习的融合网络.
- 提高红外和可见图像融合技术的灵活性和性能.
主要方法:
- 开发了一个增强的自动编码器-解码器框架,包含跳过连接,CBAM和巢架构.
- 提出了一个融合网络,利用空间和道注意力机制来实现特征集成.
- 使用TNO图像融合数据集进行全面评估.
主要成果:
- 与最先进的融合方法相比,EMAFusion表现出更高的性能.
- 增强的多尺度编码器有效地提取和保存多尺度特征.
- 注意驱动的融合网络精确地整合了红外和可见图像的基本特征.
结论:
- 对于红外和可见图像融合,EMAFusion提供了一种灵活有效的解决方案.
- 拟议的方法通过改进目标突出显示和纹理保存来推进该领域.
- 对于需要融合图像的各种现实应用,EMAFusion显示出巨大的潜力.
相关概念视频
Association Areas of the Cortex
5.1K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.1K
Vision
53.0K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.0K
Visual System
553
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
553


