MHDBN:基于Mamba的混合双分支网络,用于多焦图像融合
概括
一个新的基于Mamba的混合双分支网络 (MHDBN) 在多焦图像融合 (MFIF) 中表现出色. 这种先进的网络实现了卓越的性能,在关键指标上超过了其他13种方法.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 图像处理 图像处理
背景情况:
- 多焦图像融合 (MFIF) 对于组合具有不同焦平面的图像至关重要.
- 现有的方法往往难以有效地捕捉远程依赖和局部细节.
研究的目的:
- 引入一种基于Mamba的新型混合双分支网络 (MHDBN),以实现高质量的多焦图像融合.
- 通过有效地整合全球背景和本地纹理信息来增强融合过程.
主要方法:
- 提出了一个并行的Mamba-ConvNeXt架构,Mamba处理远程依赖,ConvNeXt专注于局部纹理.
- 层次特征交互模块 (HFIM) 调整特征,而多尺度特征聚合模块 (MSFAM) 适应性地强调焦点区域.
- 一个上采样模块生成决策地图和最终的融合图像.
主要成果:
- 与13种最先进的MFIF方法相比,MHDBN在三个公共数据集 (Lytro,MFFW,SAVIC) 中表现出卓越的表现.
- 该网络在数据集中的6,10和9个目标指标上分别获得了最高分.
- 与第二最佳方法相比,SAVIC数据集的相互信息 (MI) 得到了17.4%的显著改善.
结论:
- 拟议的MHDBN显著推进了多焦图像融合的最先进技术.
- 混合架构有效平衡全球和本地特征提取,以获得卓越的融合质量.
- 广泛的结果验证了MHDBN方法的整体优越性和有效性.
相关概念视频
01:22Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
01:16Confocal Fluorescence Microscopy
14.3K
Confocal microscopy is an advanced microscopic technique. The prime advantage of the confocal microscope over other microscopy techniques is its ability to block the out-of-focus light from the illuminated samples using pinholes. It is widely used with fluorescence optics to obtain high-resolution, sharp contrast images. Unlike optical microscopes, confocal microscopes use a focused beam of light laser to scan the entire sample surface at different z-planes. These microscopes are, therefore,...
14.3K