SGAFuse:用于RGB热图像的语义引导的自适应融合,通过动态关口
Chao Yang1, Deshui Miao1, Chao Tian1
1School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), China.
概括
本研究介绍了一种新的RGB-T图像融合方法,使用语义引导的注意力和动态门. 这种方法通过自适应地融合可见和红外图像以提高跨场景的稳定性来增强计算机视觉任务.
科学领域:
- 计算机视觉 计算机视觉
- 图像处理 图像处理
- 人工智能的人工智能
背景情况:
- 可见和红外图像融合整合了用于增强计算机视觉的互补数据.
- 现有的方法往往使用相同的权重,忽视模式的重要性和动态场景需求.
研究的目的:
- 开发一种强大的RGB-T融合方法,适应各种场景.
- 为了提高融合图像的质量和实用性,用于下游任务.
主要方法:
- 提出了一种新的RGB-T融合方法,利用语义引导的注意力和动态门机制.
- 引入了一种双模态语义驱动的特征对齐模块,具有跨模态查询补偿和内部模态查询增强.
- 实现了基于输入场景的自适应模块权重的动态多路径门机制.
主要成果:
- 拟议的方法在四个基准数据集上展示了最先进的性能.
- 与现有的融合技术相比,获得了优异的定性和定量评估.
- 在各种具有挑战性的场景中展示了改进的稳健性.
结论:
- 语义导向的注意力和动态门机制显著增强了RGB-T图像融合.
- 该方法为计算机视觉应用提供了更好的稳定性和性能.
- 这种方法为多模式图像融合提供了更具适应性和有效的解决方案.
更多相关视频
07:34Excitation-Scanning Hyperspectral Imaging Microscopy to Efficiently Discriminate Fluorescence Signals
Published on: August 22, 2019
8.5K
06:53Management of Respiratory Motion Artefacts in 18F-fluorodeoxyglucose Positron Emission Tomography using an Amplitude-Based Optimal Respiratory Gating Algorithm
Published on: July 23, 2020
6.2K
相关概念视频
01:37Super-resolution Fluorescence Microscopy
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been developed.
01:02Flame Photometry: Overview
Flame photometry, also known as flame emission spectrometry, is a technique used for the qualitative and quantitative analysis of elements present in a sample using a flame as the source of excitation energy. The concept of flame photometry was realized in the early 1860s by Kirchhoff and Bunsen, who discovered that specific elements emit characteristic radiation when excited in flames. The first instrument developed for this purpose was used to measure sodium (Na) in plant ash using a Bunsen...