双频导向特征融合网络用于可见红外人重新识别
Xingyu Cao1, Pengxin Ding1, Jie Li1
1School of Computer Science, Chengdu University of Information Technology, Chengdu 610225, China.
Sensors (Basel, Switzerland)
|March 17, 2025
概括
这项研究引入了一个双频特征融合网络 (BiFFN),通过减少模式差距来改善可见红外人重新识别 (VI-ReID). 这种新的方法增强了跨频率和空间域的特征提取和融合,实现了最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 可见红外人重新识别 (VI-ReID) 面临挑战,原因是可见和红外行人图像之间的模式差距.
- 现有的方法通常通过仅关注空间域特征或采用简单的融合策略来限制信息提取.
研究的目的:
- 为有效的VI-ReID提出一个新的双频特征融合网络 (BiFFN).
- 通过频率空间共同学习和增强特征融合,系统地解决模式差异.
主要方法:
- 开发了一个BiFFN,包括频率空间增强 (FSE),深频挖矿 (DFM) 和交叉频率融合 (CFF) 模块.
- 引入了统一的模式中心 (UMC) 损失,以改进共同空间中的身份特征分布.
- 来自高频,低频和空间领域的融合特征,以最大限度地减少模式差距.
主要成果:
- 在VI-ReID基准上取得了最先进的表现.
- 在SYSU-MM01数据集 (全搜索模式) 上实现了77.5%的Rank-1准确率和75.9%的mAP.
- 在LLCM数据集 (IR-VIS模式) 上达到58.5%的排名-1准确率和63.7%的mAP.
结论:
- 拟议的BiFFN通过将频域信息与空间特征集成,显著减少VI-ReID中的模式差距.
- 系统的频率空间共同学习方法和先进的融合模块导致比现有方法更高的性能.
- UMC的损失有效地平衡了跨模式的分配,同时保留了歧视性的身份信息.
相关概念视频
IR Frequency Region: Fingerprint Region
682
IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the...
682
Association Areas of the Cortex
4.8K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
4.8K
Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K


