GAE-Net:一个步行辅助增强网络,用于基于视频的个人重新识别
Minting Dai1, Xi Yang1, Wenjiao Dong1
1State Key Laboratory of Integrated Services Networks, School of Telecommunications Engineering, Xidian University, Xi'an, 710071, China.
概括
本研究介绍了一种步行辅助增强网络 (GAE-Net),通过结合外观和步行特征来改善人体重新识别 (Re-ID). GAE-Net增强了对外观变化的稳定性,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 生物识别信息 生物识别信息
背景情况:
- 基于视频的个人重新识别 (Re-ID) 在很大程度上依赖于外观,使其易受照明和颜色变化的影响.
- 步态信息提供了对外观变化的稳定性,并提供了时间线索,但步态和RGB数据之间的差距仍然是一个挑战.
研究的目的:
- 提出一个步行辅助增强网络 (GAE-Net) 来同时从RGB视频序列中学习外观和步行特征.
- 为了弥合步态和RGB数据之间的差距,在人身 Re-ID 系统中.
- 为了提高个人重新识别的稳定性和准确性.
主要方法:
- GAE-Net包括一个动态双流聚合网络 (DTA-Net),用于提取外观和步态特征,以及一个知识蒸融合 (KD-Fusion) 框架.
- DTA-Net使用动态特征聚合 (DFA) 模块来融合步态和外观特征.
- KD-Fusion采用局部感知补充蒸 (LPCD) 来将知识从多式模式转移到单式模式的Re-ID网络.
主要成果:
- 提出的方法有效地学习了互补的步态和外观特征,从而产生了更全面的时空表征.
- 对MARS和LS-VID数据集的广泛实验显示,与最先进的方法相比,性能有了显著的改善.
- 与外观仅有的方法相比,GAE-Net在外观变化方面表现出更高的稳定性.
结论:
- GAE-Net成功地整合了健壮人Re-ID.的步态和外观信息.
- 拟议的DTA-Net和KD-Fusion框架有效地解决了步态-RGB数据差距.
- 该方法为改善个人重新识别系统在具有挑战性的现实世界中提供了一个有希望的方向.
更多相关视频
相关概念视频
01:24Prosopagnosia
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
01:25Rapid Identification of Pathogens
MALDI-TOF MS has transformed clinical microbiology by offering a rapid and reliable method for pathogen identification. The traditional approach to microbial identification typically involves time-consuming culture techniques and biochemical tests, which can delay the initiation of appropriate antimicrobial therapy. MALDI-TOF MS avoids these delays by using characteristic ribosomal protein mass patterns of microbial cells, enabling accurate species-level identification within minutes.Principle...