MGNet:通过跨模式跨区域的相互指导来追踪RGBT
Jianming Zhang1, Jing Yang1, Yu Qin1
1School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, 410114, China.
概括
本研究介绍了MGNet,这是一个新的红-绿-蓝-深度 (RGBT) 追踪网络,有效地融合了不同地区和模式的特征. MGNet在基准数据集上实现了卓越的准确性和实时性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 机器人技术 机器人技术 机器人技术
背景情况:
- 来自多种模式的有效特征融合对于红-绿-蓝-深度 (RGBT) 对象跟踪至关重要.
- 现有的RGBT跟踪方法往往无法捕捉跨模式,跨区域的关系,因为它们忽视了不同模式的不同区域之间的特征依赖.
研究的目的:
- 提出一个新的RGBT追踪网络,MGNet,通过利用不同地区之间的相互指导来解决现有方法的局限性.
- 增强多模式特征的融合,以提高RGBT对象跟踪精度和效率.
主要方法:
- 开发了MGNet,一个RGBT跟踪网络,包含一个跨模式跨区域双阶段注意 (CCDA) 模块和一个多尺度区域内特征融合 (MIFF) 模块.
- CCDA模块采用了两阶段的关注机制,以保持独特的区域特征,并促进跨模块,跨区域的相互指导.
- 该MIFF模块可以实现多尺度的特征感知,以实现有效的区域内融合.
主要成果:
- 在三个RGBT基准数据集上,MGNet表现出卓越的性能:GTOT,RGBT234和LasHeR.
- 拟议的方法在RGBT对象跟踪任务中实现了高精度.
- MGNet以75 FPS的实时速度运行.
结论:
- 拟议的MGNet通过考虑跨模式,跨区域关系,有效地解决了在RGBT跟踪中融合特征的挑战.
- MGNet为准确和高效的RGBT对象跟踪提供了一个有前途的解决方案,适合实时应用.
更多相关视频
12:55Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
8.6K
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
15.9K
相关概念视频
01:30Types of Global Positioning System Surveys
125
GPS surveying methods vary in application, accuracy, and data collection techniques, catering to diverse surveying and mapping needs. Static GPS, kinematic GPS, and real-time kinematic (RTK) surveying are widely used. Each technique offers distinct advantages.Static GPS involves placing one receiver at a known reference point and another at the target point. It collects exact positional data by observing multiple satellite ranges over an extended period, achieving centimeter-level accuracy for...
125
01:28Field Application of Global Positioning System
96
The Global Positioning System (GPS) has become an indispensable tool in fieldwork, offering unparalleled precision and efficiency for surveying, navigation, and infrastructure development. By harnessing signals from a constellation of satellites, GPS receivers determine the location of objects with remarkable speed and accuracy, often completing calculations within a second.Advantages of Modern GPS TechnologyContemporary GPS receivers are designed to meet the practical demands of field...
96