VisEvent:通过框架和事件流的协作可靠的对象跟踪
IEEE transactions on cybernetics
|October 12, 2023
概括
本研究介绍了VisEvent,这是一个用于可见事件对象跟踪的大规模数据集. 它还介绍了一种新的跨模式变压器,用于有效的传感器融合,在具有挑战性的条件下提高跟踪可靠性.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 传感器融合式传感器
背景情况:
- 可见摄像头捕捉强度图像,但与运动模糊和低动态范围扎.
- 事件摄像机提供低延迟,高动态范围和运动模糊免疫力,非常适合动态场景.
- 结合可见和事件摄像头,增强了对象跟踪能力.
研究的目的:
- 为了解决缺乏大规模,现实的数据集可见事件对象跟踪.
- 开发和验证一个强大的双模式物体跟踪系统.
- 促进对传感器融合进行研究,以提高感知.
主要方法:
- 介绍 VisEvent 数据集:在低光,高速和杂乱条件下捕获的 820 个视频对.
- 通过扩展单模式方法开发超过30个基线双模式追踪器.
- 关于跨模式变压器的建议,用于在可见和事件数据之间有效的特征融合.
主要成果:
- 对VisEvent和其他基准进行了广泛的实验,证明了拟议的跟踪算法的有效性.
- 交叉模式变压器显著改善了可见事件对象跟踪的特征融合.
- VisEvent数据集可以全面评估双模式跟踪方法.
结论:
- VisEvent数据集为推进可见事件对象跟踪研究提供了宝贵的资源.
- 拟议的跟踪算法与交叉模式融合实现了最先进的性能.
- 使用可见和事件摄像头的合作传感提供了卓越的对象跟踪可靠性.
相关概念视频
Frames: Problem Solving II
237
Consider a hydraulic hoist supporting a load of 1 kN. Assuming a simplified schematic representation of this frame structure, the force acting on BD and BF members can be determined.
237
Relative Motion Analysis using Rotating Axes
472
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
472
Frames: Problem Solving I
492
Consider a jib crane with an external load suspended from the pulley. The dimensions of the crane members are shown in the figure. A systematic analysis of the frame structure is required to determine the reaction forces at the pin joints, assuming that the pulleys are frictionless.
492
Relative Motion Analysis using Rotating Axes-Problem Solving
408
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
408
Non-inertial Frames of Reference
5.9K
A reference frame accelerating or decelerating relative to an inertial frame is a non-inertial frame. To help understand this, consider what taking off in an airplane, turning a corner in a car, riding a merry-go-round, and the circular motion of a tropical cyclone all have in common. All these systems are accelerating, decelerating, or rotating relative to the Earth; hence, they all are non-inertial frames. All these systems exhibit inertial forces, which merely seem to arise from motion,...
5.9K
Inertial Frames of Reference
7.1K
Newton’s first law is usually considered to be a statement about reference frames. It provides a method for identifying a special type of reference frame: the inertial reference frame. In principle, we can make the net force on a body zero. If its velocity relative to a given frame is constant, then that frame is said to be inertial. So, by definition, an inertial reference frame is a reference frame where Newton's first law holds valid. Newton's first law applies to objects with...
7.1K


