UniSOT:多模式单个对象跟踪的统一框架
IEEE transactions on pattern analysis and machine intelligence
|October 13, 2025
概括
一个新的统一追踪器,UniSOT,可以处理多个参考和视频模式,以实现强大的单个对象追踪. 这种方法可以提高各种基准的性能,优于专门的追踪器.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 单个对象跟踪 (SOT) 通常使用特定的参考 (例如,边界框,自然语言) 和视频模式 (例如,RGB,RGB+Depth).
- 现有的SOT追踪器往往是特定于模式的,导致单独的模型设计和有限的适用性.
- 需要采用统一的方法来处理各种模式的多样化跟踪要求.
研究的目的:
- 推出UniSOT,这是一种能够同时处理多个参考和视频模式的新型统一追踪器,具有统一的参数.
- 解决现有的模式特定追踪器在实际应用中的局限性.
主要方法:
- 开发了UniSOT,这是一个统一的追踪器,旨在组合三个参考模式和四个视频模式.
- 在所有模式组合中使用统一的参数.
- 在18个不同的基准上进行了广泛的实验,包括视觉跟踪,视觉语言跟踪和RGB+X跟踪.
主要成果:
- 与模式特定的追踪器相比,UniSOT在各种基准上表现优越.
- 在TNL2K基准指标上,在所有三种参考模式中实现了AUC的3.0%以上的改善.
- 在所有三种RGB+X视频模式中,在主要指标上表现优于Un-Track超过2.0%.
结论:
- UniSOT提供了一种多功能和高性能解决方案,用于跨多种参考和视频模式的单个对象跟踪.
- 统一的方法简化了模型设计,并提高了复杂场景中的实际应用性.
- UniSOT为多模式跟踪性能设定了一个新的标准.
相关概念视频
Non-inertial Frames of Reference
7.1K
A reference frame accelerating or decelerating relative to an inertial frame is a non-inertial frame. To help understand this, consider what taking off in an airplane, turning a corner in a car, riding a merry-go-round, and the circular motion of a tropical cyclone all have in common. All these systems are accelerating, decelerating, or rotating relative to the Earth; hence, they all are non-inertial frames. All these systems exhibit inertial forces, which merely seem to arise from motion,...
7.1K
Relative Motion Analysis using Rotating Axes
879
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
879
Inertial Frames of Reference
8.6K
Newton’s first law is usually considered to be a statement about reference frames. It provides a method for identifying a special type of reference frame: the inertial reference frame. In principle, we can make the net force on a body zero. If its velocity relative to a given frame is constant, then that frame is said to be inertial. So, by definition, an inertial reference frame is a reference frame where Newton's first law holds valid. Newton's first law applies to objects with...
8.6K
Orthogonal Trajectories
6
Orthogonal trajectories describe the geometric relationship between two families of curves that intersect each other at right angles. One illustrative case involves a family of parabolas that open sideways along the x-axis. These curves share a common shape but differ by a scaling parameter, resulting in a set of curves that all pass through the origin and widen at different rates.Determining Orthogonal TrajectoriesTo identify the orthogonal trajectories for these parabolas, the first step...
6
Absolute Motion Analysis- General Plane Motion
536
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
536
Relative Motion Analysis using Rotating Axes-Problem Solving
702
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
702


