MeViS:用于引用运动表达式视频分割的多模式数据集.
IEEE transactions on pattern analysis and machine intelligence
|August 19, 2025
概括
本研究介绍了MeViS,这是一个用于基于运动的视频细分的大型数据集. 它强调了当前方法的局限性,并提出LMPM++来推进引用视频对象分割 (RVOS) 和跟踪.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 现有的视频细分数据集往往忽略了运动线索,依赖于静态属性.
- 这限制了基于对象的动态行为来理解和跟踪对象的能力.
研究的目的:
- 介绍MeViS,一个新的大型多模式数据集,用于引用运动表达式视频细分.
- 通过对物体运动的语言描述,实现对运动引导视频理解和像素级分析的研究.
主要方法:
- 开发了MeViS数据集,在2,006个视频中包含33,072个注释的运动表达 (文本/音频).
- 在任务上对现有15种方法进行了基准测试,包括引用视频对象分割 (RVOS),音频引导视频对象分割 (AVOS) 和引用多对象跟踪 (RMOT).
- 拟议的LMPM++方法,以解决动作引导视频理解的局限性.
主要成果:
- 确定了当前用于以运动表达为指导的视频理解方法的重大缺陷.
- 在RVOS,AVOS和RMOT任务中,LMPM++取得了新的最先进的结果.
- MeViS数据集促进了复杂视频场景分析的进步.
结论:
- 运动表达对于强大的视频细分和跟踪至关重要.
- MeViS数据集和LMPM++为这个领域的未来研究提供了基础.
- 需要进一步开发,以充分利用视频理解中的运动线索.
相关概念视频
Relative Motion Analysis using Rotating Axes
531
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
531
Absolute Motion Analysis- General Plane Motion
271
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
271
Relative Motion Analysis - Velocity
430
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
430
Relative Motion Analysis using Rotating Axes-Problem Solving
449
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
449
Relative Motion Analysis using Rotating Axes - Acceleration
394
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
394
Relative Motion Analysis - Acceleration
424
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
424


