建立一个有效的行动区域跟踪框架,用于精细的视频动作识别
IEEE transactions on neural networks and learning systems
|September 19, 2025
概括
行动区域跟踪 (ART) 框架通过跟踪微妙的当地细节随着时间的推移,有效地识别细粒度的行动. 这种新的方法改进了现有的方法,通过专注于特定区域的动态来更准确地对行动进行分类.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 细粒度动作识别 (FGAR) 在区分微妙的动作差异方面面临挑战.
- 现有的方法往往错过了关键的局部细节和时间动态.
研究的目的:
- 引入行动区域跟踪 (ART) 框架,以改善FGAR.
- 通过追踪当地细节,能够有效地区分类似的细粒度行动.
主要方法:
- 使用文本受约束查询提出特定区域的语义激活模块.
- 将区域响应组织成行动轨道,以捕捉时空动态.
- 实现多层次的tracklet对比约束和特定任务的微调,以实现语义优化.
主要成果:
- 在多个基准 (FineGym,Diving48,NTURGB-D,Kinetics,Something-Something) 上表现出高于最先进的基线的性能.
- ART框架有效地捕捉和跟踪FGAR至关重要的独特的当地细节.
结论:
- ART框架为细粒度动作识别提供了一种新且有效的解决方案.
- 通过文本受约束的语义来跟踪基于区域的动态,可以显著提高行动分类的准确性.
更多相关视频
05:57Long-term Video Tracking of Cohoused Aquatic Animals: A Case Study of the Daily Locomotor Activity of the Norway Lobster Nephrops norvegicus
Published on: April 8, 2019
7.2K
08:32Tracking Rats in Operant Conditioning Chambers Using a Versatile Homemade Video Camera and DeepLabCut
Published on: June 15, 2020
13.3K
相关概念视频
Fixed Action Patterns
17.5K
A fixed action pattern (FAP) is a specific, hard-wired sequence of behaviors that occurs in response to an external stimulus, called a sign stimulus. The behavior is “fixed” because it is essentially unchangeable—proceeding similarly across individuals of a species every time it occurs.
17.5K
Relative Motion Analysis using Rotating Axes
881
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
881
Absolute Motion Analysis- General Plane Motion
539
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
539
Association Areas of the Cortex
8.9K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
8.9K
Relative Motion Analysis using Rotating Axes-Problem Solving
704
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
704
Relative Motion Analysis - Acceleration
815
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
815
