InterAcT:一种基于关键点的通用轻型变压器模型,用于识别空中视频中人类单人行动和互动
Mubashir Shah1, Tahir Nawaz1,2, Rab Nawaz3
1Department of Mechatronics Engineering, College of Electrical and Mechanical Engineering, National University of Sciences and Technology, Islamabad, Pakistan.
PloS one
|May 14, 2025
概括
一个新的轻量级的变压器网络InterAcT,有效地识别了空中视频中的人类单人行动和互动,使用关键点. 它实现了高精度,超越了监控应用的现有最先进方法.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 人类行动识别对于空中安全和监视至关重要.
- 现有的方法往往难以识别单独的动作和相互作用,限制了它们的适用性.
- 需要计算高效和轻量级的模型来实现现实世界的部署.
研究的目的:
- 介绍InterAcT,一个通用,轻量级和计算效率高的变压器网络,用于在空中视频中识别人类动作.
- 为了能够识别单独的人类行为和两个人的互动.
- 开发一个适用于现实世界监控应用的模型.
主要方法:
- 利用YOLO v8从空中视频中提取身体关键点.
- 开发了一种轻量级的变压器网络架构 (InterAcT),具有最小的参数 (0.0709M) 和FLOP (0.0389G).
- 在两个公共空中数据集 (无人机行动和UT-交互) 上训练和评估模型,包括18个行动类.
主要成果:
- 在测试组中,InterAcT实现了0.9923的高精度.
- 该模型的性能超过了一些最先进的方法,包括AcT模型,2P-GCN,LSTM,3D-ResNet和3D CNN.
- 在识别空中和地面镜头中广泛的单人行动和两人互动的证明有效性.
结论:
- InterAcT提供了一个计算效率高,轻量级的解决方案,用于监控中识别人类行动.
- 该模型识别多样化的动作和相互作用的能力使其对各种应用非常通用.
- 在现实场景中部署有效的行动识别模型方面,InterAcT代表了重大进步.
相关概念视频
Relative Motion Analysis using Rotating Axes
436
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
436
Absolute Motion Analysis- General Plane Motion
197
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
197
Relative Motion Analysis using Rotating Axes-Problem Solving
378
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
378
Relative Motion Analysis - Acceleration
316
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
316
Relative Motion Analysis - Velocity
332
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
332
Relative Motion Analysis using Rotating Axes - Acceleration
313
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
313


