动量对比教师为半监督的骨行动识别教师
概括
SkeleMoCLR通过使用伪标签和对比学习来增强半监督的骨动作识别,以从视觉文本模型中转移特征,优于现有方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 目前的半监督骨动作识别依赖于自我监督的训练,然后是监督的微调.
- 自主监督学习优先考虑数据表示,而不是直接标签分类.
- 现有方法面临的挑战是有限的大规模骨架数据.
研究的目的:
- 介绍SkeleMoCLR,一种基于伪标签的新型模型,用于半监督的骨动作识别.
- 在骨架数据稀缺的情况下,利用对比学习从大型视觉文本模型中转移歧视性特征.
- 通过将伪标签集成到内存队列中来提高动作识别准确度,以增强表示差异化.
主要方法:
- 使用MoCo v2作为基础,将其扩展为带有动量编码器的教师-学生网络.
- 采用对比学习来预训练骨架编码器,使用来自大型视觉文本模型的特征.
- 使用预训练的MoCo v2教师编码器来训练查询编码器生成高可靠性伪标签.
- 将伪标签纳入内存队列,在不同的伪标签类别中采样负样本.
- 联合优化分类损失 (标记和伪标记数据) 和对比损失 (未标记数据).
主要成果:
- 与基准数据集 (NTU-60,NTU-120,PKU-MMD,NW-UCLA) 上的现有方法相比,SkeleMoCLR表现出更高的性能.
- 提出的方法有效地将歧视性行动特征从大型视觉文本模型中转移.
- 伪标签在内存队列中的集成改善了表示差异化和模型准确性.
结论:
- 通过有效地结合伪标记和对比学习,SkeleMoCLR提供了一种强大的半监督骨动作识别方法.
- 该方法通过从大规模视觉文本模型转移知识来解决数据稀缺问题.
- SkeleMoCLR取得了最先进的结果,突出了伪标签半监督和自我监督学习的潜力.
相关概念视频
Muscle Coordination and Action
1.3K
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
1.3K
Relative Motion Analysis using Rotating Axes
441
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
441
Relative Motion Analysis using Rotating Axes-Problem Solving
382
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
382
Relative Motion Analysis - Acceleration
320
A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
320
Relative Motion Analysis using Rotating Axes - Acceleration
317
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
317
Absolute Motion Analysis- General Plane Motion
199
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
199


