斯凯尔Former:一个基于转换器的自适应层次的方法,用于视频序列中的人类动作识别的骨架图
Jiexing Yan1, Xi Zhang2, Caiyan Tan3
1College of Military and Political Basic Education, National University of Defense Technology, Changsha, China.
PloS one
|January 12, 2026
概括
SkelFormer通过捕捉时空变化来增强基于人类骨的动作识别. 这种新的框架有效地提取了层次表示,提高了对复杂动作的理解.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 基于人类骨的动作识别对于理解物理动态至关重要.
- 现有的方法与等级结构,先验知识要求和时间动态表示作斗争.
- 挑战包括编码基于骨架的图形和解释时空变化.
研究的目的:
- 提出SkelFormer,一个基于骨架的动作识别的新框架.
- 解决目前捕捉时空变化的方法的局限性.
- 为了使得在没有手工制作的规则的情况下可以提取层次表示.
主要方法:
- 开发了SkelFormer,这是一个利用SKT块进行信息交换的框架.
- 在结构和时间维度中使用节点度和扩散.
- 从视频序列中的基于骨架的图表中提取了时空变化.
主要成果:
- 与最先进的基准标准相比,SkelFormer取得了更高的表现.
- 在NTU RGB+D 60数据集上实现了92.8%的准确性.
- 在NTU RGB+D 120上达到89.4%,在NW-UCLA数据集上达到96.1%.
结论:
- SkelFormer有效地捕捉了时空变化,以改进动作识别.
- 该框架有助于学习层次表征.
- 在多个基准数据集上展示了最先进的结果.
相关概念视频
Relative Motion Analysis using Rotating Axes-Problem Solving
693
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
693
Relative Motion Analysis using Rotating Axes
872
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
872


