一次性动作识别通过多尺度的时空骨匹配
IEEE transactions on pattern analysis and machine intelligence
|February 8, 2024
概括
这项研究引入了一种新方法,用于使用多尺度的时空特征匹配进行一次性骨动作识别. 这种方法通过考虑空间结构和时间顺序来提高准确性,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 收集和注释大规模的骨架行动数据是具有挑战性的,限制了传统的行动识别模型.
- 现有的一次性骨动作识别方法往往忽略了骨数据固有的空间和时间动态,因为它们依赖于直接的特征向量比较.
研究的目的:
- 开发一种新的技术,用于一次性骨动作识别,有效地利用多尺度的时空特征.
- 通过结合空间结构和时间顺序来解决现有方法的局限性,以实现更强大的动作识别.
主要方法:
- 在多个空间和时间尺度上表示骨架数据.
- 实现多尺度匹配,同时捕捉尺度智能的语义相关性.
- 采用跨尺度匹配,通过分析跨尺度相关性来处理运动大小和速度的变化.
主要成果:
- 拟议的方法在一次性骨动作识别中表现出卓越的性能.
- 与最先进的 (SOTA) 方法相比,观察到一致且显著的性能改善.
- 在三个大型数据集上验证了实验:NTU RGB+D,NTU RGB+D 120和PKU-MMD.
结论:
- 多尺度的时空特征匹配方法对于一次性骨架动作识别非常有效.
- 这种技术为训练数据有限的场景提供了强大的解决方案.
- 该方法通过提供更全面的骨架数据分析,显著地推动了该领域的发展.
相关概念视频
Bone Remodeling
34.4K
Bone remodeling is a continuous and balanced process of bone resorption by osteoclasts and bone formation by osteoblasts. In adults, it helps maintain bone mass and calcium homeostasis. While mechanical stress can stimulate turnover as part of the normal maintenance and reparative process, several hormones also regulate bone remodeling.
34.4K
Classification of Bones
14.3K
The bones of the human skeletal system are of varied shapes, sizes, and functions. They can be classified based on their shape and function into four major classes: long bones, short bones, flat bones, and irregular bones. Some classifications include a fifth type, the sesamoid bones, as a separate class, whereas others categorize them under short bones.
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The...
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The...
14.3K
Structural Classification of Joints
8.0K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
8.0K


