多维精细化图形卷积网络,具有强大的脱损失,用于基于精细粒度骨的动作识别
IEEE transactions on neural networks and learning systems
|April 15, 2024
概括
这项研究引入了一种新的多维改进图形卷积网络 (MDR-GCN) 带有频道变量时空注意力 (CVSTA),以改进基于细粒度骨架的动作识别,在多个数据集上表现优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 基于骨的动作识别对于人机交互至关重要.
- 现有的图形卷积网络 (GCN) 由于类间数据相似性和杂的姿势数据,难以识别细粒度.
- 为了准确的细粒度动作分类,需要加强特征歧视.
研究的目的:
- 开发一种新的注意力机制和GCN架构,以改进基于细粒度骨的动作识别.
- 增强时空特征的区分能力,减少阶级内差异.
- 为了减轻杂的姿势数据对动作识别准确性的影响.
主要方法:
- 建议使用频道可变的时空注意力 (CVSTA) 块来改进特征.
- 引入了多维精制GCN (MDR-GCN),集成CVSTA,以在多个层面 (通道,关节,框架) 进行增强的特征歧视.
- 开发出强大的脱损失 (RDL),以放大注意力机制的效果并降低噪声敏感度.
主要成果:
- 建议使用RDL的MDR-GCN在细粒度数据集 (FineGym99, FSD-10) 上实现了最先进的性能.
- 该方法还在粗数据集 (NTU-RGB+D 120,NTU-RGB+D X-view) 上表现出卓越的性能.
- 这种方法有效地增强了特征歧视,并缩小了类内分布.
结论:
- 拟议的MDR-GCN与RDL相结合,在基于骨架的动作识别方面取得了重大进展,特别是在细粒度任务中.
- CVSTA机制和RDL有效地解决了数据相似性和噪声带来的挑战.
- 公开可用的代码有助于进一步的研究和应用在动作识别.
相关概念视频
Structural Classification of Joints
3.4K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.4K
Functional Classification of Joints
4.1K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
4.1K
Deconvolution
159
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
159
Muscle Coordination and Action
1.5K
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
1.5K
One-Degree-of-Freedom System
487
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
487
Classification of Bones
5.4K
The bones of the human skeletal system are of varied shapes, sizes, and functions. They can be classified based on their shape and function into four major classes: long bones, short bones, flat bones, and irregular bones. Some classifications include a fifth type, the sesamoid bones, as a separate class, whereas others categorize them under short bones.
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The...
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The...
5.4K


