自我GCN:图形卷积网络与自我注意力用于基于骨架的动作识别
概括
这项研究引入了 SelfGCN,一种新的图形卷积网络,通过捕捉短距离和长距离依赖来改善基于骨架的动作识别. SelfGCN在多个基准数据集上取得了最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 图形卷积网络 (GCNs) 在基于骨架的动作识别方面表现出色,但在远程依赖和固定骨架拓学上扎.
- 现有的GCN方法经常使用统一的骨架结构,限制特征学习能力.
研究的目的:
- 解决基于骨架的动作识别GCN的局限性.
- 提出一种新的架构,SelfGCN,能够捕捉到本地和全球的依赖性,并适应特定框架的空间特征.
主要方法:
- 介绍了带有自我注意的图形卷积网络 (SelfGCN).
- 开发了一种跨自我注意和图形卷积 (MFSG) 模块的混合功能,用于并行本地和全球关系建模.
- 整合了一个特定于时间的空间自我注意 (TSSA) 模块,以学习框架级空间关系.
主要成果:
- 自我GCN在NTU RGB+D,NTU RGB+D120和西北-UCLA基准数据集上实现了最先进的性能.
- 与现有方法相比,在基于骨架的动作识别中表现出更高的准确性.
- 实验结果证实了拟议的MFSG和TSSA模块的有效性.
结论:
- 在骨架数据中,SelfGCN有效地模拟了本地和全球依赖关系.
- 拟议的架构显著提高了基于骨架的动作识别的准确性.
- SelfGCN为理解复杂的人类行为提供了一个有前途的方法.
相关概念视频
01:24Generation of Action Potential in Skeletal Muscles
Every cell in the body maintains a membrane potential due to an uneven distribution of positive and negative charges across its plasma membrane. The membrane potential is measured in millivolts and quantifies the difference in charge across the membrane.
Like neurons, muscle cells are also regarded as excitable due to their capacity to change in response to stimuli, primarily due to voltage-gated ion channels embedded in their plasma membranes, which get activated by alterations in the cell's...
Like neurons, muscle cells are also regarded as excitable due to their capacity to change in response to stimuli, primarily due to voltage-gated ion channels embedded in their plasma membranes, which get activated by alterations in the cell's...
01:24Muscle Coordination and Action
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement.