双分支差分通道超图卷积网络用于基于人类骨的动作识别
Dong Chen1,2, Kaichen She1,2, Peisong Wu1,2
1College of Physics and Electronic Engineering, Nanning Normal University, Nanning, China.
PloS one
|October 27, 2025
概括
本研究介绍了一种双分支差分通道超图卷积网络 (DBC-HCN) 用于骨架动作识别. 这种新型网络有效地模拟了非相邻连接之间的复杂,高阶依赖关系,在基准数据集上实现了卓越的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 图形卷积网络 (GCNs) 由于对联节点的限制,在骨架动作识别中与高阶依赖性作斗争.
- 现有的超图法缺乏适应性,依赖于静态结构或未能利用通道特征相互作用.
研究的目的:
- 提出一个双分支差分通道超图卷积网络 (DBC-HCN),以增强骨架动作识别.
- 为了有效地建模骨结构中非相邻关节之间的复杂,高阶依赖关系.
- 为了提高适应性和特征交互利用在基于超图的动作识别.
主要方法:
- 开发了一种集成静态和动态超图的双分支超图卷积网络 (DBC-HCN).
- 实现了两个并行流:空间时间动态超图卷积网络 (ST-HCN) 和频道差异超图卷积网络 (CD-HCN).
- 融合了双流,通过跨流特征学习来增强表达能力.
主要成果:
- 在Kinetics-Skeleton 400,NTU RGB+D 60和NTU RGB+D 120数据集上取得了竞争性结果.
- 在NTU RGB+D 60 (X-View) 上达到96.9%的准确性,在NTU RGB+D 60 (X-Sub) 上达到92.7%.
- 在捕捉时空特征和动作细节方面表现出卓越的性能.
结论:
- 拟议的DBC-HCN有效地模拟了用于骨架动作识别的复杂依赖关系.
- 双分支架构和超图集成比现有方法提供了显著的改进.
- 该网络显示了对现实世界应用的巨大潜力,需要准确理解人类行动.
相关概念视频
Classification of Bones
9.5K
The bones of the human skeletal system are of varied shapes, sizes, and functions. They can be classified based on their shape and function into four major classes: long bones, short bones, flat bones, and irregular bones. Some classifications include a fifth type, the sesamoid bones, as a separate class, whereas others categorize them under short bones.
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The...
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The...
9.5K
Structural Classification of Joints
6.9K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
6.9K
Skeletal Muscle Anatomy
92.6K
Skeletal muscle is the most abundant type of muscle in the body. Tendons are the connective tissue that attaches skeletal muscle to bones. Skeletal muscles pull on tendons, which in turn pull on bones to carry out voluntary movements.
92.6K
Muscle Coordination and Action
3.0K
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
3.0K
Classification of Skeletal Muscle Fibers
59.4K
Skeletal muscles continuously produce ATP to provide the energy that enables muscle contractions. Skeletal muscle fibers can be categorized into three types based on differences in their contraction speed and how they produce ATP, as well as physical differences related to these factors. Most human muscles contain all three muscle fiber types, albeit in varying proportions.
Slow-Twitch Muscle Fibers
Slow oxidative, muscle fibers appear red due to large numbers of capillaries and high levels of...
Slow-Twitch Muscle Fibers
Slow oxidative, muscle fibers appear red due to large numbers of capillaries and high levels of...
59.4K
Carbon Skeletons
113.9K
Life on Earth is carbon-based, as all macromolecules that make up living organisms contain carbon atoms. All organic compounds have a carbon backbone. Each carbon atom is tetravalent and can bond with four other atoms, making it an extraordinarily flexible component of biological molecules. Because carbon’s valence electrons are stable, it rarely becomes an ion. As the carbon chain increases in length, structural modifications such as ring structures, double bonds, and branching side...
113.9K
