增强的时空骨架建模:集成部分联合注意力与动态图形卷积.
Yanghong Qin1, Shengrui Liu2, Chunhong Yuan3
1School of Artificial Intelligence, Chongqing Three Gorges Vocational College, Chongqing, China. 2019220572@cqsxzy.edu.cn.
Scientific reports
|October 6, 2025
概括
这项研究引入了一个新的时空骨建模框架,使用部分联合注意力和动态图卷积网络来准确预测人类运动和动作识别.
科学领域:
- 计算机视觉 计算机视觉
- 人与计算机的交互
- 机器人技术 机器人技术 机器人技术
- 行为分析 行为分析
背景情况:
- 人类运动预测和动作识别对于各种应用至关重要.
- 在捕捉骨运动中的细粒度语义和时空依赖性方面存在挑战.
- 现有的方法在时间的推移中与复杂的关节和部分级相互作用作斗争.
研究的目的:
- 提出一个新的时空骨建模框架.
- 为了增强细粒度语义和动态时空依赖的捕获.
- 为了提高人类运动预测和动作识别准确度.
主要方法:
- 开发了一个整合部分联合注意力 (PJA) 和动态图卷积网络 (动态GCN) 的框架.
- 采用多颗粒度序列编码模块用于联合级和部分级特征提取.
- 利用PJA进行关键关节/关节部位的自适应突出显示,并使用动态GCN来演变关节间关系.
主要成果:
- 在Human3.6M数据集上,在80ms时达到10.2mm,在400ms时达到57.5mm的平均每关节位置误差 (MPJPE).
- 在各种行动中表现比强的基线优于9-12%的相对改善.
- 证明精确捕捉微妙和大规模的人类运动,具有时间稳定性.
结论:
- 拟议的框架准确地模拟了人类骨运动,推进了运动预测和动作识别.
- 该方法提供可解释和精确的基于骨架的运动建模.
- 实时人机交互,智能监控和行为识别的潜在好处.
相关概念视频
Structural Classification of Joints
7.0K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
7.0K
Bone Remodeling
40.2K
Bone remodeling is a continuous and balanced process of bone resorption by osteoclasts and bone formation by osteoblasts. In adults, it helps maintain bone mass and calcium homeostasis. While mechanical stress can stimulate turnover as part of the normal maintenance and reparative process, several hormones also regulate bone remodeling.
40.2K
Carbon Skeletons
113.9K
Life on Earth is carbon-based, as all macromolecules that make up living organisms contain carbon atoms. All organic compounds have a carbon backbone. Each carbon atom is tetravalent and can bond with four other atoms, making it an extraordinarily flexible component of biological molecules. Because carbon’s valence electrons are stable, it rarely becomes an ion. As the carbon chain increases in length, structural modifications such as ring structures, double bonds, and branching side...
113.9K
Bone Structure
51.5K
Within the skeletal system, the structure of a bone, or osseous tissue, can be exemplified in a long bone, like the femur, where there are two types of osseous tissue: cortical and cancellous.
51.5K
Functional Classification of Joints
6.5K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
6.5K
Virtual Work for a System of Connected Rigid Bodies
725
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
725
