基于骨架的人类行为理解的基础模型
IEEE transactions on pattern analysis and machine intelligence
|August 20, 2025
概括
这项研究介绍了基于统一骨架的密集表示学习 (USDRL) 框架,这是理解人类行动的基础模型. USDRL显著提高了跨多种任务的可扩展性和通用性,优于现有的方法.
科学领域:
- 计算机视觉
- 人工智能
- 人与计算机的交互
背景情况:
- 人类行为理解对于智能运动感知至关重要.
- 骨架数据为机器人和互动中的人类建模提供了多功能表示.
- 目前的方法缺乏可扩展性和通用性,
研究的目的:
- 引入一个基于骨架的人类行为理解的基础模型.
- 开发一个在各种行动识别任务中增强可扩展性和通用性的框架.
- 解决现有方法在处理各种复杂的人类行为方面的局限性.
主要方法:
- 开发了一个基于骨架的统一代表性学习 (USDRL) 框架.
- 采用基于变压器的密集时空编码器 (DSTE),用于时间和空间特征的并行流.
- 使用多粒度特征脱相关性 (MG-FD) 和多视角一致性训练 (MPCT) 来增强特征提取和学习.
主要成果:
- 在9个基于骨架的行动理解任务中实现了25个基准的最新表现.
- 在粗略,密集和转移的预测任务中表现出显著的改善.
- 这一框架具有卓越的可扩展性和通用性.
结论:
- 这一框架为基于骨架的行动理解奠定了新的基础.
- 提出的方法显著提升了人类行为识别的最新技术.
- 这项工作鼓励进一步的研究,特别是在基于骨架的行动理解的密集预测任务中.
相关概念视频
Muscle Coordination and Action
2.0K
Muscle coordination is a complex and finely tuned process essential for smooth and purposeful movements like flexion, extension, adduction, abduction, and rotation. The human body orchestrates the actions of various muscles working in concert, each with a specific role. Four functional types describe how muscles work together: agonist, antagonist, synergist, and fixator.
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
Agonists
Agonist muscles, often called prime movers, are the primary muscles responsible for producing a specific movement....
2.0K
Carbon Skeletons
110.2K
Life on Earth is carbon-based, as all macromolecules that make up living organisms contain carbon atoms. All organic compounds have a carbon backbone. Each carbon atom is tetravalent and can bond with four other atoms, making it an extraordinarily flexible component of biological molecules. Because carbon’s valence electrons are stable, it rarely becomes an ion. As the carbon chain increases in length, structural modifications such as ring structures, double bonds, and branching side...
110.2K
Introduction to the Skeletal System
6.8K
The skeletal system is the central framework of the body, consisting of different connective tissues: bones, cartilage, tendons, and ligaments.
Components of the Skeletal System
Bone, or osseous tissue, is a hard connective tissue that forms an internal support structure for the human body. Bones shield vulnerable organs and soft tissue from external forces. For example, the vertebral bones protect and support the spinal cord.
Cartilage, a semi-rigid connective tissue found in regions such as...
Components of the Skeletal System
Bone, or osseous tissue, is a hard connective tissue that forms an internal support structure for the human body. Bones shield vulnerable organs and soft tissue from external forces. For example, the vertebral bones protect and support the spinal cord.
Cartilage, a semi-rigid connective tissue found in regions such as...
6.8K
Bone Structure
49.0K
Within the skeletal system, the structure of a bone, or osseous tissue, can be exemplified in a long bone, like the femur, where there are two types of osseous tissue: cortical and cancellous.
49.0K
Anatomical Movements
11.5K
Anatomical movements refer to the various actions or motions that can be performed by the body's joints and muscles. These movements are described using specific terms to provide a standardized way of discussing and understanding the range of motion at different joints.
Here are some common anatomical movements:
Flexion and extension motions are in the sagittal (anterior–posterior) plane of motion. These movements take place at the shoulder, hip, elbow, knee, wrist,...
Here are some common anatomical movements:
Flexion and extension motions are in the sagittal (anterior–posterior) plane of motion. These movements take place at the shoulder, hip, elbow, knee, wrist,...
11.5K
Overview of Skeletal Muscle
12.4K
Skeletal muscles are composed of a bundle of muscle fibers and are attached to bones through tendons. Each skeletal muscle fiber is a single muscle cell. The sarcolemma, the plasma membrane of a skeletal muscle cell, consists of a lipid bilayer and glycocalyx that supports muscle fibers. The sarcolemma extends into the muscle cells to form tubular structures called transverse or T-tubules. Each side of the T-tubules consists of a membrane-bound structure called the sarcoplasmic reticulum,...
12.4K


