潜在空间改进了面具重建模型,用于基于人类骨的动作识别.
Enqing Chen1, Xueting Wang1, Xin Guo1
1School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou, China.
Frontiers in neurorobotics
|March 28, 2025
概括
这项研究通过改进编码器特征学习来增强基于人类骨的动作识别. 新的模型,SkeletonMVAE和SkeletonMVQVAE,利用变量自编码器隐藏空间进行更好的分类和概括,特别是在有限的数据下.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 基于人类骨的动作识别在计算机视觉中至关重要.
- 蒙面自动编码器 (MAE) 在数据重建方面表现出色,但在特征提取方面却很难进行分类.
- 现有的自动编码器结构限制了编码器在视觉分类任务中的性能.
研究的目的:
- 在动作识别任务中增强编码器的特征提取能力.
- 通过使用先进的自动编码技术来提高分类性能和概括能力.
- 解决标准自动编码器在学习基于骨架的动作识别的区分特征方面的局限性.
主要方法:
- 拟议的SkeletonMVAE模型,利用变量自编码器 (VAE) 隐藏空间来限制特征作为分布.
- 开发了SkeletonMVQVAE模型,利用矢量量量化变量自编码器 (VQVAE) 隐藏空间进行离散特征表示.
- 集成的 VAE 和 VQVAE 隐藏空间,以增强编码器学习更深层次数据结构的能力.
主要成果:
- 无论是SkeletonMVAE还是SkeletonMVQVAE,都显著提高了NTU-60和NTU-120数据集上的编码器分类准确度.
- 骨MVAE显示了更强的分类能力.
- 骨架MVQVAE显示出优越的概括能力,特别是在低数据的制度.
结论:
- 提出的基于VAE和VQVAE的方法有效地增强了基于骨架的动作识别的特征表示.
- 这些方法提高了分类准确性和概括性,为计算机视觉任务提供了强大的解决方案.
- 骨架MVAE和骨架MVQVAE为动作识别提供了有价值的替代方案,特别是在处理有限的标记数据时.
相关概念视频
Bone Structure
Within the skeletal system, the structure of a bone, or osseous tissue, can be exemplified in a long bone, like the femur, where there are two types of osseous tissue: cortical and cancellous.
Bone Remodeling
Bone remodeling is a continuous and balanced process of bone resorption by osteoclasts and bone formation by osteoblasts. In adults, it helps maintain bone mass and calcium homeostasis. While mechanical stress can stimulate turnover as part of the normal maintenance and reparative process, several hormones also regulate bone remodeling.
Classification of Bones
The bones of the human skeletal system are of varied shapes, sizes, and functions. They can be classified based on their shape and function into four major classes: long bones, short bones, flat bones, and irregular bones. Some classifications include a fifth type, the sesamoid bones, as a separate class, whereas others categorize them under short bones.
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The long...
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The long...
Bone Remodeling and Repair
Osteoclasts are cells responsible for bone resorption and remodeling. They originate from hematopoietic progenitor cells present in the bone marrow. Numerous progenitor cells fuse to form multinucleated cells, each with 10-20 nuclei. A single osteoclast has a diameter of 150 to 200 µM. These cells have ruffled borders that break down the underlying bone tissue and release minerals such as calcium into the blood in bone resorption. Osteoclasts cling to bones with their ruffled edges during bone...


