使用生成对抗网络进行骨重建,以识别人类活动在阻塞下.
Ioannis Vernikos1, Evaggelos Spyrou1
1Department of Informatics and Telecommunications, University of Thessaly, 35100 Lamia, Greece.
Sensors (Basel, Switzerland)
|March 17, 2025
概括
本研究引入了一种新的生成对抗网络 (GAN) 方法,用于使用3D骨架数据识别人类活动,有效地重建隐蔽的身体部位,以提高现实世界的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 人类活动识别 人类活动识别
- 机器学习 机器学习
背景情况:
- 从运动数据中识别人类活动至关重要,但受到现实世界因素的挑战,例如基于摄像头的系统中的遮蔽.
- 身体部位的部分或完全封闭显著降低了人类活动识别的准确性.
- 现有的方法在与封闭数据作斗争,限制在不受约束的环境中的实际应用.
研究的目的:
- 开发一种新的方法,在部分身体遮蔽 (最多两个身体部位) 下进行可靠的人类活动识别.
- 利用生成对抗网络 (GAN) 来重建缺失的骨架数据,这是由于阻塞引起的.
- 为了提高识别准确度,当特定的身体部位在活动期间始终被遮住时.
主要方法:
- 使用3D骨关节建模人类运动.
- 使用生成对抗网络 (GAN) 框架.
- 使用卷积循环神经网络 (CRNN) 作为生成器来重建封闭的骨架部分.
- 使用长短期记忆 (LSTM) 网络作为区分器.
主要成果:
- 提出的基于GAN的方法有效地重建了封闭的3D骨架关节.
- 重建可以显著缓解因闭塞引起的性能下降,有时可以实现近乎完美的识别.
- 该方法在之前的工作中表现出优越的性能,在不同的数据集和遮场景中,精度的改进范围从2.2%到37.5%.
结论:
- 生成对抗网络为处理3D人类活动识别中的部分阻塞提供了强大的解决方案.
- 拟议的CRNN生成器和LSTM歧视器有效地重建缺失的骨架数据,提高识别稳定性.
- 这种方法显著提升了在具有挑战性的现实条件下与身体部位被遮的活动识别的最先进技术.
相关概念视频
Carbon Skeletons
Life on Earth is carbon-based, as all macromolecules that make up living organisms contain carbon atoms. All organic compounds have a carbon backbone. Each carbon atom is tetravalent and can bond with four other atoms, making it an extraordinarily flexible component of biological molecules. Because carbon’s valence electrons are stable, it rarely becomes an ion. As the carbon chain increases in length, structural modifications such as ring structures, double bonds, and branching side chains...
Bone Remodeling
Bone remodeling is a continuous and balanced process of bone resorption by osteoclasts and bone formation by osteoblasts. In adults, it helps maintain bone mass and calcium homeostasis. While mechanical stress can stimulate turnover as part of the normal maintenance and reparative process, several hormones also regulate bone remodeling.
Classification of Bones
The bones of the human skeletal system are of varied shapes, sizes, and functions. They can be classified based on their shape and function into four major classes: long bones, short bones, flat bones, and irregular bones. Some classifications include a fifth type, the sesamoid bones, as a separate class, whereas others categorize them under short bones.
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The long...
Long and Short Bones
The appendicular skeleton, particularly the upper and lower limbs, is primarily made of long and short bones. The long...
Bone Remodeling and Repair
Osteoclasts are cells responsible for bone resorption and remodeling. They originate from hematopoietic progenitor cells present in the bone marrow. Numerous progenitor cells fuse to form multinucleated cells, each with 10-20 nuclei. A single osteoclast has a diameter of 150 to 200 µM. These cells have ruffled borders that break down the underlying bone tissue and release minerals such as calcium into the blood in bone resorption. Osteoclasts cling to bones with their ruffled edges during bone...
Structural Classification of Joints
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
Masking and Demasking Agents
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on the metal...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on the metal...


