SDFPoseGraphNet:空间深度特征姿势图谱网络用于2D手姿势估计
Sartaj Ahmed Salman1, Ali Zakir1, Hiroki Takahashi1,2
1Department of Informatics, Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo 182-8585, Japan.
Sensors (Basel, Switzerland)
|November 25, 2023
概括
SDFPoseGraphNet使用VGG-19和空间注意力增强了手姿势估计 (HPE). 这种新的框架提高了计算机视觉任务的准确性,例如人机交互和虚拟现实.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 手姿势估计 (HPE) 对人机交互 (HCI) 和虚拟现实 (VR) 至关重要.
- 现有的2D HPE方法面临着手动力学和遮的挑战.
- 精确的特征提取对于提高HPE性能至关重要.
研究的目的:
- 为了引入SDFPoseGraphNet,一个用于精确手姿势估计的新框架.
- 用VGG-19和空间注意力来增强从手图像中提取深度特征.
- 通过使用Pose Graph Model (PGM) 适应性处理特征地图来提高姿势估计的准确性.
主要方法:
- 利用VGG-19架构与空间注意力 (SA) 结合,用于精细的特征地图提取.
- 集成了一个姿势图模型 (PGM) 与第一推理模块 (FIM) 潜力和姿势估计的适应参数.
- 开发了一个端到端可训练网络,优化所有组件以提高精度.
主要成果:
- 与最先进的方法相比,SDFPoseGraphNet表现出更高的性能.
- 与卷积姿势机 (CPM) 相比,平均精度提高了7.49%.
- 与自适应图形模型网络 (AGMN) 相比,显示了3.84%的平均精度.
结论:
- SDFPoseGraphNet在手姿势估计准确度方面取得了重大进展.
- 该框架有效地解决了手动力学和遮所带来的挑战.
- 拟议的模型为需要精确HPE的计算机视觉应用提供了强大而精确的解决方案.
相关概念视频
Structural Classification of Joints
3.5K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.5K
Functional Classification of Joints
4.1K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
4.1K
Absolute Motion Analysis- General Plane Motion
224
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
224
Relative Motion Analysis using Rotating Axes
469
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
469


