MPCTrans:通过旋转变压器进行3D手姿势估计的多视角线索意识联合关系表示
Xiangan Wan1, Jianping Ju1, Jianying Tang1
1School of Computer Science and Technology, Hubei Business College, Wuhan 430079, China.
Sensors (Basel, Switzerland)
|November 9, 2024
概括
本研究介绍了MPCTrans,这是一种使用深度图像进行3D手姿势估计 (HPE) 的新方法. MPCTrans有效地处理视角变化和遮蔽,在基准数据集上获得最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 机器人技术 机器人技术 机器人技术
背景情况:
- 从深度图像进行3D手姿势估计 (HPE) 非常重要,但由于视角变化和遮,具有挑战性.
- 现有的方法很难有效地捕获全面的手部外观信息.
研究的目的:
- 为准确的3DHPE开发一种新的方法,克服当前方法的局限性.
- 通过使用Swin变压器 (MPCTrans) 引入多视角提示意识的联合关系表示.
主要方法:
- 提出了三个新的模块:自适应性虚拟多视角 (AVM),层次特征估计 (HFE) 和虚拟视角评估 (VVE).
- AVM通过自适应地调整视角来生成信息化的虚拟视图.
- HFE通过层次特征提取来估计关键点,VVE通过虚拟视角来评估.
- 利用Swin变压器骨干来进行长距离的语义关节关系提取.
主要成果:
- 在四个具有挑战性的基准数据集上,MPCTrans展示了最先进的性能.
- 该模型有效地从手深度图像中学习多视角线索和基本信息.
- 在定位和预测手关键点方面取得了卓越的准确性.
结论:
- MPCTrans提供了一个强大的解决方案,用于从深度图像进行3D手姿势估计.
- 拟议的多视角策略和Swin变压器集成显著提高了准确性,并处理复杂的场景.
- 这项工作推进了3D HPE领域,采用了一种新且有效的表示学习方法.
相关概念视频
Relative Motion Analysis using Rotating Axes
448
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
448
Relative Motion Analysis using Rotating Axes-Problem Solving
389
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
389
Structural Classification of Joints
3.2K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.2K
Three-Dimensional Force System:Problem Solving
630
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
630
Functional Classification of Joints
3.8K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
3.8K
Kinematic Equations for Rotation
316
In mechanics, when one observes a rigid body in rotational motion with constant angular acceleration, it is possible to establish equations for its rotational kinematics. This process resembles how linear kinematics are dealt with in simpler motion studies.
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
316


