通过3D局部回归器进行3D手姿势估计
IEEE transactions on pattern analysis and machine intelligence
|September 16, 2025
概括
这项研究介绍了A2J-Transformer+,这是一种用于从单个图像中估计3D手姿势的新方法. 它通过整合当地细节与全球背景来提高准确性,优于现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 机器人技术 机器人技术 机器人技术
背景情况:
- 单眼3D手姿势估计对于人机交互和增强现实至关重要.
- 现有的方法往往与遮,深度模糊性和各种手势作斗争.
- 从单个RGB或深度图像中准确估计3D手姿势仍然是一个重大挑战.
研究的目的:
- 开发一种有效的方法,用于单眼3D手姿势估计,使用关节到关节局部回归器.
- 通过共同考虑局部细节和全球接的背景,提高3D手动姿势估计的准确性和稳定性.
- 提出一个新的A2J-Transformer+框架,能够处理各种手动场景和模式.
主要方法:
- A2J-变压器+采用了两阶段的方法,用于在3D空间中适应性点设置.
- 当地回归者 (点) 意识到精细的手指细节和全局接的上下文.
- 线性加权聚合用于预测手部关节的3D偏移,改善局部化.
主要成果:
- 在多个RGB和深度手数据集 (InterHand2.6 M,HO-3D V2,RHP,NYU,ICVL,HANDS 2017) 上,A2J-Transformer+表现出卓越的性能.
- 该方法在不同的模式 (RGB,深度) 和手的配置 (单个,交互,手对象) 中显示出强烈的概括性.
- 实验表明,A2J-Transformer+也可以应用于3D人体姿势估计,如 ITOP 数据集所示.
结论:
- A2J-变压器+有效地解决了单眼3D手姿势估计挑战.
- 提出的方法实现了最先进的结果,超过了以前的方法,包括基于模型的方法.
- 该框架的适应性使其可用于更广泛的3D人类姿势估计任务.
相关概念视频
Structural Classification of Joints
7.0K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
7.0K
Functional Classification of Joints
6.6K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
6.6K
Relative Motion Analysis using Rotating Axes
881
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
881
Kinematic Equations - III
10.3K
The first two kinematic equations have time as a variable, but the third kinematic equation is independent of time. This equation expresses final velocity as a function of the acceleration and distance over which it acts. The fourth kinematic equation does not have an acceleration term and provides the final position of the object at time t in terms of the initial and final velocities. This equation is useful when the value of the constant acceleration is unknown.
Using the kinematic equations,...
Using the kinematic equations,...
10.3K
Relative Motion Analysis using Rotating Axes-Problem Solving
704
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
704
Rigid Body Equilibrium Problems - II
7.9K
A rigid body is in static equilibrium when the net force and the net torque acting on the system are equal to zero.
Consider two children sitting on a seesaw, which has negligible mass. The first child has a mass (m1) of 26 kg and sits at point A, which is 1.6 meters (r1) from the pivot point B; the second child has a mass (m2) of 32 kg and sits at point C. How far from the pivot point B should the second child sit (r2) to balance the seesaw?
Consider two children sitting on a seesaw, which has negligible mass. The first child has a mass (m1) of 26 kg and sits at point A, which is 1.6 meters (r1) from the pivot point B; the second child has a mass (m2) of 32 kg and sits at point C. How far from the pivot point B should the second child sit (r2) to balance the seesaw?
7.9K


