Seq2seq运动连续性和四肢不变性受约束的时空编码器用于3D人类姿势估计
Fan Wei1, Guanghua Xu1,2,3,4, Qingqiang Wu1
1School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China.
iScience
|December 24, 2025
概括
这项研究引入了一种新的混合时空编码器,用于3D人体姿势估计. 该方法利用四肢不变性来显著提高2D姿势的关键点精度.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人与计算机的交互
背景情况:
- 深度神经网络被广泛用于2D图像的3D人体姿势估计.
- 现有的方法往往忽略了四肢和关节运动之间的关键相关性.
- 这种限制会影响关键点预测的准确性.
研究的目的:
- 开发一个先进的深度学习模型,用于准确的3D人类姿势估计.
- 使用一种新的不变性约束,将四肢-关节相关性纳入.
- 在人类运动分析中提高关键点定位的精度.
主要方法:
- 提出了一种肢体不变性受约束的混合时空编码器.
- 从连续视频中提取了时空和运动特征.
- 利用四肢不变性来完善关键点估计.
主要成果:
- 在标准的3D人体姿势估计数据集上实现了最先进的性能.
- 在关键点估计准确度方面取得了显著的改进.
- 验证了四肢不变约束的有效性.
结论:
- 拟议的方法为3D人体姿势估计提供了一个强大的方法.
- 肢体不变性约束是提高准确性的关键因素.
- 潜在的应用包括人机交互和医疗康复.
更多相关视频
06:32Author Spotlight: Automated Deep Brain Stimulation for Parkinson's Disease - Exploring the Possibilities and Challenges of Home Monitoring
Published on: July 14, 2023
1.8K
08:24Sit-to-stand-and-walk from 120% Knee Height: A Novel Approach to Assess Dynamic Postural Control Independent of Lead-limb
Published on: August 30, 2016
10.6K
相关概念视频
Kinematic Equations - III
10.2K
The first two kinematic equations have time as a variable, but the third kinematic equation is independent of time. This equation expresses final velocity as a function of the acceleration and distance over which it acts. The fourth kinematic equation does not have an acceleration term and provides the final position of the object at time t in terms of the initial and final velocities. This equation is useful when the value of the constant acceleration is unknown.
Using the kinematic equations,...
Using the kinematic equations,...
10.2K
Kinematic Equations - II
12.8K
The second kinematic equation expresses the final position of an object in terms of its initial position, the distance traveled with the initial constant velocity, and the distance traveled due to a change in velocity. Similar to the first kinematic equation, this equation is also only valid when the acceleration is constant throughout the motion of an object.
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
12.8K
Absolute Motion Analysis- General Plane Motion
503
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
503
Relative Motion Analysis using Rotating Axes
854
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
854
Kinematic Equations for Rotation
719
In mechanics, when one observes a rigid body in rotational motion with constant angular acceleration, it is possible to establish equations for its rotational kinematics. This process resembles how linear kinematics are dealt with in simpler motion studies.
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
719
Kinematic Equations - I
14.1K
When an object moves with constant acceleration, the velocity of the object changes at a constant rate throughout the motion. The kinematic equations of motions are derived for such cases where the acceleration of the object is constant. The first kinematic equation gives an insight into the relationship between velocity, acceleration, and time. We can see, for example:
14.1K
