DSPose:用于人类姿势估计的双空间驱动关键点拓建模
Anran Zhao1, Jingli Li2,3, Hongtao Zeng2,3
1School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China.
Sensors (Basel, Switzerland)
|September 9, 2023
概括
这项研究引入了一种新的双空间驱动拓模型,以改善人类姿势估计. 通过整合物理空间关键点的相关性,它克服了特征级方法的局限性,以获得更准确的结果.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 人类姿势估计对于诸如行为分析和人机交互等应用至关重要.
- 由于过度依赖图像特征相似性,当前的方法在阻塞,关键点幽灵化和干扰方面扎.
研究的目的:
- 开发一个强大的人类姿势估计模型,解决现有的特征级别方法的局限性.
- 通过结合物理空间关键点关系来提高准确性.
主要方法:
- 利用基于变压器的网络进行准确的关键点特征提取.
- 引入了物理空间关键点的相关性,以减轻特征级别表示错误.
- 采用图形卷积神经网络来融合空间和特征相关性.
主要成果:
- 拟议的双空间驱动拓模型在人类姿势估计中表现出更高的准确性.
- 在真实数据集上的实验验证证证了该模型的有效性.
结论:
- 这种新型模型成功地集成了特征级和物理空间信息,以优越地估计人类的姿势.
- 这种方法为诸如闭塞和关键点模糊性等挑战提供了更强大的解决方案.
相关概念视频
Centroid of a Body: Problem Solving
1.2K
The centroid of a body is a crucial concept in engineering and physics. Finding the centroid of a body can help determine its stability, its balance point, and even its design. In this context, consider a thin wire bent in the form of a quarter circular arc. Polar coordinates are used to calculate the centroid. The wire is first divided into small differential elements of a length equal to the radius multiplied by the differential angle.
The x-coordinates and y-coordinates of each element's...
The x-coordinates and y-coordinates of each element's...
1.2K
Kinematic Equations for Rotation
346
In mechanics, when one observes a rigid body in rotational motion with constant angular acceleration, it is possible to establish equations for its rotational kinematics. This process resembles how linear kinematics are dealt with in simpler motion studies.
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
346
Modeling and Similitude
288
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
288
Kinematic Equations - II
9.6K
The second kinematic equation expresses the final position of an object in terms of its initial position, the distance traveled with the initial constant velocity, and the distance traveled due to a change in velocity. Similar to the first kinematic equation, this equation is also only valid when the acceleration is constant throughout the motion of an object.
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
Suppose a car merges into freeway traffic on a 200 m long ramp. If its initial velocity is 10 m/s and it accelerates at 2 m/s2, then the...
9.6K
Kinematic Equations: Problem Solving
12.5K
When analyzing one-dimensional motion with constant acceleration, the problem-solving strategy involves identifying the known quantities and choosing the appropriate kinematic equations to solve for the unknowns. Either one or two kinematic equations are needed to solve for the unknowns, depending on the known and unknown quantities. Generally, the number of equations required is the same as the number of unknown quantities in the given example. Two-body pursuit problems always require two...
12.5K
One-Degree-of-Freedom System
515
In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
515


