HOIMotion:使用自我中心的3D对象界限框预测人与物体交互期间的人类运动
IEEE transactions on visualization and computer graphics
|September 10, 2024
概括
通过整合身体姿势和3D对象数据,HOIMotion改善了人类运动预测. 这种新的方法增强了对增强现实应用程序的预测,在准确性和现实性方面超过了现有的方法.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 人与计算机的交互
背景情况:
- 人类运动预测对于增强现实 (AR) 和机器人技术至关重要.
- 现有的方法主要依赖于过去的身体姿势,忽视了对象相互作用.
- 准确预测在物体相互作用期间的人类运动仍然是一个挑战.
研究的目的:
- 介绍HOIMotion,这是一种在人与物体交互期间预测人类运动的新方法.
- 为了利用过去的身体姿势和自我中心的3D对象界限框来改进运动预测.
- 在交互式环境中提高预测人类运动的现实性和精度.
主要方法:
- 从身体姿势和3D对象界限框中提取特征,使用编码器-残余图卷积网络 (GCN) 和多层感知子.
- 姿势和对象特征的融合形成了一个新的姿势-对象图.
- 未来的运动预测使用残余解码器 GCN.
主要成果:
- 在Aria数字双胞胎 (ADT) 和MoGaze数据集上,HOIMotion显著超过了最先进的方法.
- 在ADT上达到8.7%,在MoGaze上达到7.2%,平均每关节位置错误的改善.
- 一项人类研究证实,HOIMotion预测的姿势被认为更精确,更现实.
结论:
- 自我中心的3D对象界限框包含人类运动预测的重要信息.
- HOIMotion有效地利用对象交互数据来提高运动预测的准确性和现实性.
- 拟议的方法为需要在交互式环境中准确预测人类运动的应用提供了实质性的进步.
相关概念视频
Relative Motion Analysis using Rotating Axes-Problem Solving
394
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
394
Relative Motion Analysis using Rotating Axes
450
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
450
Planar Rigid-Body Motion
414
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
414
Absolute Motion Analysis- General Plane Motion
218
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
218
Curvilinear Motion: Rectangular Components
429
Curvilinear motion characterizes the movement of a particle or object along a curved path, notably evident when envisioning a car navigating a winding road. If the car starts at point A, its position vector is established within a fixed frame of reference, where the ratio of the position vector to its magnitude signifies the unit vector pointing in the position vector's direction.
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
429
Relative Motion Analysis using Rotating Axes - Acceleration
327
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Time differentiation is...
327


