涂你的运动:草图引导的人类运动生成器
IEEE transactions on visualization and computer graphics
|March 3, 2025
概括
草图引导的人类运动扩散 (SMD) 从2D草图生成精确的3D人体运动. 这种新的方法确保动作与用户的意图保持一致,通过使用双分支关注全球和本地素描特征.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 条件导向的人类运动生成方法由于抽象的条件语义而难以精确的意图对齐.
- 自由手的草图提供了一个直接而准确的代表人为运动生成的意图.
研究的目的:
- 介绍草图引导的人类运动扩散 (SMD) 对于新的草图到动作场景.
- 从2D人类运动草图生成可信和自然的3D人类运动.
主要方法:
- 使用双分支时间感知变压器来调节2D素描信息以生成3D运动.
- 利用全球语义级别的注意力来对草图到动作序列进行对齐.
- 实施地方视角级别的注意力,以精确地对准草图到关键框架.
主要成果:
- SMD 证明了在运动中介和身体部位编辑任务中的熟练程度.
- 这种方法无地产生了与草图背景协调的自然动作序列.
- 在草图到动作数据集上的实验验验证了SMD的有效性和最先进的性能.
结论:
- SMD有效地弥合了抽象的条件语义和精确的人类运动意图之间的差距.
- 拟议的草图到动作框架为直观的人类运动生成提供了一个有希望的方向.
- 根据草图,SMD在生成自然和准确的人类运动方面取得了最先进的结果.
相关概念视频
Absolute Motion Analysis- General Plane Motion
199
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
199
Planar Rigid-Body Motion
370
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
370
Kinematic Equations for Rotation
301
In mechanics, when one observes a rigid body in rotational motion with constant angular acceleration, it is possible to establish equations for its rotational kinematics. This process resembles how linear kinematics are dealt with in simpler motion studies.
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
For instance, imagine a point A on a rigid body engaged in circular motion. The translational velocity of this particular point can be calculated by taking the time derivatives of the displacement equation, which essentially measures the...
301
Kinematic Equations: Problem Solving
11.8K
When analyzing one-dimensional motion with constant acceleration, the problem-solving strategy involves identifying the known quantities and choosing the appropriate kinematic equations to solve for the unknowns. Either one or two kinematic equations are needed to solve for the unknowns, depending on the known and unknown quantities. Generally, the number of equations required is the same as the number of unknown quantities in the given example. Two-body pursuit problems always require two...
11.8K
Relative Motion Analysis using Rotating Axes-Problem Solving
382
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
382
Relative Motion Analysis - Velocity
334
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
334


