StruGauAvatar:从单眼视频中学习结构化的3D高斯语来制作可动画的化身.
IEEE transactions on visualization and computer graphics
|April 3, 2025
概括
这项研究引入了一种创新的方法,可以从单个视频中创建可动画的3D化身,通过将3D高斯斯点与离散MObius定理 (DMTet) 结合起来来改善姿势概括,用于结构化几何.
科学领域:
- 计算机视觉 计算机视觉
- 计算机图形 计算机图形
- 机器学习 机器学习
背景情况:
- 从单眼视频中进行神经3D化身重建具有挑战性,但具有广泛的应用.
- 神经辐射场 (NeRF) 具有先进的高保真化身生成.
- 3D高斯式喷涂 (3D-GS) 提供了高效的染,但由于缺乏结构,与姿势泛化作斗争.
研究的目的:
- 从单眼视频重建的可动画3D化身来增强姿势概括能力.
- 为了解决现有的3D-GS方法在处理看不见的姿势方面的局限性.
- 开发一种新的表示方式,将几何结构与高效染相结合.
主要方法:
- 提出了一种混合表示,将离散MObius定理 (DMTet) 集成为粗略的avatar几何学与3D高斯斯分片.
- 将大多数高斯点绑定到网状顶点,允许数据拟合的部分自由扩展.
- 开发了一种双空间优化框架,以共同优化DMTet,高斯点和剥皮重量.
主要成果:
- 与现有的3D-GS方法相比,拟议的方法显著提高了化身对未见姿势的概括能力.
- 在保持高效训练和染的同时,实现了高保真染.
- 在广泛的实验评估中表现出强大的性能.
结论:
- 整合结构化几何学 (DMTet) 与3D高斯斯普拉丁增强了化身姿势的概括性.
- 双空间优化框架有效地限制了高斯点变形,以提高性能.
- 这种方法为创建更具多功能性和强大的可动画3D化身提供了有希望的方向.
更多相关视频
10:393D-Neuronavigation In Vivo Through a Patient's Brain During a Spontaneous Migraine Headache
Published on: June 2, 2014
17.9K
06:20Author Spotlight: Development of an Automated Camera-Based System for Real-Time Blast Overpressure Monitoring and TBI Risk Assessment in Military Training
Published on: December 6, 2024
2.4K
相关概念视频
Relative Motion Analysis using Rotating Axes
436
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
436
Curvilinear Motion: Rectangular Components
373
Curvilinear motion characterizes the movement of a particle or object along a curved path, notably evident when envisioning a car navigating a winding road. If the car starts at point A, its position vector is established within a fixed frame of reference, where the ratio of the position vector to its magnitude signifies the unit vector pointing in the position vector's direction.
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
As the car advances, its position evolves over time. Quantifying the car's velocity involves computing the...
373
Relative Motion Analysis using Rotating Axes-Problem Solving
378
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
378
Absolute Motion Analysis- General Plane Motion
197
Visualize a drone, with its propellers spinning rapidly, hovering mid-air. The fascinating movements and operations of this drone can be comprehended by applying the principle of general plane motion.
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the...
197
Planar Rigid-Body Motion
367
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
367
Curvilinear Motion: Normal and Tangential Components
363
When a car traverses a curved road, its motion can be elucidated by breaking it down into tangential and normal components. The car-centric coordinates attached to the vehicle move with it.
The positive direction of the t-axis aligns with the increasing position of the car along the curved path, denoted by the unit vector ut. Simultaneously, the n-axis, perpendicular to the t-axis, dissects the curved path into differential arc segments, each forming the arc of a circle with a radius of...
The positive direction of the t-axis aligns with the increasing position of the car along the curved path, denoted by the unit vector ut. Simultaneously, the n-axis, perpendicular to the t-axis, dissects the curved path into differential arc segments, each forming the arc of a circle with a radius of...
363
