可动画的虚拟人类:在UV空间学习姿势依赖的人类表现,用于交互式表演合成
IEEE transactions on visualization and computer graphics
|March 11, 2024
概括
我们介绍了一种新的方法,用于创建现实的虚拟人类,使用姿势依赖的外观和几何. 该技术利用统计体模型在3D应用中实现高效的实时动画和染.
科学领域:
- 计算机图形 计算机图形
- 计算机视觉 计算机视觉
- 人与计算机的交互
背景情况:
- 现实实时动画和虚拟人类的染对于3D应用至关重要.
- 来自多视图视频重建的精确动态网状序列对于捕捉人类运动至关重要.
- 从网状序列中学习姿势依赖的外观和几何,由于人类形状和运动的复杂性,这带来了重大挑战.
研究的目的:
- 为虚拟人类提出一种新的表征,使其能够实现高度现实的实时动画和染.
- 利用统计体模型,如SMPL (皮肤多人线性模型),限制学习搜索空间并定义姿势依赖性.
- 在SMPL模型的一致紫外线空间内编码姿势依赖的外观和几何.
主要方法:
- 使用最先进的多视图视频重建获得的高度精确的动态网状序列.
- 使用统计体模型 (SMPL) 提供先验知识并限制学习过程.
- 学习观察到的几何和配套的SMPL模型之间的区别,而不是绝对的姿势依赖几何.
主要成果:
- 在SMPL模型的一致紫外线空间中成功编码依赖姿势的外观和几何.
- 在虚拟的人类表现中实现了高水平的现实主义.
- 实现了虚拟人类的精简处理和染,用于实时应用.
结论:
- 拟议的新型表现形式促进了高度现实的和高效的实时动画和虚拟人类的染.
- 利用统计体模型显著增强了对姿势依赖的人类特征的学习过程.
- 这种方法为推进3D环境中的虚拟人类的质量和性能提供了一个有希望的方向.
相关概念视频
Virtual Work for a System of Connected Rigid Bodies
384
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
384
Composite Bodies
1.0K
A composite body is a body made up of multiple parts, connected to form a larger, unified object. Each part has its own weight and center of gravity, which must be considered to determine the center of gravity of the composite body. In cases where the density or specific weight is constant, the center of gravity coincides with the centroid.
Composite bodies have widespread applications in mechanical engineering, from automobiles to aircraft to rockets. For example, an automobile wheel comprises...
Composite bodies have widespread applications in mechanical engineering, from automobiles to aircraft to rockets. For example, an automobile wheel comprises...
1.0K
Facial Feedback Hypothesis
152
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
152
Morphogenesis
28.1K
Plant morphogenesis—the development of a plant’s form and structure—involves several overlapping developmental processes, including growth and cell differentiation. Precursor cells differentiate into specific cell types, which are organized into the tissues and organ systems that make up the functional plant.
28.1K
Planar Rigid-Body Motion
446
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
446
Nonconscious Mimicry
4.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.6K


