姿势驱动的压缩为动态3D人类通过人类先前模型
IEEE transactions on pattern analysis and machine intelligence
|February 22, 2024
概括
本研究介绍了一种使用人类先前模型的新型动态3D人体压缩框架. 它为沉浸式应用实现了卓越的感知质量和比特率节省.
科学领域:
- 计算机视觉 计算机视觉
- 计算机图形 计算机图形
- 多媒体系统 多媒体系统
背景情况:
- 对于沉浸式多媒体应用程序,有效压缩动态3D人类数据是必不可少的.
- 现有的方法往往侧重于信号级错误,限制感知质量和下游任务支持.
- 需要一种利用人类先验的新方法来实现先进的3D人类表现.
研究的目的:
- 开发一个具有成本效益和高质量的动态3D人体压缩框架.
- 提高感知质量,并支持各种下游应用,如视觉分析和内容编辑.
- 在主观质量和比特率效率方面超越现有的3D编解码器.
主要方法:
- 提出了一种分层编码架构,从姿势驱动的阿凡达作为结构层开始.
- 人类运动是使用皮肤多人线性模型 (SMPL) 为运动层进行参数化的.
- 正常被纳入作为增强层,以保存精细的几何细节.
- 阿凡达,SMPL参数和正常地图被压缩成语义位流.
主要成果:
- 拟议的框架在与最先进的3D编解码器相比,表现出了显著的优异性.
- 在最小的比特率消耗下,可以实现主观质量的显著改善.
- 框架在感知质量和比特率节省方面的优势随着序列大小和数的增加而增加.
结论:
- 基于人类先验的压缩框架在动态3D人类数据传输方面取得了重大进展.
- 层层的方法有效地平衡了压缩效率与高感知质量和功能多功能性.
- 这种方法为各种应用中实时,高保真度的3D人体染提供了有前途的解决方案.
更多相关视频
09:32Subject-specific Musculoskeletal Model for Studying Bone Strain During Dynamic Motion
Published on: April 11, 2018
9.7K
06:20Author Spotlight: Development of an Automated Camera-Based System for Real-Time Blast Overpressure Monitoring and TBI Risk Assessment in Military Training
Published on: December 6, 2024
2.8K
相关概念视频
Modeling and Similitude
267
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
267
Three-Dimensional Force System
2.0K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.0K
Three-Dimensional Force System:Problem Solving
667
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
667
Deformation of Member under Multiple Loadings
164
When a rod is made of different materials or has various cross-sections, it must be divided into parts that meet the necessary conditions for determining the deformation. These parts are each characterized by their internal force, cross-sectional area, length, and modulus of elasticity. These parameters are then used to compute the deformation of the entire rod.
In the case of a member with a variable cross-section, the strain is not constant but depends on the position. The deformation of an...
In the case of a member with a variable cross-section, the strain is not constant but depends on the position. The deformation of an...
164
Planar Rigid-Body Motion
446
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
446
Virtual Work for a System of Connected Rigid Bodies
384
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
384
