HDhuman:高品质的人类小说-视图从稀疏的视图进行染
IEEE transactions on visualization and computer graphics
|June 29, 2023
概括
HDhuman通过稀疏的摄像头视图实现了高质量的新视图染,为人类提供复杂的服装纹理. 这种新方法重建了详细的几何形状,并集成了实现现实的2k图像生成的功能,优于现有的技术.
科学领域:
- 计算机视觉 计算机视觉
- 计算机图形 计算机图形
- 机器学习 机器学习
背景情况:
- 从稀疏的视图中合成复杂的服装纹理的人类表演者的新视图是具有挑战性的.
- 现有的方法很难从复杂的纹理中恢复高频几何细节,从而限制染质量.
研究的目的:
- 提出HDhuman,一个新的框架,用于高质量的人类重建和染从稀疏的观点.
- 解决当前神经染技术在处理复杂的服装图案方面的局限性.
主要方法:
- 使用人类重建网络与像素对齐的空间变压器进行详细的几何恢复.
- 采用染网络,具有几何引导的像素智能功能集成,用于增强多视图功能融合.
- 像素对齐的空间变压器识别了输入视图之间的相关性,以重建高频细节.
主要成果:
- 在新的视图上实现高质量的人类重建和2k分辨率的染.
- 与现有的通用和特定方法相比,在合成和现实世界数据集上表现出优异的性能.
- 拟议的方法可以通用到新的主题,而不需要特定场景的培训或微调.
结论:
- HDhuman有效地从稀疏的视图中重建并使人类具有复杂的纹理.
- 该框架为神经染提供了可通用的解决方案,性能优于以前的方法.
- 公共可用的代码和数据有助于进一步研究人类视觉合成.
相关概念视频
Newman Projections
17.0K
Different notations are used to represent the three-dimensional structure of molecules on two-dimensional surfaces. One of the most commonly used representations is the dash-wedge formula. The dashed wedges, solid wedges, and the plane lines indicate the groups situated behind the plane, coming out of the plane, and in the plane, respectively.
The organic molecules rotate across the single bonds leading to numerous temporary three-dimensional structures of varying energy known as...
The organic molecules rotate across the single bonds leading to numerous temporary three-dimensional structures of varying energy known as...
17.0K
Downsampling
192
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
192
Upsampling
265
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
265
Deconvolution
197
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
197
The Retina
69.2K
The retina is a layer of nervous tissue at the back of the eye that transduces light into neural signals. This process, called phototransduction, is carried out by rod and cone photoreceptor cells in the back of the retina.
69.2K
Residual Plots
4.7K
A residual plot is a statistical representation of data used to analyze correlation and regression results. It helps verify the requirements for drawing specific conclusions about correlation and regression. To obtain the residual plot, first, the residual for each data value is calculated, which is simply the vertical distance between the observed and the predicted value obtained from the regression equation.
When the residual values are plotted against the variable x, it is called a residual...
When the residual values are plotted against the variable x, it is called a residual...
4.7K


