可点亮的详细的人类重建从稀缺的手电筒图像

相关实验视频

Updated: Jun 13, 2025

High-Throughput Total Internal Reflection Fluorescence and Direct Stochastic Optical Reconstruction Microscopy Using a Photonic Chip

High-Throughput Total Internal Reflection Fluorescence and Direct Stochastic Optical Reconstruction Microscopy Using a Photonic Chip

Published on: November 16, 2019

Jiawei Lu, Tianjia Shao, He Wang

IEEE transactions on visualization and computer graphics

|September 9, 2024

概括

这项研究引入了一种新的系统,用于从稀疏的手电筒图像中创建详细的3D人体模型. 该方法增强了几何和外观重建,以实现现实的染和重新照明应用.

科学领域:

计算机视觉计算机视觉
计算机图形计算机图形
三维重建的3D重建

背景情况:

从图像中重建详细的3D人体几何和外观是具有挑战性的.
现有的方法难以准确地捕捉表面细节和材料特性,特别是从稀疏的数据.

研究的目的:

从稀疏的手电筒图像开发一种轻量级的系统,用于高保真度的3D人体重建.
允许在传统图形管道中直接出口重建的模型进行染和重新照明.

主要方法:

使用消费者摄像机和同位LED拍摄的多视图手电筒图像.
将预训练模型集成到基于物理的可微分染框架中.
联合优化图像特征提取器与MLP用于签名距离函数 (SDF) 和双向反射分布函数 (BRDF) 预测.

主要成果:

产生详细的几何形状,包括服装纹和精确的表面反射率.
与现有方法相比,实现了高保真度的3D人体模型,其几何和外观得到了改进.
使用视图特定的阴影线索,展示了阴影和材料特性之间的有效分歧.

结论:

拟议的系统提供了一个强大的解决方案,可以从稀疏的数据中轻松地进行3D人类重建.
在可差异化染框架内的联合优化是高质量的重建现实世界的细节的关键.
该系统提供可导出,详细的3D人类模型,适合高级图形应用.

更多相关视频

Cryo-Structured Illumination Microscopic Data Collection from Cryogenically Preserved Cells

Cryo-Structured Illumination Microscopic Data Collection from Cryogenically Preserved Cells

Published on: May 28, 2021

A Method for 3D Reconstruction and Virtual Reality Analysis of Glial and Neuronal Cells

A Method for 3D Reconstruction and Virtual Reality Analysis of Glial and Neuronal Cells

Published on: September 28, 2019

相关概念视频

Super-resolution Fluorescence Microscopy

Super-resolution Fluorescence Microscopy

Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...

Electron Microscope Tomography and Single-particle Reconstruction

Electron Microscope Tomography and Single-particle Reconstruction

Transmission electron microscopy (TEM) can be used to determine the 3D structure of biological samples with the help of techniques such as electron microscope tomography and single-particle reconstruction. While single-particle reconstruction can examine macromolecules and macromolecular complexes in vitro conditions only, tomography permits the study of cell components or small cells in vivo.
Electron Tomography
Electron tomography can be performed either in TEM or STEM (scanning transmission...