GO-NeRF:在神经辐射场中生成对象,用于虚拟现实内容创建

相关实验视频

Updated: May 23, 2025

21:47

Localizing Protein in 3D Neural Stem Cell Culture: a Hybrid Visualization Methodology

Published on: December 19, 2010

12.7K

Peng Dai, Feitong Tan, Xin Yu

IEEE transactions on visualization and computer graphics

|March 10, 2025

概括

在虚拟环境中,GO-NeRF可以在现有场景中实现直观的3D对象创建. 这种新的管道无地集成用户生成的对象,增强虚拟,增强和混合现实体验.

科学领域:

计算机图形计算机图形
虚拟现实虚拟现实虚拟现实
3D场景重建 3D场景重建

背景情况:

虚拟环境 (VE) 对于虚拟,增强和混合现实 (VR/AR/MR) 是至关重要的.
直接在已建立的3D场景 (NeRFs) 中创建3D对象,用于创建新的VE是一个尚未探索的领域.
将新的3D对象无地集成到现有场景中,带来了重大挑战.

研究的目的:

引入一个新的管道,GO-NeRF,用于在现有3D场景中直观地生成3D对象.
为了能够创建高质量的3D对象,并将它们无地集成到NeRF所代表的场景中.
利用场景背景生成与周围环境协调的对象.

主要方法:

使用文本提示符和用户指定的区域作为输入来生成3D对象.
采用组合染配方与3D感知不透明度地图进行场景集成.
开发量身定制的优化目标和培训策略,以减轻文物和捕捉场景背景.

主要成果:

在周围场景中生成协调的3D对象的表现卓越.
成功合成了面向前方和360°场景的高质量新视图图像.
在场景中的对象优化过程中减轻了像"浮动器"这样的常见工件.

结论:

GO-NeRF为创建和集成3D对象到现有NeRF场景提供了有效的解决方案.
该方法增强了VR/AR/MR应用程序的新型虚拟环境的创建.
该方法显示了在沉浸式技术中推进3D内容创建的巨大潜力.

相关概念视频

01:10

Generating Electromagnetic Radiations

2.5K

The German physicist Heinrich Hertz (1857–1894) was the first to generate and detect certain types of electromagnetic waves in the laboratory. Starting in 1887, he performed a series of experiments that confirmed the existence of electromagnetic waves and verified that they travel at the speed of light. Hertz used an alternating-current RLC (resistor-inductor-capacitor) circuit that resonated at a known frequency and connected it to a loop of wire. High voltages induced across the gap in...

2.5K

01:17

Radiation: Applications

1.1K

The average temperature of Earth is the subject of much current discussion. Earth is in radiative contact with both the Sun and dark space; it receives almost all its energy from the radiation of the Sun and reflects some of it into outer space. Dark space is very cold, about 3 K, so Earth radiates energy into it. For instance, heat transfer occurs from soil and grasses, the rate of which can be so rapid that frost can occur on clear summer evenings, even in warm latitudes.
The average...

1.1K

01:06

Virtual Work for a System of Connected Rigid Bodies

360

Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...

360

01:23

Induced Electric Fields

3.5K

The fact that emfs are induced in circuits implies that work is being done on the conduction electrons in the wires. What can possibly be the source of this work? We know that it’s neither a battery nor a magnetic field, as a battery does not have to be present in a circuit where current is induced, and magnetic fields never do any work on moving charges. The source of the work is in fact an electric field that is induced in the wires. For example, if a stationary conductor is placed in a...

3.5K

01:09

Radiation Pressure: Problem Solving

304

The radiation pressure applied by an electromagnetic wave on a perfectly absorbing surface equals the energy density of the wave. The wave's momentum also gets transferred to the surface when an electromagnetic wave is entirely absorbed by it. The rate at which momentum is transmitted to an absorbing surface perpendicular to the propagation direction equals the force on the surface.
The average value of the rate of momentum transfer divided by the absorbing area represents the average force...

304

01:27

Induced Electric Fields: Applications

1.5K

An important distinction exists between the electric field induced by a changing magnetic field and the electrostatic field produced by a fixed charge distribution. Specifically, the induced electric field is nonconservative because it does not work in moving a charge over a closed path. In contrast, the electrostatic field is conservative and does no net work over a closed path. Hence, electric potential can be associated with the electrostatic field but not the induced field. The following...