结构NeRF:用于结构暗示的室内场景的神经辐射场
IEEE transactions on pattern analysis and machine intelligence
|August 15, 2023
概括
通过利用结构性线索,StructNeRF增强了用于稀疏输入的新视图合成. 这种方法可以改善神经辐射场 (NeRF) 几何和室内场景的染质量,而无需额外的训练数据.
科学领域:
- 计算机视觉 计算机视觉
- 计算机图形 计算机图形
- 机器学习 机器学习
背景情况:
- 神经辐射场 (NeRF) 擅长用密集的输入图像进行光现实视图合成.
- 稀少的输入视图严重限制了NeRF几何,降低了新视图合成质量.
- 现有的方法在稀疏视图的NeRF中与不受约束的几何学作斗争.
研究的目的:
- 提出StructNeRF,这是一个新的解决方案,用于从室内场景中的稀疏输入中进行强大的新视图合成.
- 在使用有限的输入视图时,解决NeRF中受限度不足的几何问题.
- 为了提高几何精度和染质量,在稀疏视图的NeRF.
主要方法:
- 结构NeRF利用来自多视图输入的结构提示来限制NeRF几何.
- 基于补丁的多视图一致的光度损失应用于纹理区域.
- 非纹理区域被明确地限制为3D一致的平面.
- 集成了密集的自我监督的深度约束来指导优化过程.
主要成果:
- 结构NeRF显著提高了NeRF的几何一致性和视图合成性能,输入稀疏.
- 该方法在与NeRF,DSNeRF,RegNeRF,密度深度Priors和MonoSDF等最先进的方法相比显示出优越或可比的结果.
- 对现实数据集的定量和质量评估验证了StructNeRF.RF的有效性.
结论:
- 结构NeRF通过结合结构先验,有效地处理在稀疏视图的NeRF中受到限制的几何问题.
- 拟议的方法为在具有挑战性的稀疏输入场景中进行新视图合成提供了强大而高效的方法.
- StructNeRF 提升了 NeRF 的功能,用于需要从有限数据中提供高质量的染的实际应用.
相关概念视频
Radiation: Applications
1.2K
The average temperature of Earth is the subject of much current discussion. Earth is in radiative contact with both the Sun and dark space; it receives almost all its energy from the radiation of the Sun and reflects some of it into outer space. Dark space is very cold, about 3 K, so Earth radiates energy into it. For instance, heat transfer occurs from soil and grasses, the rate of which can be so rapid that frost can occur on clear summer evenings, even in warm latitudes.
The average...
The average...
1.2K
Radiation Pressure: Problem Solving
394
The radiation pressure applied by an electromagnetic wave on a perfectly absorbing surface equals the energy density of the wave. The wave's momentum also gets transferred to the surface when an electromagnetic wave is entirely absorbed by it. The rate at which momentum is transmitted to an absorbing surface perpendicular to the propagation direction equals the force on the surface.
The average value of the rate of momentum transfer divided by the absorbing area represents the average force...
The average value of the rate of momentum transfer divided by the absorbing area represents the average force...
394
Neural Circuits
1.3K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.3K
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT)
390
Insensitive Nuclei Enhanced by Polarization Transfer (INEPT) is an advanced Nuclear Magnetic Resonance (NMR) technique specifically designed to detect and enhance the signals of low-abundance nuclei, such as carbon-13 and nitrogen-15, in small molecules. The fundamental principle behind INEPT is the transfer of polarization from a more abundant and highly polarizable nucleus, typically hydrogen-1, to the low-abundance nucleus of interest. This process effectively boosts the NMR signal of the...
390
Light Acquisition
8.5K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.5K


