从单个360度输入图像中获得360度3D照片
IEEE transactions on visualization and computer graphics
|March 18, 2025
概括
本研究介绍了一种新的方法,可以从360度图像中创建沉浸式3D照片,从而在虚拟现实中实现自由的视角导航. 该技术实现了高视觉质量和实时染速度.
科学领域:
- 计算机视觉 计算机视觉
- 虚拟现实 虚拟现实 虚拟现实
- 计算机图形 计算机图形
背景情况:
- 360°图像提供全景,但缺乏深度,限制了虚拟现实沉浸感.
- 目前用于深度增强的方法与视觉工件或缓慢染速度作斗争.
研究的目的:
- 开发一种用于将360度图像升级为具有六度自由度的自由视角染的新方法.
- 为了实现高视觉质量和实时染速度,实现身临其境的虚拟现实体验.
主要方法:
- 使用3D高斯斯普拉特来进行场景表示,平衡视觉真实性和染性能.
- 集成的隐性扩散绘制和单眼深度估计与基于Poisson的混合,以填补看不见的区域.
主要成果:
- 在生成的自由视角染中展示了最先进的视觉和深度质量.
- 在标准GPU上实现了每兆像素每秒105的实时染速率.
结论:
- 提出的方法有效地将360度图像转化为沉浸式3D体验.
- 这种方法为虚拟现实应用中高质量的实时自由视角染提供了可行的解决方案.
相关概念视频
Spherical Coordinates
9.9K
Spherical coordinate systems are preferred over Cartesian, polar, or cylindrical coordinates for systems with spherical symmetry. For example, to describe the surface of a sphere, Cartesian coordinates require all three coordinates. On the other hand, the spherical coordinate system requires only one parameter: the sphere's radius. As a result, the complicated mathematical calculations become simple. Spherical coordinates are used in science and engineering applications like electric and...
9.9K
Rotation of Asymmetric Top
817
By definition, a spherically symmetric body has the same moment of inertia about any axis passing through its center of mass. This situation changes if there is no spherical symmetry. Since most rigid bodies are not spherically symmetric, these require special treatment.
The relationship between the angular momentum of any rigid body and its angular velocity, both of which are vectors, involves the moment of inertia. The moment of inertia is a scalar quantity only for spherically symmetric...
The relationship between the angular momentum of any rigid body and its angular velocity, both of which are vectors, involves the moment of inertia. The moment of inertia is a scalar quantity only for spherically symmetric...
817
Centroid for the Paraboloid of Revolution
504
The paraboloid of revolution is an axially symmetric surface generated by rotating a parabola around its axis. This shape has several applications in mechanical engineering due to its advantageous structural properties, such as strength against stress concentration points and rotational symmetry.
The centroid for the paraboloid of revolution is the point where all the mass of the paraboloid is concentrated. This centroid is important for engineering applications, as it determines how forces are...
The centroid for the paraboloid of revolution is the point where all the mass of the paraboloid is concentrated. This centroid is important for engineering applications, as it determines how forces are...
504
Depth Perception and Spatial Vision
500
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
500
Rotational Motion about a Fixed Axis
378
A rigid body's rotation around a fixed axis makes every point within it trace a circular path around a specific line or point. The term given to this type of spinning is defined by the angular position, symbolized by the angle θ. This angle is gauged from a static reference line to the revolving object. From this angular position, any variation is referred to as angular displacement, denoted by dθ. The extent of this displacement can be calculated in degrees, radians, or...
378


