360°立体图像构成与深度调整
IEEE transactions on visualization and computer graphics
|October 27, 2023
概括
这项研究引入了一种新方法,用于将物体插入360度立体全景,改善深度感知和消除幽灵文物. 每个视图投影技术确保了现实的虚拟现实 (VR) 经验与操纵的360°内容.
科学领域:
- 计算机视觉 计算机视觉
- 虚拟现实 (VR) 是一种虚拟现实.
- 图像处理 图像处理
背景情况:
- 360°图像和视频对于VR体验非常受欢迎.
- 对立体全景内容的操纵,特别是对象插入,是未经探索的.
- 现有的对象插入到等直角图像的方法往往无法提供令人满意的深度感知,并可能导致幽灵文物.
研究的目的:
- 开发一种通过插入物体组成360度立体图像的解决方案.
- 在物体插入过程中保存几何信息.
- 为了增强深度感知和消除操纵立体声全景中的幽灵文物.
主要方法:
- 利用恢复的3D点云来指导复合图像生成.
- 提出了一种新的每视图投影方法,用于在3D球形空间中分割对象.
- 开发了一个深度密集网络,用于为每个视图段生成深度指导.
- 将合成的视图段和混合的对象组合到目标立体 360° 场景中.
主要成果:
- 提出的方法成功地将物体插入到立体360度全景图中.
- 用户研究证实了操纵内容的良好的深度感知.
- 幽灵文物被有效地移除,提高了VR体验的视觉质量.
结论:
- 每视图投影方法为360度立体图像构成提供了一个强大的解决方案.
- 这种方法为未来360度媒体的内容操纵提供了潜在的范式.
- 该技术增强了虚拟现实应用中的现实性和用户体验.
相关概念视频
01:15Depth Perception and Spatial Vision
681
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
681
01:21Gestalt Principles of Perception
318
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
318