具有视听意识的形染 (Foveated Rendering) 进行染
IEEE transactions on visualization and computer graphics
|March 26, 2025
概括
本研究介绍了用于虚拟现实 (VR) 的视听感知形染 (AvFR). 通过考虑听觉内容,AvFR可以提高染性能.
科学领域:
- 计算机图形 计算机图形
- 人与计算机的交互
- 虚拟现实 虚拟现实 虚拟现实
背景情况:
- 虚拟现实 (VR) 染需要高速率,挑战现有的可视化染方法.
- 当前的 foveated 染忽略了听觉内容对人类视觉感知的影响.
- 听觉刺激在人类视觉系统 (HVS) 中显著影响视觉感知.
研究的目的:
- 为了量化听觉条件对视觉感知在foveated染的影响.
- 为增强VR体验开发一种视听意识的形染方法 (AvFR).
- 为了提高VR染效率而不会影响感知到的视觉质量.
主要方法:
- 开发了一个基于听觉内容的感知染质量分析.
- 构建了一个视听特征驱动的感知模型,集成场景视听内容.
- 实施了由感知模型指导的自适应性形染成本优化算法.
主要成果:
- 在复杂的VR场景中,AvFR实现了平均116/秒的率.
- 与最先进的方法相比,表现出高达1.4倍的性能改善.
- 在不降低视觉真实性的情况下保持高感知视觉质量.
结论:
- 在foveated染中,视听集成显著提高了VR性能.
- 通过结合听觉线索,AvFR提供了一种创新的方法来优化VR染.
- 拟议的方法增强了复杂VR环境中的用户体验.
相关概念视频
Association Areas of the Cortex
4.8K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
4.8K
Depth Perception and Spatial Vision
499
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
499
Focusing of Light in the Eye
1.7K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
1.7K
Anatomy of the Eyeball
5.9K
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...
5.9K
Vision
52.8K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
52.8K
Glaucoma: Overview
484
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
484


