FovealNet:推进人工智能驱动的视线跟踪解决方案,以在虚拟现实中实现高效的形染
IEEE transactions on visualization and computer graphics
|March 11, 2025
概括
FovealNet通过改进人工智能驱动的凝视跟踪精度来增强虚拟现实 (VR). 这导致了在 foveated 染应用程序中更好的视觉质量和系统性能.
科学领域:
- 计算机视觉 计算机视觉
- 虚拟现实系统 虚拟现实系统
- 人工智能的人工智能
背景情况:
- 虚拟现实中的Foveated染优化了硬件效率和视觉质量,通过将高分辨率图形集中在用户的目光上.
- 基于深度学习的凝视跟踪经常存在错误,降低了用户体验和foveated染的好处.
研究的目的:
- 介绍FovealNet,一个人工智能框架,以提高视线跟踪精度,以优化VR系统性能.
- 降低计算成本并提高AI驱动的目光跟踪算法的效率.
主要方法:
- FovealNet使用基于事件的裁剪方法来消除无关的像素,减少输入数据.
- 一个令牌修剪策略可以动态删除令牌,而不会影响跟踪准确性.
- 系统性能意识的多分辨率培训策略可以适应不同的运行时配置.
主要成果:
- 与现有方法相比,FovealNet实现了至少1.42×的加快速度.
- 显示了对foveated染输出的感知质量增加了13%.
- 通过高效的像素和令牌管理,成功降低了计算负载.
结论:
- FovealNet显著提高了人工智能驱动的凝视跟踪的性能和视觉质量.
- 该框架为增强VR体验提供了具有成本效益和准确的解决方案.
- 拟议的方法有助于更高效和适应性的凝视跟踪系统.
相关概念视频
Depth Perception and Spatial Vision
503
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
503
Association Areas of the Cortex
4.8K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
4.8K
Focusing of Light in the Eye
1.8K
Light rays enter the eye through the cornea, a transparent dome-shaped tissue that is the eye's outermost layer. The cornea bends or refracts, light rays traveling to the pupil. The shape of the cornea determines how much of the light is bent and whether the image will be focused correctly on the retina at the back of the eye. Once the light has passed through both refraction layers, it converges into a single focal point onto a small area. This is where photoreceptors start transforming...
1.8K
Sight Distance in a Vertical Curve
30
Sight distance on vertical curves is critical in roadway design. It ensures drivers can see far enough ahead to identify and respond to hazards effectively. This directly impacts safety, driver comfort, and the overall efficiency of the transportation network.Vertical curves are classified into crest and sag curves based on their geometry. For crest curves, sight distance is determined by the line of sight between a driver's eye and a small object on the road's surface. Design parameters for...
30


