Gaze-Dependent Simulation of Light Perception in Virtual Reality.

Area of Science:

• Computational visual neuroscience
• Virtual reality (VR) and augmented reality (AR) display technology
• Human visual perception modeling

Background:

• Current head-worn displays (HWDs) in VR/AR cannot replicate the human eye's high dynamic range of brightness and color.
• Accurate simulation of incident light effects is essential for achieving perceptual realism in virtual environments.
• Existing VR/AR systems lack advanced visual effects that mimic real-world light perception phenomena.

Purpose of the Study:

• To develop and evaluate an eye-tracked VR/AR simulation incorporating gaze-dependent temporal eye adaptation, perceptual glare, visual acuity reduction, and scotopic color vision.
• To advance virtual simulations towards greater perceptual realism by mimicking real-world light interactions with the human visual system.
• To investigate the subjective nature of light perception within simulated environments.

Main Methods:

• Development of an eye-tracked VR/AR simulation integrating multiple visual effects based on medical expert knowledge and studies of the healthy human eye.
• Implementation of gaze-dependent temporal eye adaptation, perceptual glare, visual acuity reduction, and scotopic color vision algorithms.
• Conduction of a user study comparing real-world low-light scene perception with the developed VR simulation.

Main Results:

• The proposed combination of simulated visual effects in VR was well-received by users.
• The study demonstrated the feasibility of simulating complex light perception phenomena in virtual environments.
• Results indicated a significant need for individual adaptation in simulations due to the subjective nature of light perception.

Conclusions:

• The developed eye-tracked VR/AR simulation effectively enhances perceptual realism by incorporating advanced visual effects.
• Simulated visual effects, including gaze-dependent adaptation and scotopic vision, improve the user experience in virtual environments.
• Personalized calibration is crucial for optimizing virtual reality experiences, acknowledging the inherent subjectivity of human light perception.