Related Experiment Video
Updated: Sep 14, 2025
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
Enhancing Orientation and Mobility Assessments: Integrating Visual and Auditory Factors Using Artificial Intelligence
Roberto Morollón Ruiz1,2, Joel Alejandro Cueva Garcés1,3, Leili Soo1,4
1Miguel Hernandez University, Elche, Spain.
Propose:
Common orientation and mobility (O&M) assessments in individuals with visual impairments often overlook environmental and psychological factors, and report results in outcome measures that might not be sufficiently sensitive. The present study aims to extend previous assessments by comparing the O&M performance and arousal levels in different simulated vision impairment and auditory conditions while using artificial intelligence (AI) tools for body tracking in an O&M task within a StreetLab environment.
Methods:
We video-recorded the O&M performance in 32 volunteers under different auditory and visual conditions. In addition to common outcome metrics (speed and collisions), we measured path length and deviations based on AI tools. Physiological parameters and subjective experiences were also recorded.
Results:
Our results showed differences between various conditions when measured using AI-based path length and deviations that were not detected by common outcome measures. We found that both vision and auditory conditions influenced O&M performance and that performing the task with a lot of background sound increased arousal.
Conclusions:
Overall, the study shows that AI-based analysis can offer valuable insights into performance beyond traditional measures and that a comprehensive evaluation of O&M skills in visual impairment should include considerations for both visual and auditory factors as well as arousal level.
Translational Relevance:
The use of AI tools enhance O&M assessments for individuals with visual impairments provides insights into environmental and psychological factors influencing O&M performance and potentially improves the evaluation of and care for individuals with visual impairments.
