Auditory Feedback for Navigation with Echoes in Virtual Environments: Training Procedure and Orientation Strategies.

Area of Science:

• Human-computer interaction
• Auditory perception
• Virtual reality

Background:

• Echolocation is a challenging sensory task for environmental awareness.
• Virtual environments (VEs) offer a controlled setting for training echolocation skills.
• Musicians demonstrate an aptitude for distinguishing sound pulses from reflections.

Purpose of the Study:

• To develop and evaluate virtual environments for echolocation training.
• To classify user navigation strategies within these virtual environments.
• To identify features enhancing user performance in auditory-based navigation.

Main Methods:

• Design of VE simulators for training and testing echolocation.
• User studies involving spatial orientation tasks under different auditory conditions (reflections, reverberation, combined, visual).
• Classification of user navigation strategies and performance analysis.

Main Results:

• Two user studies were conducted: a pilot test for sonic interaction design refinement and a primary study.
• Participants were exposed to four conditions: early reflections (RF), late reverberation (RV), early reflections-reverberation (RR), and visual stimuli (V).
• A subset of users (10/26) formed spatial cognitive maps, correlating with better performance in the RR condition.

Conclusions:

• Virtual environments can be effectively used to train echolocation-based navigation.
• User performance is influenced by the type of auditory stimuli and individual strategies, such as cognitive map formation.
• Further research into sonic interaction design can optimize VE-based training for spatial orientation.