Navigation aid for blind persons by visual-to-auditory sensory substitution: A pilot study

Area of Science:

• Assistive technology research
• Human-computer interaction
• Sensory substitution devices

Background:

• Blind individuals face challenges in navigation and object recognition.
• Sensory substitution offers a potential solution by translating visual information into other sensory modalities.

Purpose of the Study:

• To investigate the use of augmented reality (AR) for a visual-to-auditory sensory substitution device (SSD).
• To evaluate the effectiveness of this AR-based SSD for improving navigation and recognition tasks in blind individuals.

Main Methods:

• Developed a sensory substitution algorithm translating 3D visual data into audio feedback.
• Integrated the algorithm into an AR-based mobile application.
• Conducted a study with 7 blind participants navigating obstacle courses and identifying objects using the AR-SSD, white cane, or both.

Main Results:

• Participants successfully completed navigation and object recognition tasks in an experimental setting with minimal training.
• The AR-based sensory substitution device demonstrated general feasibility and a low entry barrier.
• No statistically significant improvement in navigation performance was observed compared to a white cane within the 10-hour study duration.

Conclusions:

• AR technology can be utilized to create feasible visual-to-auditory sensory substitution devices.
• The developed algorithm shows promise for aiding blind individuals in specific tasks.
• Further research and development are needed to enhance navigation performance compared to traditional mobility aids.