Related Experiment Video
Updated: Aug 8, 2025

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
Exploiting the haptic and audio channels to improve orientation and mobility apps for the visually impaired
Maria Teresa Paratore1, Barbara Leporini1
1ISTI-CNR Area Della Ricerca Di Pisa, 56124 Pisa, Italy.
Abstract:
Orientation and mobility apps for visually impaired people are well known to be effective in improving the quality of life for this target group. A mobile application that guides a visually impaired person step-by-step through a physical space is a valuable aid, but it does not provide an overview of a complex environment "at a glance," as a traditional hard-copy tactile map does. The aim of this study is to investigate whether a smartphone GPS map, enriched with haptic and audio hints, can facilitate cognitive mapping for visually impaired users. Encouraged by a preliminary study conducted in co-operation with two visually impaired volunteers, we designed and developed an Android prototype for exploration of an urban area. Our goal was to provide an affordable, portable and versatile solution to help users increase awareness of an environment through the positions of its landmarks and points of interest. Vibro-tactile and audio hints were linked to the coordinates on the map via the GeoJSON data format and were issued exploiting the text-to-speech and vibration features of the mobile device, as they were displayed through the operating system's APIs. Test sessions and interviews with visually impaired users produced encouraging results. Results, to be verified by more extensive testing, overall confirm the validity of our approach and are in line with results found in the literature.
More Related Videos
13:44Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
Published on: August 8, 2011
11:39Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
Related Concept Videos
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Tactile and Chemical Senses
Design Example: Resistive Touchscreen
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Hearing
Design Example