Related Experiment Video
Updated: Aug 8, 2026

09:01
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
Visualization tools for blind people using multiple modalities
1Department of Computing Science, University of Glasgow, UK. stephen@dcs.gla.ac.uk
Disability and Rehabilitation
|August 17, 2002
Summary
Non-speech audio and haptic feedback significantly improve how blind individuals access visual data like graphs. This multimodal approach offers a more flexible and effective way to interact with complex information.
Area of Science:
- Human-Computer Interaction
- Assistive Technology
- Data Visualization
Background:
- Blind individuals face significant challenges accessing visual data like graphs and tables.
- Existing assistive technologies, such as speech or tactile graphics, offer limited solutions.
- There is a need for more effective and flexible methods for data visualization accessibility.
Purpose of the Study:
- To investigate the use of non-speech sounds and haptic feedback for improved access to graphs.
- To compare the effectiveness of non-speech audio interfaces with standard speech interfaces.
- To evaluate different haptic graph designs for user interaction.
Main Methods:
- Two experiments were conducted to test sound and haptic graph solutions.
- The audio experiment compared a standard speech interface with one augmented by non-speech sounds.
- The haptic experiment evaluated the effectiveness of two distinct graph designs.
Main Results:
- Non-speech audio interfaces led to significantly lower subjective workload, reduced task completion times, and fewer errors compared to standard speech interfaces.
- Haptic graph designs demonstrated reductions in workload and mitigated common usability issues.
- Both non-speech sound and haptic feedback showed promise in enhancing data accessibility.
Conclusions:
- Multimodal approaches utilizing non-speech sound and haptics can substantially enhance user interaction with data visualizations.
- These methods offer more flexible and richer access to graphical information for visually impaired users.
- Leveraging multiple senses provides a powerful avenue for improving assistive technology for data access.
Related Concept Videos
Sensory Modalities
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Visual Agnosia
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round end"...

