Related Experiment Video
Updated: May 22, 2026

11:39
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
Fast, accurate reaching movements with a visual-to-auditory sensory substitution device.
S Levy-Tzedek1, S Hanassy, S Abboud
1The Institute for Medical Research Israel-Canada, Faculty of Medicine, Department of Medical Neurobiology, The Hebrew University of Jerusalem, Jerusalem, Israel. shelly@huji.ac.il
Restorative Neurology and Neuroscience
|May 19, 2012
Summary
This study shows that a visual-to-auditory sensory substitution device (SSD) can effectively guide fast and accurate reaching movements in blindfolded participants, demonstrating its potential for daily tasks and rehabilitation.
Area of Science:
- Neuroscience
- Human-Computer Interaction
- Rehabilitation Engineering
Background:
- Sensory substitution devices (SSDs) translate visual information into non-visual modalities like sound or touch.
- Prior research focused on perceptual learning and neural correlates of SSDs.
- Sensorimotor integration is key for practical SSD application in daily tasks.
Purpose of the Study:
- To evaluate a novel visual-to-auditory SSD for guiding rapid reaching movements.
- To assess the efficacy of auditory feedback for precise motor control.
Main Methods:
- Participants used a visual-to-auditory SSD providing location, shape, and color information.
- Blindfolded sighted participants performed fast reaching movements towards SSD-guided targets.
- Movement parameters (time, speed, path length, accuracy) were compared to visual feedback conditions.
Main Results:
- Participants achieved fast and accurate movements with the SSD after brief training.
- Performance metrics (movement time, peak speed, path length) were comparable to visual guidance.
- Endpoint accuracy was high, with average errors under 0.5 cm for both conditions.
Conclusions:
- Findings support a modality-independent spatial information representation theory.
- Task-specific brain function is crucial for rehabilitative SSD use.
- The visual-to-auditory SSD shows potential for daily tasks and rehabilitation requiring accurate, rapid movements.

