Related Experiment Video
Updated: Apr 17, 2026
11:39
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
2.7K
Visual objects in the auditory system in sensory substitution: how much information do we need?
Multisensory Research
|February 20, 2015
Summary
Sensory substitution devices create soundscapes from images. Researchers found a performance limit at 8x8 pixels, suggesting perceptual rather than technical limits hinder visual substitution device effectiveness.
Area of Science:
- Neuroscience
- Sensory Perception
- Human-Computer Interaction
Background:
- Sensory substitution devices (SSDs) translate visual information into auditory or tactile signals.
- The vOICe is an example of a device converting visual imagery into auditory soundscapes.
- The efficacy of SSDs is limited by unknown technical or perceptual factors.
Purpose of the Study:
- To investigate whether technical or perceptual limitations dominate the efficacy of sensory substitution devices.
- To determine the resolution at which performance plateaus in visual object identification using sonified images.
Main Methods:
- Naïve sighted participants identified visual objects using a six-alternative forced-choice (6AFC) procedure.
- The resolution of sonified images presented via The vOICe was manipulated.
- Performance was assessed under both auditory and tactile sensory substitution conditions.
Main Results:
- A performance ceiling effect was observed at 8x8 pixel resolution for object identification.
- This resolution limit was consistent across both auditory and tactile sensory substitution modalities.
- The observed performance limit was significantly below the theoretical technical capabilities of the devices.
Conclusions:
- Perceptual limitations, not technical constraints, appear to dominate the practical efficacy of current sensory substitution devices.
- Auditory neural processing limits may restrict the representation of 'auditory' objects.
- Perceptual training could potentially enhance performance and overcome these limitations.
Related Concept Videos
01:17Auditory Perception
1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
01:15Sensory Modalities
4.7K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
4.7K
01:26Visual System
2.4K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
2.4K
01:15Auditory Pathway
9.1K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
9.1K
01:31Hearing
59.1K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
59.1K
01:12Visual Agnosia
1.8K
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
1.8K