Related Experiment Video
Updated: Mar 31, 2026
11:39
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
2.7K
Auditory Sensory Substitution is Intuitive and Automatic with Texture Stimuli
Noelle R B Stiles1, Shinsuke Shimojo1
1Biology and Biological Engineering, MC 139-74, California Institute of Technology, Pasadena, CA.
Scientific Reports
|October 23, 2015
Summary
Sensory substitution devices help blind individuals by converting visual information into sound. Using intuitive crossmodal mappings, like textures, significantly improves device efficiency and reduces training time.
Area of Science:
- Neuroscience
- Sensory Neuroscience
- Cognitive Science
Background:
- Millions globally experience blindness, necessitating assistive technologies.
- Sensory substitution (SS) devices translate visual data into auditory signals, engaging visual brain areas for sound processing.
- Conventional SS training is lengthy and yields limited functional gains.
Purpose of the Study:
- To investigate if SS can be efficiently engaged using stimuli with intrinsic crossmodal mappings, such as textures.
- To compare the performance of naive sighted participants with intensively-trained participants in matching intuitive SS sounds to images.
- To determine the role of existing crossmodal interactions and amodal processing versus crossmodal plasticity in SS interpretation.
Main Methods:
- Utilized stimuli (e.g., textures) with inherent crossmodal mappings for SS.
- Compared the accuracy of naive sighted individuals and extensively trained participants in associating SS sounds with corresponding images.
- Analyzed the contribution of crossmodal interactions and amodal processing in SS pattern interpretation.
Main Results:
- Naive sighted participants performed as well as intensively-trained participants in matching intuitive SS sounds to images.
- This suggests that existing crossmodal interactions and amodal sensory cortical processing are crucial for SS, particularly in early usage stages.
- Crossmodal plasticity's role may be less dominant than initially assumed in early SS interpretation.
Conclusions:
- An SS training approach leveraging crossmodal mappings can enhance performance and reduce training duration.
- This optimized training can significantly expand the capabilities of individuals with blindness.
- Future SS device development should prioritize intuitive crossmodal mappings for efficient user onboarding.
Related Concept Videos
01:33Somatosensation
45.6K
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
45.6K
01:15Sensory Modalities
4.4K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
4.4K
01:27Synesthesia
875
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
875
01:27Tactile and Chemical Senses
1.3K
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
1.3K
01:15Auditory Pathway
8.9K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
8.9K
01:17Auditory Perception
1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K