Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Neuroplasticity01:01

Neuroplasticity

977
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
977
Hearing01:31

Hearing

54.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
54.4K
Auditory Perception01:17

Auditory Perception

697
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
697
Auditory Pathway01:15

Auditory Pathway

6.1K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
6.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Do Not Forget the Stimulus: A Missing Control in Naturalistic Studies of Neural Entrainment.

eNeuro·2026
Same author

Aβ-induced inference of velocity contributes to pleasant touch in interaction with visual cues.

The Journal of physiology·2026
Same author

The emotional responses to the sounds of organic affective tactile gestures.

Psychological research·2025
Same author

Shared sensitivity to data distribution during learning in humans and transformer networks.

Nature human behaviour·2025
Same author

Is It Different to Touch Oneself Than to Touch Others? A Scientific Journey with Vincent Hayward.

Multisensory research·2025
Same author

Auditory-tactile presentation accelerates target detection in a multitasking situation.

Cognitive research: principles and implications·2025
Same journal

Therapeutic potential of crude protein extracts from two Egyptian freshwater snails Lanistes carinatus and Bellamya unicolor.

Scientific reports·2026
Same journal

Microbial contamination of donor corneas and post-keratoplasty endophthalmitis: a comparison between Japanese and U.S. eye banks using cold storage.

Scientific reports·2026
Same journal

Prevalence and contributing factors of virological non-suppression among adult patients on first-line antiretroviral therapy in tertiary hospitals in Ethiopia.

Scientific reports·2026
Same journal

An in vitro comparison of color stability between alkasite and different restorative materials in various staining solutions.

Scientific reports·2026
Same journal

Toward accessible mRNA LNP formulation: systematic evaluation of mixing strategies and key parameters.

Scientific reports·2026
Same journal

A network analysis of personality traits, mentalizing, and psychological health in Chinese college students.

Scientific reports·2026
See all related articles

Related Experiment Video

Updated: Oct 27, 2025

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.3K

Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device.

Jacques Pesnot Lerousseau1, Gabriel Arnold2, Malika Auvray3

  • 1Aix Marseille Univ, Inserm, INS, Inst Neurosci Syst, Marseille, France.

Scientific Reports
|July 21, 2021
PubMed
Summary
This summary is machine-generated.

Sensory substitution devices (SSDs) blend visual and auditory processing. Training with a visual-to-sound device showed that visual information interfered with sound identification, indicating shared processing, while auditory skills influenced user experience.

More Related Videos

A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.7K
Optogenetic Stimulation of the Auditory Nerve
10:53

Optogenetic Stimulation of the Auditory Nerve

Published on: October 8, 2014

14.8K

Related Experiment Videos

Last Updated: Oct 27, 2025

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.3K
A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.7K
Optogenetic Stimulation of the Auditory Nerve
10:53

Optogenetic Stimulation of the Auditory Nerve

Published on: October 8, 2014

14.8K

Area of Science:

  • Neuroscience
  • Cognitive Science
  • Human-Computer Interaction

Background:

  • Sensory substitution devices (SSDs) aim to restore visual function by translating visual input into auditory or tactile signals.
  • The cognitive mechanisms underlying SSD use are not fully understood, with ongoing debate about the extent of visual versus auditory processing involved.
  • Emerging theories suggest a blend of both visual and auditory processes in sensory substitution.

Purpose of the Study:

  • To investigate the behavioral extent to which visual and auditory processes are engaged during sensory substitution training.
  • To explore the influence of individual auditory abilities on performance and subjective experience with a visual-to-sound SSD.
  • To elucidate the underlying neural and cognitive mechanisms of sensory substitution for improved device design.

Main Methods:

  • Participants underwent a Stroop-like crossmodal interference task before and after training with a visual-to-sound SSD.
  • Performance in sound identification was assessed under conditions of simultaneous visual distraction.
  • Individual auditory abilities and phenomenological reports were measured to correlate with task performance.

Main Results:

  • Post-training, participants exhibited crossmodal interference, where visual distractors affected sound identification, indicating shared visual-auditory processing.
  • Performance during SSD training and subjective experiences were significantly influenced by participants' baseline auditory abilities.
  • These findings suggest that sensory substitution processing is rooted in the individual's inherent sensory modalities.

Conclusions:

  • Sensory substitution involves shared cognitive resources between vision and audition, particularly after training.
  • Individual differences in auditory perception play a crucial role in the effectiveness and user experience of SSDs.
  • Optimizing SSD design and learning requires consideration of inter-individual variations in perceptual strategies.