Dual neural routing of visual facilitation in speech processing

Area of Science:

• Neuroscience
• Auditory Perception
• Visual Processing

Background:

• Visual cues significantly enhance speech perception compared to auditory-only input.
• The neural mechanisms underlying visual facilitation of speech remain incompletely understood.

Purpose of the Study:

• To investigate the distinct neural pathways and mechanisms through which visual information facilitates auditory speech perception.
• To differentiate between early visual prediction and later audiovisual error signaling.

Main Methods:

• Magnetoencephalography (MEG) to measure early auditory response latencies (M100) under varying visual predictability.
• Functional magnetic resonance imaging (fMRI) to examine functional connectivity between visual and auditory brain regions.
• Analysis of audiovisual (AV) congruence and prediction error signals.

Main Results:

• Visual predictability shortened auditory response latencies (M100), independent of auditory-visual congruence.
• Audiovisual incongruence triggered a feedback signal approximately 20 ms after initial latency shortening, indicating prediction error.
• Distinct neural pathways were identified: a fast direct route for visual motion to auditory cortex and a slower feedback route for prediction error signaling via the superior temporal sulcus.

Conclusions:

• The brain employs two primary mechanisms to leverage visual information for enhanced speech perception: rapid predictive processing and slower error correction.
• A fast corticocortical pathway processes visual motion for predictive auditory facilitation.
• A distinct, slower feedback pathway involving the superior temporal sulcus signals prediction errors between visual expectations and auditory input.