The visual speech head start improves perception and reduces superior temporal cortex responses to auditory speech.

Area of Science:

• Neuroscience
• Speech Perception
• Multisensory Integration

Background:

• Visual speech information from the mouth is often perceived before auditory speech.
• Understanding how this temporal advantage influences speech perception and neural processing is crucial.

Purpose of the Study:

• To investigate the impact of a visual head start in speech on both perceptual and neural responses.
• To determine how visual speech modulates auditory processing in the posterior superior temporal gyrus (pSTG).

Main Methods:

• Examined perceptual and neural responses to spoken words with and without a preceding visual component.
• Measured neural activity using electrodes in the pSTG of epileptic patients.
• Compared responses for words with and without a visual head start.

Main Results:

• Perception of spoken words was enhanced by viewing the talker's face, with significantly greater enhancement for words with a visual head start.
• Visual speech suppressed neural responses to auditory speech in the pSTG, more so when a visual head start was present.
• The visual head start led to decreased overall neural responses.

Conclusions:

• A visual head start in speech processing enhances perception and reduces neural activity in the auditory cortex.
• This suggests that early visual information can inhibit competing auditory phoneme representations, leading to more accurate and efficient speech perception.
• Multisensory interactions, particularly involving visual speech, significantly modulate activity across the entire speech perception network.