Examining the McGurk illusion using high-field 7 Tesla functional MRI

Area of Science:

• Neuroscience
• Cognitive Science
• Audiovisual Speech Perception

Background:

• Speech perception relies on both auditory and visual (mouth movements) information.
• Incongruent audiovisual information can lead to perceptual illusions, such as the McGurk effect.
• Current models emphasize speech motor areas and the superior temporal sulcus (STS) in audiovisual speech processing.

Purpose of the Study:

• To investigate brain activity during audiovisual (AV) speech perception using high-resolution fMRI.
• To differentiate brain regions involved in fusing congruent AV speech from those processing AV incongruence.
• To test and extend the audio-visual-motor model of speech perception.

Main Methods:

• Event-related 7 Tesla functional magnetic resonance imaging (fMRI).
• Presentation of naturally spoken syllable pairs with matching and incongruent audiovisual information.
• Analysis focused on brain regions involved in AV speech processing, fusion, and incongruence detection.

Main Results:

• Successful fusion of congruent AV speech correlated with activity in the superior temporal sulcus (STS) bilaterally.
• Distinct neural areas were identified for perceptual fusion versus processing of AV incongruence.
• The findings support a dissociation between areas for AV speech integration and those for detecting AV conflict.

Conclusions:

• Audiovisual speech perception involves complex neural processes within the superior temporal sulcus.
• The study provides evidence for distinct neural mechanisms underlying the fusion of congruent AV speech and the processing of incongruent AV stimuli.
• These findings refine the audio-visual-motor model by highlighting specific roles of different brain regions in AV speech perception.