The visual mismatch negativity elicited with visual speech stimuli

Area of Science:

• Neuroscience
• Cognitive Science
• Auditory and Speech Processing

Background:

• The visual mismatch negativity (vMMN) reflects the brain's response to stimulus deviance, originating from stimulus-representing cortical areas.
• Previous research indicates right posterior temporal cortex specialization for non-speech facial gestures and left posterior temporal cortex for visual speech.

Purpose of the Study:

• To investigate the lateralization of visual speech processing using the vMMN paradigm.
• To determine how the brain differentiates between visually presented speech sounds based on perceptual similarity.

Main Methods:

• Utilized an electroencephalography (EEG) vMMN paradigm with controlled visual speech consonant-vowel (CV) stimuli.
• Compared event-related potentials (ERPs) for deviant vs. standard CV stimuli to elicit vMMNs.
• Tested vMMNs using perceptually "far" deviants ('zha'/'fa') and "near" deviants ('zha'/'ta').

Main Results:

• The left posterior temporal cortex showed vMMN responses only to "far" deviants, indicating sensitivity to significant phonetic differences.
• The right posterior temporal cortex exhibited vMMN responses to all tested deviants, suggesting a broader role in processing facial gestures.
• Differential vMMN responses were observed based on perceptual dissimilarity of CV stimuli.

Conclusions:

• The left posterior temporal cortex is specialized for representing speech contrasts perceived as distinct consonants.
• The right posterior temporal cortex appears to process facial gestures, potentially including visual speech, with less sensitivity to fine phonetic distinctions.