Rethinking the Mechanisms Underlying the McGurk Illusion

Area of Science:

• Auditory Perception
• Speech Science
• Cognitive Neuroscience

Background:

• The McGurk illusion, where mismatched audiovisual speech stimuli create a third percept, is often cited as evidence for audiovisual (AV) fusion.
• However, alternative explanations suggest visual dominance or default perceptual mechanisms may be at play.

Purpose of the Study:

• To investigate whether the McGurk illusion is driven by visual dominance, with ambiguous visual stimuli defaulting to a specific percept.
• To explore the role of auditory encoding strength in the manifestation of the McGurk illusion.

Main Methods:

• Participants transcribed visual-only (V-only) and audiovisual (AV) consonant-vowel (CV) stimuli.
• Auditory encoding of the syllable /ba/ was assessed using an auditory-only control task.
• Experiments involved stimuli from one talker, with a second experiment attempting replication with a different talker.

Main Results:

• In V-only conditions with ambiguous visual place of articulation (POA), participants predominantly perceived "da" or "ta".
• In AV conditions, the illusory percept was predominantly "da", "ta", or "tha", particularly when auditory /ba/ encoding was weak.
• Replication in Experiment 2 showed consistent illusory percepts but not the V-only findings, though the link between weak auditory encoding and illusion strength persisted.

Conclusions:

• The McGurk illusion may arise from a default perceptual mechanism when both visual and auditory speech stimuli are ambiguous.
• This challenges the AV fusion account, suggesting that visual dominance and default percepts play a significant role, especially with weak auditory input.