Discrimination tests of visually influenced syllables

Area of Science:

• Cognitive psychology
• Auditory perception
• Audiovisual integration

Background:

• The McGurk effect illustrates how auditory perception can be influenced by visual information.
• Visual input can sometimes override auditory signals, leading to consistent judgments for discrepant syllables.
• This raises questions about the phonetic equivalence between visually influenced and audiovisually compatible syllables.

Purpose of the Study:

• To investigate whether visually influenced syllables are phonetically equivalent to audiovisually compatible syllables.
• To test phonetic equivalence using an AXB matching paradigm with discrepant audiovisual stimuli.
• To determine if perceived phonetic differences stem from the audiovisual stimuli themselves.

Main Methods:

• An AXB matching paradigm was employed.
• Participants matched an auditory syllable (/va/) to either a consistent audiovisual syllable (audio/va/-video/fa/) or a discrepant one (audio/ba/-video/fa/).
• Further experiments explored potential extraneous factors influencing preferences.

Main Results:

• Participants were significantly more likely to match the auditory /va/ to the audiovisually consistent syllable (audio/va/-video/fa/).
• This preference suggests that the two types of audiovisual syllables are not perceived as phonetically equivalent.
• Results indicate differences in phonetic convincingness rather than extraneous phonetic dimensions or noticeable discrepancies.

Conclusions:

• Visually influenced syllables in the McGurk effect are not always perceived as phonetically equivalent to audiovisually compatible stimuli.
• The study highlights nuanced differences in phonetic perception within audiovisual integration.
• The findings contribute to understanding the mechanisms underlying audiovisual speech perception.