The self-advantage in visual speech processing enhances audiovisual speech recognition in noise

Area of Science:

• Cognitive Psychology
• Neuroscience
• Speech Perception

Background:

• Individuals exhibit a self-advantage in lip reading (vision-only speech recognition).
• This phenomenon aligns with the common-coding hypothesis, suggesting shared representations for action perception and production.
• The current study investigates if this self-advantage extends to audiovisual speech recognition under degraded listening conditions.

Purpose of the Study:

• To determine if a self-advantage exists in audiovisual speech recognition.
• To test the common-coding hypothesis in the context of combined auditory and visual speech signals.
• To examine the role of visual speech cues when listening to oneself versus others in noisy environments.

Main Methods:

• Participants engaged in round-robin testing, acting as both talker and listener/observer with subgroup members, including themselves.
• Audiovisual speech recognition was assessed under poor listening conditions.
• Statistical controls were applied for individual differences in visual speech benefit and self-generated visual speech benefit.

Main Results:

• A significant self-advantage was observed in audiovisual speech recognition.
• The benefit from the visual speech signal was greater when participants were the talker compared to when others were the talker.
• This self-advantage persisted even after accounting for individual differences in visual speech processing abilities.

Conclusions:

• The findings support a self-advantage in audiovisual speech recognition, extending previous vision-only findings.
• Results are consistent with the common-coding hypothesis, indicating shared neural mechanisms for perceiving and producing speech.
• This suggests that observing one's own speech production provides unique benefits for comprehension, especially when auditory cues are limited.