Children use visual speech to compensate for non-intact auditory speech

Area of Science:

• Developmental Psychology
• Auditory Perception
• Speech Processing

Background:

• The integration of visual and auditory speech information is crucial for speech perception.
• Understanding how children integrate visual speech cues, especially when auditory information is incomplete, is vital.
• Previous research highlights the McGurk effect, but the 'visual speech fill-in' phenomenon requires further investigation in developmental populations.

Purpose of the Study:

• To determine if visual speech can fill in missing consonant onsets in auditory speech for children aged 4-14.
• To examine how the difficulty of visual speech cues and age influence the visual speech fill-in effect.
• To differentiate the cognitive processes underlying the visual speech fill-in effect versus the McGurk effect in children.

Main Methods:

• Children (4-14 years) were presented with auditory-only (AO) and audiovisual (AV) stimuli featuring excised consonant onsets.
• The visual speech fill-in effect was measured by comparing correct consonant onset identification in AV versus AO conditions.
• Performance was analyzed in relation to cue difficulty (e.g., /b/ vs. /g/) and age, with comparisons to McGurk task performance.

Main Results:

• A significant visual speech fill-in effect was observed, with easier visual cues (/b/) showing greater filling-in than difficult cues (/g/).
• All children benefited from easy visual cues, while only older children benefited from difficult visual cues.
• The visual speech fill-in effect was associated with age and vocabulary, whereas the McGurk effect was linked to speechreading skills, indicating distinct underlying mechanisms.

Conclusions:

• Visual speech plays a substantial role in aiding children's perception of incomplete auditory speech.
• The ability to utilize visual speech cues for filling in gaps develops with age and is modulated by cue difficulty.
• Children's speech perception is a complex, multifaceted process influenced by various cognitive abilities, integrating auditory and visual information dynamically.