"Look who's talking!" Gaze Patterns for Implicit and Explicit Audio-Visual Speech Synchrony Detection in Children...

Area of Science:

• Neuroscience
• Developmental Psychology
• Speech Perception

Background:

• Effective communication relies on integrating auditory and visual speech cues.
• Individuals with autism spectrum disorder (ASD) may exhibit atypical multisensory integration.
• Previous research suggests ASD individuals prefer looking at the mouth, but integration efficiency is unclear.

Purpose of the Study:

• To investigate auditory-visual speech integration in individuals with and without high-functioning autism (HFA).
• To examine how explicit instructions affect visual attention during speech perception tasks.
• To compare gaze patterns, particularly towards the mouth, between HFA and typically developing (TD) groups.

Main Methods:

• Participants (8-19 years) viewed split-screen videos of synchronized and unsynchronized speech.
• Two conditions were used: implicit (no instructions) and explicit (watch the in-sync speaker).
• Eye-tracking technology recorded participants' gaze behavior, focusing on screen and facial regions.

Main Results:

• Both groups increased attention to the in-sync speaker with explicit instructions.
• HFA participants showed less overall attention to the in-sync speaker compared to TD peers.
• The HFA group gazed significantly less at the mouth and more at non-face areas than the TD group.

Conclusions:

• Individuals with HFA demonstrate maladaptive gaze behavior during auditory-visual speech integration.
• Reduced visual attention to the mouth region in HFA may impair speech processing.
• Findings highlight differences in multisensory integration strategies between HFA and TD individuals.