Related Experiment Video
Updated: Dec 21, 2025
Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm
Published on: May 15, 2019
Neural signatures of face-voice synchrony in 5-month-old human infants
Daniel C Hyde1, Blake L Jones, Ross Flom
1Department of Psychology, Harvard University, Cambridge, MA 02138, USA. dchyde@fas.harvard.edu
Insights
Infants process audio-visual speech synchrony using early brain responses. Their brains show a bias towards synchronous speech, indicating early sensory integration and familiarity with temporal alignment.
Area of Science:
- Developmental Neuroscience
- Cognitive Neuroscience
- Auditory Perception
Background:
- Infants integrate multisensory information, crucial for social learning.
- Temporal synchrony is vital for audio-visual speech perception in infants.
- Limited research exists on infant brain processing of temporal synchrony.
Purpose of the Study:
- To investigate event-related brain potentials (ERPs) associated with synchronous and asynchronous audio-visual speech in infants.
- To determine if audio-visual integration in infants occurs during early sensory or later cognitive processing.
- To explore potential differences in infant and adult brain responses to temporal synchrony.
Main Methods:
- Two experiments using event-related brain potentials (ERPs) were conducted.
- Infants were presented with synchronous and asynchronous audio-visual speech stimuli.
- Specific ERP components (P2, Nc, N1, PSW) were analyzed.
Main Results:
- Synchronous audio-visual speech elicited a larger early auditory P2 response.
- Asynchronous speech resulted in a larger later attentional processing (Nc) response.
- Dynamic stimuli showed an enhanced early visual N1 for asynchronous and a later memory-related slow wave (PSW) for synchronous speech.
Conclusions:
- Audio-visual speech integration in infants begins early in sensory processing, similar to adults.
- Infant brain responses appear biased towards temporal synchrony, differing from adult patterns.
- Attentional and memory processing findings align with behavioral observations of infant familiarity with synchrony.
Abstract:
Infants' unitary perception of their multisensory world, including learning from people (faces and speech), hinges on temporal synchrony. Despite its importance, relatively little work has investigated the brain processes involved in infants' perception of temporal synchrony. In two experiments, we examined event-related brain potentials (ERPs) to asynchronous and synchronous audio-visual speech in infants. Both experiments showed the early auditory P2 was greater for the synchronously presented pairings and later attentional processing (Nc) was greater for asynchronous pairings. In addition, dynamic stimuli used in Experiment 2 produced a greater early visual response (N1) to the asynchronous condition and an enhanced memory-related slow wave (PSW) later for the synchronous condition. These results suggest that, like adults, auditory-visual integration for young infants begins early during sensory processing rather than later during higher-level cognitive processing. However, unlike adults, infants' brain responses may be biased towards synchrony. Furthermore, effects of attentional and memory processing confirm interpretations of behavioral looking patterns suggesting infants find synchrony more familiar.
