Related Experiment Video
Updated: Jun 23, 2026
06:07
Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm
Published on: May 15, 2019
Comparing infants' preference for correlated audiovisual speech with signal-level computational models
George Hollich1, Christopher G Prince
1Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, USA. ghollich@purdue.edu
Developmental Science
|April 18, 2009
Summary
Computational models analyzing audiovisual stimuli can explain significant infant looking behavior. This research compares infant responses to models using only visual motion versus those integrating audio-visual signals.
Area of Science:
- Developmental Psychology
- Computational Neuroscience
- Infant Cognition
Background:
- Understanding infant behavior is crucial for developmental psychology.
- Previous models often focused on single sensory modalities.
- The role of audiovisual integration in early development is an active research area.
Purpose of the Study:
- To quantify how well signal-level analyses of stimuli predict infant behavior.
- To compare the predictive power of visual-only models versus audiovisual integration models.
- To investigate the moment-by-moment looking behavior of 8-month-old infants.
Main Methods:
- Utilized an audiovisual preferential looking task with 8-month-old infants.
- Developed computational models using the same video stimuli presented to infants.
- One model focused on signal-level properties of visual motion.
- Another model incorporated audiovisual integration (correlation or instantaneous addition).
Main Results:
- Computational models accounted for a significant portion of the variance in infant looking.
- Models incorporating audiovisual integration showed improved prediction of infant behavior compared to visual-only models.
- Direct comparison of moment-by-moment infant behavior with model outputs was performed.
Conclusions:
- Signal-level analyses, particularly with audiovisual integration, can significantly explain infant looking behavior.
- This suggests that infants process and integrate multiple sensory streams from early in development.
- The findings provide a computational framework for understanding early audiovisual perception.
Related Concept Videos
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:22Language Development
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:24Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...