Related Experiment Video
Updated: Oct 16, 2025
06:07
Exploring Infant Sensitivity to Visual Language using Eye Tracking and the Preferential Looking Paradigm
Published on: May 15, 2019
8.6K
Expectations about dynamic visual objects facilitates early sensory processing of congruent sounds.
Andrew Marin1, Viola S Störmer2, Leslie J Carver1
1University of California, San Diego (UCSD), Psychology Department, La Jolla, CA, USA.
Summary
Visual motion creates sound expectations, influencing early auditory processing. Synchronous audio-visual events show faster, weaker auditory responses, demonstrating how vision primes hearing.
Area of Science:
- Neuroscience
- Auditory Perception
- Multisensory Integration
Background:
- Visual perception of motion can predict upcoming sounds.
- The influence of visual expectations on early auditory processing is not well understood.
- Investigating how dynamic visual stimuli shape auditory event-related potentials.
Purpose of the Study:
- To examine how visual motion influences early auditory processing.
- To determine if visual expectations affect auditory responses to congruent or incongruent sounds.
- To explore the roles of expectancy and multisensory integration in this cross-modal influence.
Main Methods:
- Electroencephalogram (EEG) recorded from adult participants.
- Participants passively viewed a moving ball and heard sounds.
- Conditions included audio-visual synchronous, asynchronous, occluded, and audio-only trials.
Main Results:
- Audio-visual synchronous sounds elicited earlier and attenuated auditory responses compared to asynchronous or audio-only sounds.
- An expected sound during visual occlusion (AV-occluded condition) produced similar auditory responses to AV-synchronous events.
- Dynamic visual stimuli generate expectations about sound timing, facilitating auditory processing.
Conclusions:
- Visual motion perception primes auditory processing by creating expectations.
- These visual expectations modulate early auditory-evoked potentials.
- Multisensory integration, driven by expectancy, plays a key role in cross-modal influences on perception.
Related Concept Videos
01:01Perception of Sound Waves
4.8K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.8K
01:17Auditory Perception
662
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
662
01:31Hearing
54.0K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
54.0K
01:21Perceiving Loudness, Pitch, and Location
539
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
539
01:21Gestalt Principles of Perception
641
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
641
01:12Perceptual Constancy
697
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
697