Related Experiment Video
Updated: Aug 10, 2026
04:43
Visualizing Visual Adaptation
Published on: April 24, 2017
Visual recalibration and selective adaptation in auditory-visual speech perception: Contrasting build-up courses
Jean Vroomen1, Sabine van Linden, Béatrice de Gelder
1Department of Psychology, Tilburg University, The Netherlands.
Neuropsychologia
|March 15, 2006
Summary
Visual speech exposure influences auditory speech perception. Incongruent visual speech recalibrates auditory perception, while congruent speech causes adaptation, with effects varying based on presentation numbers.
Area of Science:
- Auditory perception
- Visual perception
- Speech processing
- Multisensory integration
Background:
- Bimodal speech exposure can alter auditory speech identification.
- Earlier research showed visual recalibration with incongruent stimuli and adaptation with congruent stimuli.
Purpose of the Study:
- To investigate the temporal dynamics of after-effects from bimodal speech exposure.
- To compare the build-up of after-effects from congruent versus incongruent audiovisual speech stimuli.
Main Methods:
- Participants were exposed to bimodal audiovisual speech stimuli.
- Two types of adapters were used: ambiguous incongruent and non-ambiguous congruent stimuli.
- The number of adapter presentations ranged from 1 to 256.
Main Results:
- After-effects from non-ambiguous congruent adapters showed a monotonic increase with presentations.
- After-effects from ambiguous incongruent adapters exhibited a curvilinear pattern (increase then decrease).
Conclusions:
- The build-up of after-effects differs between congruent and incongruent audiovisual speech.
- These findings suggest an asynchronous interaction between recalibration and selective adaptation processes in speech perception.
Related Concept Videos
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...