Related Experiment Video
Updated: Jul 22, 2026
12:43
A Protocol for Comprehensive Assessment of Bulbar Dysfunction in Amyotrophic Lateral Sclerosis (ALS)
Published on: February 22, 2011
Visual speech speeds up the neural processing of auditory speech
Virginie van Wassenhove1, Ken W Grant, David Poeppel
1Neuroscience and Cognitive Science Program and Department of Biology, University of Maryland, College Park, MD 20742, USA.
Summary
Visual speech significantly accelerates auditory speech processing within 100 ms by influencing neural activity. This audiovisual integration suggests predictive internal representations guide speech perception.
Area of Science:
- Neuroscience
- Cognitive Science
- Auditory and Visual Perception
Background:
- Multisensory integration enhances perception, particularly auditory speech with visual cues.
- The precise timing and location of audiovisual speech representation remain debated.
- Sensory-specific cortices may process cross-modal information.
Purpose of the Study:
- To investigate the temporal dynamics of audiovisual speech integration.
- To determine when and where audiovisual speech representations emerge in the brain.
- To explore the neural mechanisms underlying audiovisual speech perception.
Main Methods:
- Combined psychophysical and electroencephalography (EEG) experiments.
- Analysis of neural responses to synchronized auditory and visual speech stimuli.
- Quantification of temporal facilitation and amplitude modulation in auditory processing.
Main Results:
- Visual speech significantly speeds up cortical processing of auditory signals (<100 ms).
- Audiovisual interaction shows articulator-specific temporal facilitation and amplitude reduction.
- Facilitation latency correlates with the predictive power of visual speech for auditory targets.
Conclusions:
- Audiovisual speech perception involves early cortical interactions, not just late integration.
- Abstract internal representations constrain auditory speech analysis, supporting an 'analysis-by-synthesis' model.
- Visual information provides predictive cues that enhance auditory speech processing speed.
More Related Videos
Related Concept Videos
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:20Parallel Processing
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...