Related Experiment Video
Updated: Mar 22, 2026
09:13
Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
Published on: April 22, 2015
17.3K
Audio Visual Integration with Competing Sources in the Framework of Audio Visual Speech Scene Analysis
Attigodu Chandrashekara Ganesh1, Frédéric Berthommier2, Jean-Luc Schwartz2
1Grenoble Images Parole Signal Automatique-Lab, Speech and Cognition Department, CNRS, Grenoble University, UMR 5216, Grenoble, France. ganesh.attigodu@gipsa-lab.grenoble-inp.fr.
Advances in Experimental Medicine and Biology
|April 16, 2016
Summary
Audio-Visual Speech Scene Analysis (AVSSA) explains how our brains combine sights and sounds. Competing audiovisual cues influence speech perception, with attention playing a key role in how we process mixed audio-visual information.
Area of Science:
- Multisensory perception
- Auditory scene analysis
- Speech processing
Background:
- The Auditory Scene Analysis (ASA) model explains how we segregate sound sources.
- Extending ASA to audiovisual scenes requires understanding how auditory and visual information are integrated.
Purpose of the Study:
- To investigate the Audio-Visual Speech Scene Analysis (AVSSA) model.
- To examine how competing audiovisual sources affect speech perception, specifically the McGurk effect.
- To explore the role of attention in audiovisual binding.
Main Methods:
- Participants were presented with competing audiovisual sources with varying coherence.
- The McGurk effect was measured following these contexts.
- A second experiment manipulated attentional focus on one of the competing sources.
Main Results:
- Audiovisual coherence in preceding contexts modulated the McGurk effect.
- Lower audiovisual coherence in a competing source led to a reduced McGurk effect.
- Attentional focus significantly influenced the degree of audiovisual fusion.
Conclusions:
- The AVSSA model provides a framework for understanding audiovisual scene analysis.
- Audiovisual binding is influenced by the coherence of competing sensory inputs.
- Attention plays a critical role in selecting and integrating audiovisual information for speech perception.
More Related Videos
Related Concept Videos
01:17Auditory Perception
1.4K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.4K
01:10Interference: Path Lengths
2.4K
Consider two sources of sound, that may or may not be in phase, emitting waves at a single frequency, and consider the frequencies to be the same.
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
2.4K
00:53Sound Waves: Interference
5.1K
Sound waves can be modeled either as longitudinal waves, wherein the molecules of the medium oscillate around an equilibrium position, or as pressure waves. When two identical waves from the same source superimpose on each other, the combination of two crests or two troughs results in amplitude reinforcement known as constructive interference. If two identical waves, that are initially in phase, become out of phase because of different path lengths, the combination of crests with troughs...
5.1K
01:26Visual System
2.2K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
2.2K
01:21Perceiving Loudness, Pitch, and Location
1.3K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.3K
00:58¹H NMR Signal Integration: Overview
4.0K
The intensity of a signal, which can be represented by the area under the peak, depends on the number of protons contributing to that signal. The area under each peak is shown as a vertical line called an integral, with the integral value listed under it, as seen in the proton NMR spectrum of benzyl acetate. Each integral value is divided by the smallest integral value to obtain the ratio of the number of protons producing each signal. The ratio reveals the relative number of protons and not...
4.0K