Related Experiment Videos
The time-course of intermodal binding between seeing and hearing affective information
G Pourtois1, B de Gelder, J Vroomen
1Cognitive Neuroscience Laboratory, Tilburg University, The Netherlands.
Neuroreport
|May 19, 2000
Summary
Audiovisual integration, the binding of seen and heard information, occurs rapidly (within 110 ms). This early integration enhances auditory neural activity, influenced by the content from both sensory inputs.
Area of Science:
- Neuroscience
- Cognitive Science
- Psychology
Background:
- Intermodal binding of affective information from visual and auditory stimuli necessitates audiovisual integration.
- Understanding the temporal dynamics of this audiovisual binding is crucial for cognitive neuroscience.
Purpose of the Study:
- To investigate the time course of audiovisual binding for affective information.
- To determine the neural correlates of early audiovisual integration.
Main Methods:
- Event-related brain potentials (ERPs) were recorded.
- Subjects viewed facial expressions while concurrently hearing auditory fragments.
Main Results:
- Audiovisual binding was observed early, at 110 ms post-stimulus.
- A significant enhancement in the amplitude of the auditory 'N1' component was detected.
- Findings align with prior neuroimaging and electrophysiological studies on audiovisual speech and early interactions.
Conclusions:
- The integration of visual and auditory affective information is an early and mandatory process.
- The informational content from both modalities critically influences the initiation of intermodal binding.