Related Experiment Videos
Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological
1INSERM-U280, 151, Cours Albert Thomas, F-69424 Lyon Cedex 03, FRANCE. giard@lyon151.inserm.fr
Journal of Cognitive Neuroscience
|October 8, 1999
Summary
Human object recognition improves with multisensory integration, combining sight and sound. This study used event-related potentials (ERPs) to show early brain interactions in visual and auditory cortices, demonstrating flexible multisensory processing.
Area of Science:
- Cognitive Neuroscience
- Human Perception
- Sensory Integration
Background:
- Multisensory integration enhances object recognition.
- Understanding the neural basis of multisensory interactions is crucial.
Purpose of the Study:
- Provide behavioral evidence for multimodal feature integration in human object recognition.
- Characterize the processing stages and neural structures involved in multisensory interactions.
Main Methods:
- Recorded event-related potentials (ERPs) from 30 scalp electrodes.
- Subjects performed a forced-choice reaction-time object categorization task using unimodal (auditory or visual) or multimodal stimuli.
- Analyzed spatiotemporal ERPs and scalp current densities.
Main Results:
- Subjects were more accurate and faster at identifying multimodal objects compared to unimodal objects.
- Auditory-visual interactions were observed as early as 40 msec poststimulus in visual areas and around 90-110 msec in the auditory cortex.
- New neural activity was detected over the right fronto-temporal area between 140-165 msec.
- Integration effects differed in sensory-specific cortices based on dominant modality, but were similar in fronto-temporal areas.
Conclusions:
- Multisensory integration is a flexible and adaptive process occurring early in sensory processing.
- Neural mechanisms involve both sensory-specific cortices and nonspecific fronto-temporal structures.
- These processes dynamically adapt based on individual sensory dominance.