Related Experiment Video
Updated: Jun 18, 2026
13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization
Sebastian Werner1, Uta Noppeney
1Max Planck Institute for Biological Cybernetics, 72076 Tübingen, Germany. sebastian.werner@tuebingen.mpg.de
Cerebral Cortex (New York, N.Y. : 1991)
|November 20, 2009
Summary
Multisensory integration combines information from different senses for a clearer perception. This study reveals that audiovisual integration occurs in the superior temporal sulci (STS), with interactions varying based on stimulus clarity and individual benefit.
Area of Science:
- Neuroscience
- Cognitive Science
- Sensory Processing
Background:
- The brain integrates multisensory information for robust environmental perception.
- The precise neural mechanisms and locations for high-level audiovisual integration remain largely unknown.
- Understanding audiovisual integration is crucial for explaining how we perceive the world.
Purpose of the Study:
- To investigate the neural mechanisms of audiovisual object feature integration.
- To identify specific brain regions involved in combining auditory and visual information.
- To explore how stimulus informativeness and behavioral benefit influence multisensory interactions.
Main Methods:
- Functional magnetic resonance imaging (fMRI) combined with psychophysical tasks.
- Manipulation of auditory and visual stimulus informativeness (degradation).
- Analysis of neural activity in the superior temporal sulci (STS) during audiovisual perception.
Main Results:
- Higher-level audiovisual integration was selectively identified in the bilateral superior temporal sulci (STS).
- Multisensory interactions were subadditive/suppressive for intact stimuli but additive for degraded stimuli.
- Individual behavioral benefits from multisensory integration predicted integration profiles in STS (superadditive vs. suppressive).
Conclusions:
- The superior temporal sulci (STS) are key areas for high-level audiovisual integration.
- Integration profiles (superadditive/subadditive) in STS are functionally relevant and linked to behavioral outcomes.
- Superadditive interactions in STS mediate successful audiovisual object categorization.
More Related Videos
Related Concept Videos
01:14Motor and Sensory Areas of the Cortex
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
01:21Association Areas of the Cortex
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:23Somatosensory, Motor, and Association Cortex
The somatosensory cortex in the parietal lobes is crucial for interpreting sensory data such as touch, temperature, and proprioception. The somatosensory cortex, situated in the parietal lobes, plays a vital role in interpreting sensory information like touch, temperature, and proprioception—awareness of body position. This specialized brain region features an organized structure wherein neurons at the top primarily process sensations originating from the lower body. In contrast, those at the...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...