Related Experiment Video
Updated: Mar 6, 2026
13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
20.6K
Echoes of the mind's eye: Reciprocal crossmodal interaction between auditory and visual processing
Xiaoyu Tang1,2, Ting Zhang1, Jiaying Sun1
1School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian 116029, China.
Iscience
|March 5, 2026
Summary
Visual input initially suppresses auditory processing, but attention later facilitates crossmodal integration. This competitive-facilitative framework reveals temporal dynamics in how the brain combines sensory information.
Area of Science:
- Neuroscience
- Cognitive Science
- Sensory Integration
Background:
- Understanding crossmodal integration is crucial for cognitive neuroscience.
- Auditory-visual interactions are complex, involving both reciprocal and asymmetric temporal dynamics.
Purpose of the Study:
- To investigate the temporal mechanisms of auditory-visual interactions during spatial attention.
- To explore how visual input influences auditory processing and vice versa.
Main Methods:
- High-density electroencephalography (EEG) was employed during an auditory spatial attention task.
- Participants performed an auditory-only (A) and an audiovisual (AV) condition with a task-irrelevant central visual stimulus.
- Analysis focused on event-related potentials, sensory bias, and functional connectivity.
Main Results:
- Visual input suppressed auditory processing, indicated by reduced selection negativity (220-320 ms) and attenuated auditory contralateral occipital positivity (ACOP, 300-500 ms).
- Attention-dependent auditory-to-visual cross-modal attentional spreading was observed over occipital (300-600 ms) and centro-parietal (500-600 ms) regions.
- Fronto-temporal connectivity was also attenuated by visual input.
Conclusions:
- A competitive-facilitative framework explains crossmodal integration, where initial suppression is followed by goal-driven facilitation.
- These findings provide critical temporal constraints for computational and neurocognitive models of sensory integration.
- The study highlights the dynamic interplay between stimulus-driven and attention-driven processes in multisensory environments.
Related Concept Videos
01:20Parallel Processing
839
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
839
01:17Auditory Perception
1.4K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.4K
01:24Vision
60.9K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
60.9K
01:26Visual System
2.2K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
2.2K
01:15Auditory Pathway
8.2K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
8.2K
01:12Visual Agnosia
1.5K
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
1.5K