Related Experiment Video
Updated: May 24, 2026
10:50
Functional Imaging of Auditory Cortex in Adult Cats using High-field fMRI
Published on: February 19, 2014
When a photograph can be heard: vision activates the auditory cortex within 110 ms
Alice Mado Proverbio1, Guido Edoardo D'Aniello, Roberta Adorni
1Department of Psychology, University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy. mado.proverbio@unimib.it
Scientific Reports
|February 23, 2012
Summary
Seeing images linked to sounds activates the brain's auditory cortex, even without actual sound. This visual-auditory association occurs rapidly, demonstrating how our brains process sensory information.
Area of Science:
- Neuroscience
- Auditory Perception
- Cognitive Psychology
Background:
- The human brain can evoke sensory experiences without direct stimulation, as seen in silent films.
- Visual cues can trigger associated auditory perceptions, suggesting cross-modal brain activation.
Purpose of the Study:
- To investigate if visual stimuli associated with sounds activate the auditory cortex.
- To determine the timing and brain regions involved in visually evoked auditory processing.
Main Methods:
- High-density electroencephalography (ERPs) were used to record brain activity in 15 participants.
- Participants viewed perceptually matched images, some associated with sounds and others not.
- SwLORETA (Standardized Low-Resolution Electromagnetic Tomography) was employed for source localization of brain activity.
Main Results:
- Brain activity associated with sound stimuli was detected as early as 110 milliseconds (ms).
- Ventral stream areas showed common activation for both visual and sound-associated visual stimuli.
- The associative temporal cortex was activated by sound-associated images from the earliest stage.
- The primary auditory cortex (BA41) was activated by sound images around 200 ms.
Conclusions:
- The mere sight of an image associated with a sound can activate the auditory cortex.
- This activation occurs rapidly, indicating an efficient visual-to-auditory processing pathway.
- Findings support the concept of cross-modal integration in sensory processing.
Related Concept Videos
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:24Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
01:14Motor and Sensory Areas of the Cortex
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
01:21Association Areas of the Cortex
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...