Related Experiment Video
Updated: Jun 28, 2026
13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
19.9K
Higher Order Visual Location Learning Does Not Explain Multisensory Enhancement of Sound Localization (Reply to
Patrick Bruns1, Hubert R Dinse2, Brigitte Röder1,3
1Biological Psychology and Neuropsychology, University of Hamburg, Hamburg, Germany.
The European Journal of Neuroscience
|April 30, 2025
Summary
Distinct neural mechanisms underlie multisensory enhancement (ME) and the ventriloquism aftereffect (VAE). A control experiment confirmed that visual learning alone does not explain the ME, supporting separate brain processes for these audiovisual phenomena.
Area of Science:
- Neuroscience
- Auditory Perception
- Multisensory Integration
Background:
- Multisensory enhancement (ME) and ventriloquism aftereffect (VAE) are influenced by audiovisual stimulus frequency.
- Previous findings suggest distinct neural mechanisms for ME and VAE based on frequency-dependent effects.
Purpose of the Study:
- To test the alternative explanation that higher-order visual learning or general reliability accounts for spared ME under specific stimulation frequencies.
- To further investigate the dissociable neural mechanisms underlying ME and VAE.
Main Methods:
- A control experiment involving unimodal visual stimulation at loudspeaker locations was conducted.
- Participants localized sounds before and after visual exposure.
- Auditory localization errors were measured to assess the impact of visual stimulation.
Main Results:
- Unimodal visual stimulation did not significantly reduce auditory localization errors.
- This finding indicates that higher-order visual location learning is insufficient to explain the previously observed ME after audiovisual exposure.
- The results support the conclusion of distinct neural substrates for ME and VAE.
Conclusions:
- Higher-order visual learning does not sufficiently explain multisensory enhancement (ME).
- The findings reinforce the concept of dissociable neural mechanisms underlying ME and the ventriloquism aftereffect (VAE).
- Distinct neural pathways are likely involved in processing audiovisual spatial information for ME and VAE.
Related Concept Videos
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:11Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...