Related Experiment Video
Updated: Jun 27, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Multimodal motion processing in area V5/MT: evidence from an artificial class of audio-visual events
Lukas Scheef1, Henning Boecker, Marcel Daamen
1Department of Radiology, University of Bonn, Germany. Lukas.Scheef@ukb.uni-bonn.de
This study shows that concordant audio-visual stimuli enhance brain activity in the V5/MT area, crucial for motion integration. This finding supports the role of audio-visual integration in perception and has implications for motor learning.
Area of Science:
- Neuroscience
- Auditory-Visual Integration
- Human Brain Imaging
Background:
- Audio-visual integration impacts perception and motor task precision.
- The V5/MT area is known for visual motion processing.
Purpose of the Study:
- To investigate audio-visual integration during height estimation using functional magnetic resonance imaging (fMRI).
- To explore the neural basis of concordant audio-visual stimuli processing in the V5/MT area.
Main Methods:
- Utilized sparse sampling fMRI at 3T to study brain activity.
- Employed "sonification" to create artificial auditory-visual motion events from counter movement jumps.
- Compared four conditions: unimodal visual, unimodal auditory, concordant auditory-visual, and discordant auditory-visual stimuli.
Main Results:
- Unimodal stimuli activated primary visual and auditory cortices as expected.
- Concordant audio-visual stimuli showed enhanced activation in the bilateral V5/MT area compared to unimodal stimuli.
- This enhancement was specific to the concordant bimodal condition, not the discordant one.
Conclusions:
- The V5/MT area is modulated by concordant auditory input, demonstrating its role in multimodal motion integration.
- This suggests artificial auditory stimuli can influence visual motion processing, supporting behavioral observations.
- Findings may inform applications in motor learning and rehabilitation.
Related Concept Videos
Absolute Motion Analysis- General Plane Motion
As the drone's propellers rotate, an upward force is generated that counteracts the force of gravity, enabling the drone to lift off from the ground. This initial movement of the drone is along a straight path, representing a form of translational motion. In this phase, every point on the drone...
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Motor and Sensory Areas of the Cortex
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex.
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Relative Motion Analysis using Rotating Axes
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...

