Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

The Vestibular System01:29

The Vestibular System

40.3K
The vestibular system is a set of inner ear structures that provide a sense of balance and spatial orientation. This system is comprised of structures within the labyrinth of the inner ear, including the cochlea and two otolith organs—the utricle and saccule. The labyrinth also contains three semicircular canals—superior, posterior, and horizontal—that are oriented on different planes.
40.3K
Major Somatic Sensory Pathways01:28

Major Somatic Sensory Pathways

1.3K
Sensory impulses related to touch, pressure, vibration, and proprioception from various body parts, such as the limbs, trunk, neck, and posterior head, travel to the cerebral cortex through the posterior column-medial lemniscus pathway. The pathway’s name derives from the two white-matter tracts that convey the impulses: the spinal cord's posterior column and the brainstem's medial lemniscus. First-order sensory neurons extend their axons into the spinal cord, forming the...
1.3K
Equilibrium and Balance01:15

Equilibrium and Balance

5.1K
The inner ear assumes dual functionalities of auditory perception and equilibrium maintenance. The vestibule is the organ responsible for balance. This organ contains mechanoreceptors, specifically hair cells, endowed with stereocilia, which aid in deciphering information regarding the position and motion of our heads. Two intrinsic components, the utricle and saccule, help perceive head position, while the semicircular canals track head movement. Neurological messages initiated in the...
5.1K
Motor and Sensory Areas of the Cortex01:14

Motor and Sensory Areas of the Cortex

4.8K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor cortex....
4.8K
Auditory Perception01:17

Auditory Perception

614
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
614
Perception of Sound Waves01:01

Perception of Sound Waves

4.7K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Reframing neuroergonomics in an evolutionary and active inference context.

Frontiers in neuroergonomics·2026
Same author

Changing Sensory Eye Dominance With Theta Burst Stimulation Over Visual Cortex.

Neuromodulation : journal of the International Neuromodulation Society·2026
Same author

Sequence-dependent effects of iTBS and perceptual learning on binocular balance.

Cortex; a journal devoted to the study of the nervous system and behavior·2026
Same author

Mitigating age-related stereo decline with perceptual training.

iScience·2026
Same author

Retinal-Specificity of Sensory Eye Dominance and Its Learning-Induced Improvements.

Investigative ophthalmology & visual science·2026
Same author

Toward Neuroergonomic Attention Assistance: Neural Signatures of Haptic-Driven Modulations in Multimodal Cueing.

IEEE transactions on haptics·2026

Related Experiment Video

Updated: Sep 24, 2025

MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions
09:46

MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions

Published on: May 10, 2012

12.8K

Sound-modulations of visual motion perception implicate the cortico-vestibular brain.

Dorita H F Chang1, David Thinnes2, Pak Yam Au1

  • 1Department of Psychology and The State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong.

Neuroimage
|May 10, 2022
PubMed
Summary

This study explores how sounds change how we perceive visual motion. By using brain imaging and behavioral tests, researchers found that specific brain areas, including the insular cortex, help us combine sight and sound to make sense of ambiguous motion.

Keywords:
Audiovisual bounce-inducing effectAuditionCausal perceptionMultisensory perceptionVisionmultisensory integrationfMRI neuroimagingposterior parietal cortexinsular cortex

Frequently Asked Questions

More Related Videos

Estimating Vestibular Perceptual Thresholds Using a Six-Degree-Of-Freedom Motion Platform
06:31

Estimating Vestibular Perceptual Thresholds Using a Six-Degree-Of-Freedom Motion Platform

Published on: August 4, 2022

3.2K
Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns
09:42

Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns

Published on: May 12, 2019

6.1K

Related Experiment Videos

Last Updated: Sep 24, 2025

MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions
09:46

MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions

Published on: May 10, 2012

12.8K
Estimating Vestibular Perceptual Thresholds Using a Six-Degree-Of-Freedom Motion Platform
06:31

Estimating Vestibular Perceptual Thresholds Using a Six-Degree-Of-Freedom Motion Platform

Published on: August 4, 2022

3.2K
Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns
09:42

Stimulus-specific Cortical Visual Evoked Potential Morphological Patterns

Published on: May 12, 2019

6.1K

Area of Science:

  • Neuroscience of multisensory integration within the cortico-vestibular brain
  • Cognitive psychology and behavioral neurology

Background:

No prior work had resolved the exact neurological basis for how auditory cues influence visual motion interpretation. The audiovisual bounce inducing effect remains a classic example of complex sensory signal interaction. Prior research has shown that identical objects moving toward each other create ambiguous perceptual outcomes. That uncertainty drove scientists to investigate whether simple attention explains these observations. It was already known that transient sounds presented during object overlap shift how observers interpret movement. This gap motivated a deeper look into the underlying neural architecture. Previous studies often dismissed these findings as mere decision-making artifacts. Researchers now seek to clarify the specific cortical regions involved in this multisensory phenomenon.

Purpose Of The Study:

The study aims to clarify the neurological underpinnings of the audiovisual bounce inducing effect. Researchers sought to determine if this phenomenon relies on more than simple attentional or decision-making processes. This investigation addresses the long-standing ambiguity regarding how the brain integrates multisensory signals. The team examined whether sound-induced modulations of motion perception change with varying visual target dynamics. They intended to map the specific cortical regions involved in resolving these perceptual challenges. This work addresses the need for a better understanding of sensory processing in the human brain. The authors aimed to provide evidence for the involvement of the parieto-insular-vestibular complex. The project focuses on how the brain derives probabilistic solutions from conflicting visual and auditory inputs.

Main Methods:

The research team employed a concurrent behavioral and neuroimaging approach to examine sensory processing. They utilized event-related functional magnetic resonance imaging to capture real-time neural responses. Participants viewed objects moving along the azimuth while receiving auditory cues. The design varied motion dynamics to test the robustness of perceptual shifts. Statistical analysis linked brain activation patterns directly to the reported behavioral outcomes. This methodology allowed for the precise mapping of cortical engagement during multisensory tasks. The investigators focused on identifying specific regions that correlate with perceptual ambiguity resolution. This rigorous framework ensured that neural data remained synchronized with the observed human performance.

Main Results:

The researchers discovered that sound-induced modulations of motion perception are significantly influenced by changing the dynamics of visual targets. Activity within the posterior parietal cortex showed a strong correspondence with the behavioral responses of the subjects. The parieto-insular-vestibular cortical complex exhibited distinct activation patterns during the processing of multisensory signals. These findings indicate that the insular cortex participates in deriving probabilistic solutions from integrated data. The study confirms that auditory stimuli effectively shift the interpretation of ambiguous visual motion trajectories. Neural data revealed that these cortical areas are active when observers resolve conflicting sensory information. The results demonstrate a clear link between specific brain regions and the perceptual interpretation of moving objects. This investigation provides evidence that multisensory integration involves complex cortical networks rather than simple attentional mechanisms.

Conclusions:

The authors propose that the insular cortex helps derive probabilistic solutions during multisensory integration. Their data suggest that auditory signals modify visual motion perception through specific cortical pathways. The study links activity in the posterior parietal cortex to observed behavioral changes. These results imply that the parieto-insular-vestibular complex plays a role in sensory interpretation. The researchers conclude that sound-induced modulations depend on the underlying motion dynamics of visual targets. This work shifts the understanding of the effect away from simple attentional mechanisms. The findings highlight the importance of the vestibular system in processing ambiguous visual information. The authors suggest that multisensory data integration occurs through these identified cortical networks.

The researchers propose that auditory signals modulate visual motion perception by engaging the posterior parietal cortex and the parieto-insular-vestibular cortical complex to resolve ambiguous sensory inputs.

The study utilizes event-related functional magnetic resonance imaging (fMRI) to map brain activity while participants perform behavioral tasks involving moving visual targets.

The authors state that the parieto-insular-vestibular cortical complex is necessary to integrate multisensory data, as activity in these specific regions closely mirrors the behavioral responses observed in participants.

Behavioral metrics provide the necessary quantitative data to correlate individual perceptual shifts with the corresponding neural activation patterns recorded during the fMRI sessions.

The researchers measure the modulation of motion perception by varying the dynamics of visual targets in the presence or absence of transient auditory stimuli.

The authors suggest that the insular cortex functions as a hub for probabilistic perceptual solutions, which challenges previous assumptions that the effect is driven solely by basic decision-making processes.