Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

873
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
873
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

796
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
796
Perception of Sound Waves01:01

Perception of Sound Waves

5.3K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.3K
Depth Perception and Spatial Vision01:15

Depth Perception and Spatial Vision

1.6K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
1.6K
Auditory Pathway01:15

Auditory Pathway

6.8K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
6.8K
Visual Agnosia01:12

Visual Agnosia

723
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
723

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Portable electrolyte-gated organic field-effect transistor platform for enabling ultrasensitive and rapid detection of hepatitis B and C.

Biosensors & bioelectronics·2026
Same author

Fixation and saccadic performance throughout childhood in children born preterm: A multicenter eye-tracking study.

Pediatric research·2026
Same author

Uncoupling of nutrient sensing and cell size control by specific defects in ceramide structure.

Biology open·2026
Same author

Intravenous Thrombolysis at Primary Stroke Centers Versus Comprehensive Stroke Centers: Analysis From the AcT Trial.

The Canadian journal of neurological sciences. Le journal canadien des sciences neurologiques·2026
Same author

Overdriving Visual Depth Perception via Sound Modulation in VR.

IEEE transactions on visualization and computer graphics·2026
Same author

CertPrime: a new oligonucleotide design tool for gene synthesis.

Computational and structural biotechnology journal·2025

Related Experiment Video

Updated: Dec 14, 2025

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
05:43

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

Published on: May 23, 2019

5.8K

Auditory stimuli degrade visual performance in virtual reality.

Sandra Malpica1, Ana Serrano2, Diego Gutierrez2

  • 1Universidad de Zaragoza, I3A, 50018, Zaragoza, Spain. smalpica@unizar.es.

Scientific Reports
|July 25, 2020
PubMed
Summary
This summary is machine-generated.

Auditory stimuli can impair visual performance in virtual reality (VR). Spatially incongruent sounds degrade visual detection and recognition, suggesting neural interactions, not eye movements, are the cause.

More Related Videos

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.8K
Stereoacuity Improvement using Random-Dot Video Games
06:25

Stereoacuity Improvement using Random-Dot Video Games

Published on: January 14, 2020

14.9K

Related Experiment Videos

Last Updated: Dec 14, 2025

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
05:43

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

Published on: May 23, 2019

5.8K
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.8K
Stereoacuity Improvement using Random-Dot Video Games
06:25

Stereoacuity Improvement using Random-Dot Video Games

Published on: January 14, 2020

14.9K

Area of Science:

  • Virtual Reality (VR) and Auditory Perception
  • Human-Computer Interaction
  • Cognitive Neuroscience

Background:

  • Virtual reality (VR) environments offer unique settings for studying sensory interactions.
  • Previous research has explored multisensory integration, but VR-specific auditory-visual effects require further investigation.
  • Understanding how auditory stimuli influence visual processing in VR is crucial for designing immersive and effective experiences.

Purpose of the Study:

  • To investigate the impact of auditory stimuli on visual performance within a virtual reality (VR) setting.
  • To determine if temporally congruent but spatially incongruent sounds degrade visual detection and recognition.
  • To explore the underlying mechanisms, differentiating between oculomotor and neural/attentional factors.

Main Methods:

  • Participants performed visual detection and recognition tasks in a VR environment.
  • Temporally congruent but spatially incongruent auditory stimuli were presented alongside visual stimuli.
  • Eye-tracking technology was employed to monitor participants' gaze behavior.
  • The robustness of the effect was tested across various auditory and visual stimulus types and locations.

Main Results:

  • Significant degradation in visual performance (detection and recognition) was observed when presented with spatially incongruent sounds.
  • This auditory-induced visual performance degradation was robust across different stimulus types and locations.
  • Eye-tracking data revealed that performance decline occurred even without saccades towards the sound source, during regular gaze behavior.

Conclusions:

  • Spatially incongruent auditory stimuli in VR can significantly impair visual performance.
  • The observed effect is not attributable to oculomotor responses (e.g., eye movements towards sound).
  • Findings suggest that neural interactions or attentional shifts are the primary drivers of this auditory-visual performance degradation in VR.