Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Aug 29, 2025

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.5K

Relating Sound and Sight in Simulated Environments.

Kevin Y Tsang1, Damien J Mannion1

  • 1School of Psychology, UNSW Sydney, Sydney, 2052, Australia.

Multisensory Research
|September 9, 2022
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Perception of Sound Waves01:01

Perception of Sound Waves

4.6K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.6K
Depth Perception and Spatial Vision01:15

Depth Perception and Spatial Vision

849
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
849
Sight Distance in a Vertical Curve01:29

Sight Distance in a Vertical Curve

116
Sight distance on vertical curves is critical in roadway design. It ensures drivers can see far enough ahead to identify and respond to hazards effectively. This directly impacts safety, driver comfort, and the overall efficiency of the transportation network.Vertical curves are classified into crest and sag curves based on their geometry. For crest curves, sight distance is determined by the line of sight between a driver's eye and a small object on the road's surface. Design parameters for...
116
Auditory Perception01:17

Auditory Perception

564
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
564
Visual System01:26

Visual System

658
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
658
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

407
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
407

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Applying the LATER model to reaction time data: an open-source toolkit.

Journal of neurophysiology·2024
Same author

Scene coherence can affect the local response to natural images in human V1.

The European journal of neuroscience·2015
Same journal

Seeing Scent in Sound: Exploratory Spontaneous Visual and Olfactory Mental Imagery Elicited by Musical Modes.

Multisensory research·2026
Same journal

The Contextually Tolerant but Temporally Intolerant Sensation Transference from Tactile to Taste in Drinking Coffee.

Multisensory research·2026
Same journal

The Pip-and-Pop Effect in Depth: How Multisensory Stimuli Influence Depth Perception.

Multisensory research·2026
Same journal

Material Dependency of Crossmodal Correspondences in Shitsukan (with a Focus on Food).

Multisensory research·2026
Same journal

Shifting Fall Perception: How Virtual Reality Alters the Precision of Estimating Postural Instability Onset.

Multisensory research·2026
Same journal

Duration, Sequence and Beat Perception across Modalities.

Multisensory research·2026
See all related articles

Vision can help us predict sound qualities like reverberation. This study shows people use visual cues from a location to form expectations about its sound, aiding auditory perception.

Area of Science:

  • Auditory perception
  • Multisensory integration
  • Environmental acoustics

Background:

  • Auditory signals are a mix of direct sound and environmental reverberation.
  • Perceptual separation of these sound components can be improved by expectations of reverberant qualities.
  • The role of vision in forming these auditory expectations is not well understood.

Purpose of the Study:

  • To investigate if visual information from a location can inform expectations about its auditory properties, specifically reverberation.
  • To determine if audiovisual congruence influences the perception of sound environments.
  • To explore how visual cues might aid in separating direct sound from reverberation.

Main Methods:

  • Participants (n=104) experienced simulated real-world locations via head-mounted display or web-based methods.

More Related Videos

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
05:43

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

Published on: May 23, 2019

5.5K
Visualizing Visual Adaptation
04:43

Visualizing Visual Adaptation

Published on: April 24, 2017

9.1K

Related Experiment Videos

Last Updated: Aug 29, 2025

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.5K
Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
05:43

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

Published on: May 23, 2019

5.5K
Visualizing Visual Adaptation
04:43

Visualizing Visual Adaptation

Published on: April 24, 2017

9.1K
  • Audiovisual stimuli involved viewing a location and then hearing speech convolved with impulse responses from congruent or incongruent locations.
  • Participant responses were analyzed to assess the impact of visual-auditory congruence on perceived matches and confusions.

    • Main Results:

    • Audiovisual congruence increased the probability of reporting an audiovisual match by approximately 0.22.
    • Participants were more likely to misjudge pairs as matching if their locations had similar reverberation times.
    • Visual information significantly influenced auditory judgments, particularly concerning spatial acoustics.

    Conclusions:

    • Human perceivers can form expectations about environmental reverberation based on visual information.
    • Visual cues provide a basis for predicting auditory spatial properties, potentially aiding sound source segregation.
    • This capacity for cross-modal expectation formation highlights the integrated nature of human sensory perception.