Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Depth Perception and Spatial Vision01:15

Depth Perception and Spatial Vision

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Gestalt Principles of Perception01:21

Gestalt Principles of Perception

Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceptual Constancy01:12

Perceptual Constancy

Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Requirements and Concerns of Individuals Remitted From Depression for an Early Relapse Detection mHealth App: Focus Group Study.

JMIR mHealth and uHealth·2025
Same author

When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR.

Sensors (Basel, Switzerland)·2025
Same author

EEG alpha power predicts the temporal sensitivity of multisensory perception.

The European journal of neuroscience·2022
Same journal

Seeing Scent in Sound: Exploratory Spontaneous Visual and Olfactory Mental Imagery Elicited by Musical Modes.

Multisensory research·2026
Same journal

The Contextually Tolerant but Temporally Intolerant Sensation Transference from Tactile to Taste in Drinking Coffee.

Multisensory research·2026
Same journal

Material Dependency of Crossmodal Correspondences in Shitsukan (with a Focus on Food).

Multisensory research·2026
Same journal

Shifting Fall Perception: How Virtual Reality Alters the Precision of Estimating Postural Instability Onset.

Multisensory research·2026
Same journal

Duration, Sequence and Beat Perception across Modalities.

Multisensory research·2026
Same journal

Tasting Accents: Three Studies on the Influence of Regional Accents on People's Expectations and Perception of Food.

Multisensory research·2026
See all related articles

Related Experiment Video

Updated: Jun 4, 2026

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior
09:49

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior

Published on: April 16, 2014

The Pip-and-Pop Effect in Depth: How Multisensory Stimuli Influence Depth Perception.

Haami Yusein1,2,3, Durk Talsma2, Klaas Bombeke3

  • 1Laboratory of Medical Psychology and Addictology, ULB Neuroscience Institute (UNI), 26659Université Libre de Bruxelles (ULB), Avenue F. Roosevelt 50, CP191, 1050 Brussels, Belgium.

Multisensory Research
|June 2, 2026
PubMed
Summary
This summary is machine-generated.

Audiovisual integration speeds up attention and biases distance perception. Synchronous sounds with visual targets made them seem closer, demonstrating multisensory effects on spatial awareness in virtual reality.

More Related Videos

Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities
09:38

Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities

Published on: January 29, 2014

Measuring Sensitivity to Viewpoint Change with and without Stereoscopic Cues
08:04

Measuring Sensitivity to Viewpoint Change with and without Stereoscopic Cues

Published on: December 4, 2013

Related Experiment Videos

Last Updated: Jun 4, 2026

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior
09:49

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior

Published on: April 16, 2014

Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities
09:38

Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities

Published on: January 29, 2014

Measuring Sensitivity to Viewpoint Change with and without Stereoscopic Cues
08:04

Measuring Sensitivity to Viewpoint Change with and without Stereoscopic Cues

Published on: December 4, 2013

Area of Science:

  • Cognitive Neuroscience
  • Perception Psychology
  • Virtual Reality Applications

Background:

  • Multisensory integration enhances attentional selection.
  • Its impact on depth perception is not well understood due to measurement challenges.
  • Virtual reality offers controlled environments to study multisensory perception.

Purpose of the Study:

  • To investigate how audiovisual integration affects distance perception.
  • To adapt the pip-and-pop paradigm for immersive virtual reality.
  • To determine if audiovisual cues influence spatial awareness beyond attentional facilitation.

Main Methods:

  • Adapted the pip-and-pop paradigm in immersive virtual reality.
  • Participants (N=30) searched for visual targets with or without synchronous nonspatial auditory stimuli.
  • Post-target identification, participants reported target location in 3D space (laterality, elevation, depth).

Main Results:

  • Audiovisual pairing significantly increased response speed (pip-and-pop effect).
  • Targets with synchronous tones were perceived as closer, indicating distance underestimation.
  • Exploratory analyses showed effects of target vertical and lateral position.

Conclusions:

  • Multisensory integration influences both attentional selection speed and perceived target distance.
  • Audiovisual synchrony can bias spatial perception, extending the pip-and-pop effect.
  • Spatially mismatched, temporally synchronous audiovisual events impact distance estimates in VR.