Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Parallel Processing01:20

Parallel Processing

The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Assessing the Role of Vocal Plasticity in Sociospatial Coordination.

Animals : an open access journal from MDPI·2026
Same author

Comprehension of functional category labels in dogs.

Journal of experimental psychology. Animal learning and cognition·2026
Same author

Extended High-Frequency Hearing Thresholds and Categorical Loudness Scaling in Parkinson's Disease.

Journal of speech, language, and hearing research : JSLHR·2026
Same author

Perceptual discrimination learning in children with and without autism: The effect of feedback, modality, and progressive-learning.

Psychonomic bulletin & review·2025
Same author

Cyclical variations in acoustic features within the song sessions of humpback whales (Megaptera novaeangliae).

Journal of comparative psychology (Washington, D.C. : 1983)·2024
Same author

Do rodents smell with sound?

Neuroscience and biobehavioral reviews·2024

Related Experiment Video

Updated: May 30, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Multidimensional processing of dynamic sounds: more than meets the ear.

Estella H Liu1, Eduardo Mercado, Barbara A Church

  • 1Department of Psychology, University at Buffalo, The State University of New York, 312 Park Hall, Buffalo, NY 14260, USA. hliu6@buffalo.edu

Attention, Perception & Psychophysics
|August 10, 2011
PubMed
Summary

Visual and auditory processing interact, but decision-making influences these cross-modal effects. Context changes decision criteria, while perception remains stable, impacting sound detection differently based on visual cues.

More Related Videos

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Infant Auditory Processing and Event-related Brain Oscillations
06:34

Infant Auditory Processing and Event-related Brain Oscillations

Published on: July 1, 2015

Related Experiment Videos

Last Updated: May 30, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Infant Auditory Processing and Event-related Brain Oscillations
06:34

Infant Auditory Processing and Event-related Brain Oscillations

Published on: July 1, 2015

Area of Science:

  • Cognitive Neuroscience
  • Psychology
  • Sensory Processing

Background:

  • Cross-modal interactions between visual and auditory systems are well-established.
  • The precise roles of perceptual versus decision-making processes in these interactions are not fully understood.

Purpose of the Study:

  • To disentangle perceptual and decision-related contributions to cross-modal interactions.
  • To investigate how manipulating testing context affects cross-modal effects on auditory amplitude change detection.

Main Methods:

  • Participants detected changes in sound amplitude while ignoring irrelevant visual cues.
  • Methodological and statistical techniques controlled for response interference, criterion shifts, and strategy selection.
  • Testing context was manipulated by varying the grouping of visual cues.

Main Results:

  • Cross-modal congruency effects were observed independently at perceptual and decision levels.
  • Changes in testing context significantly altered decision criteria but not perceptual sensitivity.
  • Participants showed higher sensitivity to sound amplitude increases and were less sensitive to dynamic visual cues.

Conclusions:

  • Cross-modal interactions are influenced by both perceptual and decision-making processes.
  • The relative contribution of these processes varies with within-modal processing asymmetries and cross-modal dynamics.
  • Contextual changes primarily impact decision criteria, while perceptual sensitivity to cross-modal information remains more robust.