Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Sensory Modalities01:15

Sensory Modalities

Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Prosopagnosia01:24

Prosopagnosia

Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The visome: Using cognitive networks to examine lip-reading errors in English words.

The Journal of the Acoustical Society of America·2026
Same author

Signatures of adaptive memory search: How early linguistic input shapes strategic use of lexical information.

Journal of experimental psychology. General·2026
Same author

Elliptical speech reveals the use of broad phonetic categories aids noise-degraded speech perception.

bioRxiv : the preprint server for biology·2026
Same author

Understanding Variability in Long-Term Psychological Adjustment of Prelingually Deaf Young Adults Implanted During Childhood.

Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology·2025
Same author

Evolving perspectives on speech perception assessment in adults with cochlear implants: Are we using the right tests?

Frontiers in neuroscience·2025
Same author

Externalizing Behaviors in Preschool-Aged Children With Cochlear Implants.

Journal of speech, language, and hearing research : JSLHR·2025
Same journal

Affordance-Based Surgical Design Methods Considering Biomechanical Artifacts.

Ecological psychology : a publication of the International Society for Ecological Psychology·2023
Same journal

How Interpersonal Coordination Affects Individual Behavior (and Vice Versa): Experimental analysis and adaptive HKB model of social memory.

Ecological psychology : a publication of the International Society for Ecological Psychology·2020
Same journal

Direct Perceptions of Carol Fowler's Theoretical Perspective.

Ecological psychology : a publication of the International Society for Ecological Psychology·2017
Same journal

Articulating What Infants Attune to in Native Speech.

Ecological psychology : a publication of the International Society for Ecological Psychology·2017
Same journal

PERCEPTUAL ORGANIZATION AND LAWFUL SPECIFICATION.

Ecological psychology : a publication of the International Society for Ecological Psychology·2016
Same journal

Building Tool Use From Object Manipulation: A Perception-Action Perspective.

Ecological psychology : a publication of the International Society for Ecological Psychology·2015
See all related articles

Related Experiment Video

Updated: Jun 2, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Crossmodal Source Identification in Speech Perception.

Lorin Lachs1, David B Pisoni

  • 1Department of Psychology California State University, Fresno.

Ecological Psychology : a Publication of the International Society for Ecological Psychology
|May 6, 2011
PubMed
Summary
This summary is machine-generated.

This study shows that matching voices to faces requires dynamic visual cues, not static images or fundamental frequency. Dynamic visual speech information is crucial for cross-modal voice recognition.

More Related Videos

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography
09:25

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography

Published on: July 26, 2019

Related Experiment Videos

Last Updated: Jun 2, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography
09:25

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography

Published on: July 26, 2019

Area of Science:

  • Auditory Perception
  • Visual Perception
  • Multisensory Integration

Background:

  • Understanding how the brain integrates information from different senses (multisensory integration) is key to perception.
  • Speech perception relies on both auditory and visual cues, but the specific requirements for cross-modal matching remain unclear.

Purpose of the Study:

  • To investigate the nature of multisensory speech information.
  • To determine the critical acoustic and optic patterns necessary for cross-modal speaker identification.

Main Methods:

  • Four experiments were conducted using cross-modal matching tasks.
  • Participants matched heard voices with dynamic or static visual displays of articulating faces.
  • Stimulus manipulations included altering visual display type and acoustic properties (e.g., f0, temporal reversal).

Main Results:

  • Participants successfully matched voices with dynamic visual displays of speaking faces.
  • Cross-modal source information was not available in static visual displays.
  • Matching was independent of the fundamental frequency (f0) but failed with temporally reversed audio.

Conclusions:

  • Dynamic visual information from articulating faces is essential for cross-modal voice source matching.
  • Static facial images and the primary acoustic cue for vocal identity (f0) are insufficient for this task.
  • The temporal structure of the acoustic signal is critical for successful cross-modal speech perception.