Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Perceptual Constancy01:12

Perceptual Constancy

Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Chunking and Rehearsal in Sensory Memory01:22

Chunking and Rehearsal in Sensory Memory

Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of information more...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

From Neurocognitive Frameworks to Clinical Practice: How Music and Rhythm Are Utilized by Speech-Language Pathologists.

American journal of speech-language pathology·2026
Same author

Auditory-Somatosensory Interactions in Speech Perception in Individuals With Hearing Impairment: An Exploratory Case Study.

Journal of speech, language, and hearing research : JSLHR·2026
Same author

Visual load does not modulate neural processing of audiovisual speech integration.

Neuropsychologia·2025
Same author

Audiovisual Integration in Cued Speech Perception: Impact on Speech Recognition in Quiet and Noise Among Adults With Hearing Loss and Those With Typical Hearing.

Journal of speech, language, and hearing research : JSLHR·2025
Same author

A Systematic Review and Bayesian Meta-Analysis of Acoustic Measures of Prosody in Parkinson's Disease.

Journal of speech, language, and hearing research : JSLHR·2024
Same author

Movement-related cortical potential and speech-induced suppression during speech production in younger and older adults.

Brain and language·2024

Related Experiment Video

Updated: Jul 9, 2026

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Visual contribution to the multistable perception of speech.

Marc Sato1, Anahita Basirat, Jean-Luc Schwartz

  • 1UMR 5216 CNRS, Institut National Polytechnique de Grenoble Université Stendhal, Grenoble, France.

Perception & Psychophysics
|December 15, 2007
PubMed
Summary

Visual cues significantly influence speech perception, altering how we experience repeated sounds. This research explores how seeing articulatory gestures impacts the verbal transformation effect.

More Related Videos

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Related Experiment Videos

Last Updated: Jul 9, 2026

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Area of Science:

  • Auditory Perception
  • Audiovisual Speech Processing
  • Psycholinguistics

Background:

  • The verbal transformation effect describes perceptual shifts during rapid, continuous speech repetition.
  • Understanding how sensory modalities interact is crucial for explaining speech perception.
  • The role of visual articulatory information in this effect remains largely unexplored.

Purpose of the Study:

  • To investigate if visual information from articulatory gestures modulates the emergence and stability of auditory percepts in speech.
  • To examine the influence of unimodal, audiovisual, and incongruent audiovisual speech presentations on perceptual changes.
  • To explore the role of visual cues in the temporal dynamics of speech perception shifts.

Main Methods:

  • Subjects listened to repeated syllables under unimodal, audiovisual, and incongruent audiovisual conditions, reporting perceptual changes.
  • Experiments involved presenting stable audio with congruent and incongruent visual stimuli, correlating perceptual transitions with visual changes.
  • Analysis focused on the impact of visual input, specifically vocal tract opening onset, on perceptual transformations.

Main Results:

  • Perceptual stability of auditory speech percepts was significantly affected by the presentation modality (unimodal vs. audiovisual).
  • A strong correlation was observed between the timing of perceptual shifts and video alternations in audiovisual stimuli.
  • Visual input, particularly the vocal tract opening onset, acted as a bootstrap mechanism for detecting perceptual transformations.

Conclusions:

  • Visual information exerts significant control over the multistable perception of speech, influencing both phonetic content and temporal progression.
  • The verbal transformation effect serves as a valuable paradigm for studying audiovisual interactions in speech perception.
  • These findings highlight the integrated nature of auditory and visual information in constructing our perception of spoken language.