Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Neural processes underlying perceptual enhancement by visual speech gestures.

Daniel E Callan1, Jeffery A Jones, Kevin Munhall

  • 1Human Information Science Laboratories, ATR International, Kyoto, Japan. dcallan@atr.co.jp

Neuroreport
|November 20, 2003
PubMed
Summary

Observing visual speech gestures enhances word perception, especially with accompanying audio, by integrating multisensory information. This brain activity suggests simulating speech internally aids perception, particularly in noisy conditions.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Editorial: New perspectives on the role of sensory feedback in speech production, volume II.

Frontiers in human neuroscience·2026
Same author

Mouse model of post-traumatic stress disorder negatively impacts cardiac homeostasis.

Journal of molecular and cellular cardiology·2025
Same author

A Cross-Sectional Multivariable Analysis of the Quality of Hemodialysis Patients' Life in Lahore City, Pakistan.

Healthcare (Basel, Switzerland)·2025
Same author

Shredding artifacts: extracting brain activity in EEG from extreme artifacts during skateboarding using ASR and ICA.

Frontiers in neuroergonomics·2024
Same author

Simultaneous fMRI and tDCS for Enhancing Training of Flight Tasks.

Brain sciences·2023
Same author

Right, but not left, posterior superior temporal gyrus is causally involved in vocal feedback control.

NeuroImage·2023

Area of Science:

  • Neuroscience
  • Cognitive Science
  • Speech Perception

Background:

  • The brain integrates audio-visual information for enhanced perception.
  • Multisensory integration sites play a key role in processing speech.
  • Understanding these mechanisms is crucial for speech processing research.

Purpose of the Study:

  • To investigate brain regions involved in perceptual enhancement from visual speech gestures.
  • To explore how the brain integrates audio-visual speech information.
  • To examine the role of internal speech simulation in perception.

Main Methods:

  • Functional magnetic resonance imaging (fMRI) was used.
  • Participants identified words in various audio-visual conditions (audio-only, audiovisual, audio-only with noise, audiovisual with noise, visual-only).

Related Experiment Videos

  • Brain activity was measured during passive word identification tasks.

    • Main Results:

    • Enhanced brain activity in the middle and superior temporal gyrus/sulcus was observed with concordant audiovisual stimuli, especially in acoustic noise.
    • Activity in speech production areas was noted for visual speech with degraded or absent auditory input.
    • This suggests multisensory integration and internal speech simulation pathways are involved.

    Conclusions:

    • The brain integrates concordant audio-visual speech information for enhanced perception.
    • Multisensory integration sites, like the temporal gyrus/sulcus, are critical.
    • Internal simulation of observed speech acts facilitates perception, particularly under challenging auditory conditions.