Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Shared spatial and temporal principles govern connectome dynamics across timescales.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Early Weight Loss After Sleeve Gastrectomy Selectively Improves Intermetatarsal Angle Without Affecting Hallux Valgus Angle.

Journal of clinical medicine·2026
Same author

Animal acoustic communication has a conserved optimal rhythm within the neural delta range.

PLoS biology·2026
Same author

Forecasting Perception Before It Happens: Context-Specific Connectivity Patterns Predict Perceptual Outcomes.

bioRxiv : the preprint server for biology·2026
Same author

Context-dependent interaction between goal-directed and habitual control under time pressure.

Communications psychology·2026
Same author

Languages evolve ergodically: Clarifications and responses.

Physics of life reviews·2026

Related Experiment Video

Updated: Jul 5, 2026

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Simulation of talking faces in the human brain improves auditory speech recognition.

Katharina von Kriegstein1, Ozgür Dogan, Martina Grüter

  • 1Wellcome Trust Centre for Neuroimaging, University College London, Queen Square, London WC1N 3BG, United Kingdom. kkriegs@fil.ion.ucl.ac.uk

Proceedings of the National Academy of Sciences of the United States of America
|April 26, 2008
PubMed
Summary

Even without seeing a face, the brain uses visual memory to improve understanding of speech and recognizing the speaker. This occurs by leveraging stored visual information from distinct face-processing brain areas.

More Related Videos

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

Related Experiment Videos

Last Updated: Jul 5, 2026

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

Area of Science:

  • Neuroscience
  • Cognitive Science
  • Audiovisual Speech Perception

Background:

  • Human communication is primarily audiovisual, with visual cues enhancing speech comprehension.
  • Existing models often focus on unisensory processing, potentially underestimating cross-modal influences in auditory-only scenarios.

Purpose of the Study:

  • To investigate if the brain utilizes visual face information to enhance auditory-only speech and speaker recognition.
  • To explore the neural basis of this phenomenon in individuals with and without face recognition deficits (prosopagnosia).

Main Methods:

  • Conducted behavioral and neuroimaging experiments comparing individuals with prosopagnosia and matched controls.
  • Assessed improvements in auditory-only speech and speaker recognition after a brief period of observing a specific person talking.

Main Results:

  • Observing a person talk improved subsequent auditory-only speech and speaker recognition for that individual in both groups.
  • Auditory speech recognition improvement involved face-movement processing areas in both prosopagnosics and controls.
  • Speaker recognition improvement was observed only in controls and was linked to face-identity processing areas.

Conclusions:

  • The brain optimizes auditory-only speech processing by using stored audiovisual correlations, challenging unisensory models.
  • This optimization relies on speaker-specific internal audiovisual models, simulating a talking face even when only auditory input is present.