Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Processing of changes in visual speech in the human auditory cortex.

Riikka Möttönen1, Christina M Krause, Kaisa Tiippana

  • 1Laboratory of Computational Engineering, Helsinki University of Technology, Espoo, Finland. riikka.mottonen@hut.fi

Brain Research. Cognitive Brain Research
|March 29, 2002
PubMed
Summary

Observing articulatory gestures impacts speech perception. Combining visual and auditory speech cues enhances the brain

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Do acoustic cues influence the McGurk effect-an audiovisual speech illusion?

The Journal of the Acoustical Society of America·2026
Same author

Erratum: Embodied emotions in ancient Neo-Assyrian texts revealed by bodily mapping of emotional semantics.

iScience·2026
Same author

The Effects of Cognitive Fatigue and Articulatory Suppression on Statistical Language Learning Depend on the Strength of Cognitive Resources.

Cognitive science·2026
Same author

Cerebral topographies of perceived and felt emotions.

Imaging neuroscience (Cambridge, Mass.)·2025
Same author

Does background color influence the perception of facial expression? Adjustment to neutral expression by Caucasian and Japanese participants.

Journal of the Optical Society of America. A, Optics, image science, and vision·2025
Same author

Prosody enhances learning of statistical dependencies from continuous speech streams in adults.

Cognition·2025

Area of Science:

  • Neuroscience
  • Audiology
  • Speech Perception

Background:

  • Articulatory gestures influence auditory speech perception.
  • Congruent gestures enhance speech recognition, while incongruent gestures can alter phonetic perception (e.g., McGurk effect).

Purpose of the Study:

  • To investigate the cortical processing of visual and audiovisual speech changes.
  • To compare the brain's response to visual speech changes in unimodal (visual) versus bimodal (audiovisual) contexts.

Main Methods:

  • Magnetoencephalography (MEG) was used to record brain activity.
  • Experiments involved presenting congruent and incongruent audiovisual and visual speech stimuli.
  • Stimuli included auditory and visual components of syllables like /iti/ and /ipi/.

Related Experiment Videos

Main Results:

  • Visual changes in both audiovisual and visual speech activated supratemporal auditory cortices bilaterally.
  • Auditory cortex activation to visual changes occurred significantly later in the visual-only experiment compared to the audiovisual experiment.
  • This suggests that audiovisual interaction accelerates the detection of visual speech changes.

Conclusions:

  • The brain's auditory cortex is involved in processing visual speech information.
  • Audiovisual speech integration speeds up the neural processing of visual speech cues.
  • Multimodal sensory information enhances speech perception and processing efficiency.