Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Audio-visual interactions with intact clearly audible speech.

Chris Davis1, Jeesun Kim

  • 1University of Melbourne, Parkville, Australia. cwd@unimelb.edu.au

The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology
|September 17, 2004
PubMed
Summary

Viewing a talker's face enhances auditory speech processing and duration estimation. This suggests a link between speech perception and motor action, activating speech motor schemas in the perceiver.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Pre- and post-transplant serum albumin levels and outcomes after allogeneic hematopoietic cell transplantation for adults with acute myeloid leukemia.

Leukemia & lymphoma·2026
Same author

Automated Assessment of Surgical Quality in Distal Gastrectomy: Development of a Novel Computer Vision Model Based on the Critical View of Quality (CVQ).

Annals of surgery·2026
Same author

Perspectives on an advanced practice physiotherapy-led model for musculoskeletal care in Canada: A qualitative study of patients and multidisciplinary clinicians.

Musculoskeletal science & practice·2026
Same author

Robotic-assisted gastrectomy for 700 gastric cancer patients: A comparative analysis between specialized centers in Italy and Korea.

European journal of surgical oncology : the journal of the European Society of Surgical Oncology and the British Association of Surgical Oncology·2026
Same author

Stakeholder perspectives on the potential benefits, risks, and implications of an interactive cognitive monitoring app for the identification and monitoring of cognitive decline in adults at risk of dementia.

BMC health services research·2026
Same author

Temperature-Controlled Radiofrequency for Severe Nasal Airway Obstruction: A Non-Inferiority Comparison With Surgical Intervention.

International forum of allergy & rhinology·2026

Area of Science:

  • Cognitive Science
  • Neuroscience
  • Speech Processing

Background:

  • Auditory speech processing is fundamental to communication.
  • The role of visual speech cues in enhancing auditory perception is an area of ongoing research.
  • Existing models may not fully account for the impact of articulated action in audio-visual (AV) speech.

Purpose of the Study:

  • To investigate how visual speech (seeing a talker's face) affects the processing of auditory speech stimuli.
  • To determine if visual speech influences articulatory motor actions and duration perception.
  • To explore the relationship between perception and action in audio-visual speech comprehension.

Main Methods:

  • Experiment 1: Syllable-monitoring task comparing audio-visual (AV) speech with auditory-only speech.

Related Experiment Videos

  • Experiment 2: Investigated AV effects on auditory phrase duration estimates.
  • Experiment 3: Used non-speech auditory and visual timing cues to isolate AV effects specific to speech.

    • Main Results:

    • Visual speech significantly improved syllable recognition compared to auditory-only presentation.
    • Seeing a moving face led to longer and more accurate duration estimates of spoken phrases.
    • Non-speech auditory and visual timing cues did not yield similar improvements in duration estimation.

    Conclusions:

    • Visual speech aids in the analysis of auditory stimuli, particularly in tasks involving the production of an utterance.
    • Findings support a processing link between perception and action, where viewing speech activates motor schemas.
    • The articulatory properties of speech are crucial for understanding audio-visual speech benefits.