Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Visual prosody and speech intelligibility: head movement improves auditory speech perception.

K G Munhall1, Jeffery A Jones, Daniel E Callan

  • 1Department of Psychology, Queen's University, Kingston, Ontario, Canada. munhallk@psyc.queensu.ca

Psychological Science
|January 24, 2004
PubMed
Summary

Natural head movements during speech convey linguistic information, enhancing speech perception. This study found head motion correlates with vocal pitch and amplitude, improving syllable identification in noisy environments.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Editorial: New perspectives on the role of sensory feedback in speech production, volume II.

Frontiers in human neuroscience·2026
Same author

Mouse model of post-traumatic stress disorder negatively impacts cardiac homeostasis.

Journal of molecular and cellular cardiology·2025
Same author

A Cross-Sectional Multivariable Analysis of the Quality of Hemodialysis Patients' Life in Lahore City, Pakistan.

Healthcare (Basel, Switzerland)·2025
Same author

Shredding artifacts: extracting brain activity in EEG from extreme artifacts during skateboarding using ASR and ICA.

Frontiers in neuroergonomics·2024
Same author

Simultaneous fMRI and tDCS for Enhancing Training of Flight Tasks.

Brain sciences·2023
Same author

Right, but not left, posterior superior temporal gyrus is causally involved in vocal feedback control.

NeuroImage·2023

Area of Science:

  • Linguistics
  • Speech Perception
  • Nonverbal Communication

Background:

  • Head movements are a natural component of human speech.
  • The role of these nonverbal cues in speech perception is not fully understood.

Purpose of the Study:

  • To investigate the relationship between head motion and linguistic information in speech.
  • To determine the impact of head movements on speech perception, particularly in noisy conditions.

Main Methods:

  • Recorded 3D head and face motion and voice acoustics of Japanese speakers.
  • Analyzed correlations between head movement, vocal pitch (fundamental frequency), and amplitude.
  • Conducted a perception study using realistic talking-head animations with manipulated head motion in a speech-in-noise task.

Related Experiment Videos

Main Results:

  • Head movement showed a strong correlation with vocal pitch and amplitude.
  • Japanese subjects demonstrated significantly higher syllable identification accuracy with natural head motion compared to distorted or absent motion.
  • Speech perception was enhanced when natural head movements were present in visual speech stimuli.

Conclusions:

  • Rhythmic head motion during speech directly conveys linguistic information.
  • Nonverbal gestures like head movements play a crucial role in enhancing speech perception, especially in challenging auditory environments.
  • Head motion serves as a direct perceptual cue for speech processing.