Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Perception of Sound Waves01:01

Perception of Sound Waves

5.1K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.1K
Beats01:09

Beats

1.1K
The study of music provides many examples of the superposition of waves and the constructive and destructive interference that occurs. Very few examples of music being performed consist of a single source playing a single frequency for an extended period of time. A single frequency of sound for an extended period might be monotonous to the point of irritation, similar to the unwanted drone of an aircraft engine or a loud fan. Music is pleasant and exciting due to mixing the changing frequencies...
1.1K
Auditory Perception01:17

Auditory Perception

788
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
788
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

643
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
643
Factors Affecting Perception01:25

Factors Affecting Perception

2.3K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
2.3K
Hearing01:31

Hearing

55.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
55.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Contextual F0 cues can outweigh talker F0 cues in fricative perception.

Attention, perception & psychophysics·2026
Same author

To what extent do pragmatic cues from disfluencies inform our predictions of spoken language during naturalistic language processing?

Cortex; a journal devoted to the study of the nervous system and behavior·2026
Same author

Foreign Language Learners Show a Kinematic Accent in Their Co-Speech Hand Movements.

Open mind : discoveries in cognitive science·2026
Same author

The Role of Talker Information in Phonetic Convergence.

Quarterly journal of experimental psychology (2006)·2026
Same author

Language control during free sentence production: Cued and voluntary switching.

Journal of experimental psychology. Learning, memory, and cognition·2026
Same author

Is rate-dependent perception affected by linguistic information about the intended syllable rate?

Psychonomic bulletin & review·2025

Related Experiment Video

Updated: Nov 19, 2025

Uncovering Beat Deafness: Detecting Rhythm Disorders with Synchronized Finger Tapping and Perceptual Timing Tasks
09:04

Uncovering Beat Deafness: Detecting Rhythm Disorders with Synchronized Finger Tapping and Perceptual Timing Tasks

Published on: March 16, 2015

13.1K

Beat gestures influence which speech sounds you hear.

Hans Rutger Bosker1,2, David Peeters3

  • 1Max Planck Institute for Psycholinguistics, PO Box 310, 6500 AH Nijmegen, The Netherlands.

Proceedings. Biological Sciences
|January 27, 2021
PubMed
Summary

Beat gestures, or hand movements accompanying speech, influence how we perceive spoken words. These gestures affect the recognition of lexical stress and even the vowels we hear, demonstrating a manual McGurk effect.

Keywords:
audiovisual speech perceptionbeat gestureslexical stressmanual McGurk effectmultimodal communication

More Related Videos

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

668
Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
07:18

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

Published on: January 26, 2024

1.1K

Related Experiment Videos

Last Updated: Nov 19, 2025

Uncovering Beat Deafness: Detecting Rhythm Disorders with Synchronized Finger Tapping and Perceptual Timing Tasks
09:04

Uncovering Beat Deafness: Detecting Rhythm Disorders with Synchronized Finger Tapping and Perceptual Timing Tasks

Published on: March 16, 2015

13.1K
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

668
Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
07:18

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

Published on: January 26, 2024

1.1K

Area of Science:

  • Cognitive Psychology
  • Linguistics
  • Neuroscience

Background:

  • Beat gestures are common hand movements accompanying speech, synchronized with speech prosody and lexical stress.
  • Their precise role in spoken word recognition remains largely unexplored.

Purpose of the Study:

  • To investigate the impact of beat gestures on spoken word recognition.
  • To determine if these gestures influence the perception of lexical stress and speech sounds.

Main Methods:

  • A series of experiments were conducted to assess the influence of beat gestures on auditory perception.
  • Participants' perception of lexical stress and vowel sounds was measured in the presence of accompanying gestures.

Main Results:

  • Beat gestures were found to significantly influence the explicit and implicit perception of lexical stress.
  • This influence extended to altering the vowels listeners perceived, suggesting a cross-modal effect.

Conclusions:

  • Beat gestures play a role in modulating speech perception.
  • Converging evidence supports a 'manual McGurk effect,' where hand movements impact auditory speech sound processing.