Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Lateralization01:28

Lateralization

Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Altered aperiodic EEG spectral power during speech perception task is associated with verbal communication in youths with Autism Spectrum Disorder.

Scientific reports·2026
Same author

Language network functional connectivity in infancy predicts developmental language trajectories.

Developmental cognitive neuroscience·2026
Same author

Atypical Predictive Processing Is Associated With Sensory Over-Responsivity in Autism.

Autism research : official journal of the International Society for Autism Research·2026
Same author

Independent contributions of language activations in left and right temporal cortex to aphasia outcomes after stroke.

Imaging neuroscience (Cambridge, Mass.)·2026
Same author

Decoding concept representations in aphasia after stroke.

bioRxiv : the preprint server for biology·2026
Same author

Salience Network Connectivity Relates to Sleep and Sensory Over-Responsivity in Infants at High and Low Likelihood for Autism.

medRxiv : the preprint server for health sciences·2026

Related Experiment Video

Updated: Jul 5, 2026

Stimulating the Lip Motor Cortex with Transcranial Magnetic Stimulation
12:09

Stimulating the Lip Motor Cortex with Transcranial Magnetic Stimulation

Published on: June 14, 2014

Giving speech a hand: gesture modulates activity in auditory cortex during speech perception.

Amy L Hubbard1, Stephen M Wilson, Daniel E Callan

  • 1Ahmanson-Lovelace Brain Mapping Center, University of California, Los Angeles, California 90095-7085, USA. ahubbard@humnet.ucla.edu

Human Brain Mapping
|April 17, 2008
PubMed
Summary

The brain integrates beat gestures with speech, enhancing auditory cortex activity. This suggests a shared neural basis for processing both speech and hand gestures during communication.

More Related Videos

Examining Gesture Production in the Presence of Communication Challenges
07:18

Examining Gesture Production in the Presence of Communication Challenges

Published on: January 26, 2024

Somatosensory Event-related Potentials from Orofacial Skin Stretch Stimulation
06:56

Somatosensory Event-related Potentials from Orofacial Skin Stretch Stimulation

Published on: December 18, 2015

Related Experiment Videos

Last Updated: Jul 5, 2026

Stimulating the Lip Motor Cortex with Transcranial Magnetic Stimulation
12:09

Stimulating the Lip Motor Cortex with Transcranial Magnetic Stimulation

Published on: June 14, 2014

Examining Gesture Production in the Presence of Communication Challenges
07:18

Examining Gesture Production in the Presence of Communication Challenges

Published on: January 26, 2024

Somatosensory Event-related Potentials from Orofacial Skin Stretch Stimulation
06:56

Somatosensory Event-related Potentials from Orofacial Skin Stretch Stimulation

Published on: December 18, 2015

Area of Science:

  • Neuroscience
  • Cognitive Science
  • Psycholinguistics

Background:

  • Hand gestures play a significant role in face-to-face communication, influencing speech perception and comprehension.
  • The neural mechanisms underlying the integration of hand gestures with concurrent speech remain largely unexplored.

Purpose of the Study:

  • To investigate the neural impact of beat gestures on speech perception using functional magnetic resonance imaging (fMRI).
  • To identify brain regions involved in the multisensory integration of speech and gesture.

Main Methods:

  • fMRI scans were conducted on subjects listening to spontaneous speech paired with beat gestures, nonsense hand movements, or a still body.
  • Control conditions included viewing gestures or a still body without speech.
  • Analysis focused on brain activity differences across auditory and multisensory integration areas.

Main Results:

  • Bilateral nonprimary auditory cortex showed increased activity when speech was accompanied by beat gesture compared to speech alone.
  • The left superior temporal gyrus/sulcus exhibited stronger activation for speech with beat gesture versus speech with nonsense movement.
  • The right planum temporale was identified as a potential multisensory integration site for speech and beat gesture.

Conclusions:

  • The findings support the hypothesis that gesture influences speech perception at the neural level.
  • Evidence suggests a common neural substrate for processing both speech and beat gestures.
  • This integration likely reflects the joint communicative function of speech and gesture in social interactions.