Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Working Memory01:24

Working Memory

603
Working memory refers to a combination of components, including short-term memory and attention, that allow an individual to hold information temporarily as we perform cognitive tasks. It is an essential cognitive function that enables the execution of complex tasks such as problem-solving, comprehension, and reasoning. Unlike short-term memory, which simply involves the storage of information for a brief period, working memory involves the active manipulation and processing of this...
603
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

2.6K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
2.6K
Language and Cognition01:27

Language and Cognition

585
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
585
Non-Verbal Cues01:29

Non-Verbal Cues

144
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
144
Chunking and Rehearsal in Sensory Memory01:22

Chunking and Rehearsal in Sensory Memory

446
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
446
Lateralization01:28

Lateralization

791
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
791

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

From dots to faces: individual differences in visual imagery capacity predict the content of Ganzflicker-induced hallucinations.

Neuroscience of consciousness·2026
Same author

The influence of co-speech gestures on speech envelope tracking.

Brain and language·2026
Same author

Alleviating Job-Related Burnout in Medical Professionals through Guided Imagery Hypnotherapy.

Journal of evidence-based integrative medicine·2026
Same author

Words and Worlds Both: Dynamic Effects of Distributional and Sensorimotor Information in Semantic Processing.

Open mind : discoveries in cognitive science·2026
Same author

Raspberry Pi-powered temperature monitoring of growth chamber microclimates.

Applications in plant sciences·2025
Same author

Point-light Talkers: Multisensory Enhancement of Speech Tracking by Co-speech Movement Kinematics.

Journal of cognitive neuroscience·2025

Related Experiment Video

Updated: Dec 1, 2025

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
07:18

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

Published on: January 26, 2024

1.1K

Verbal working memory and co-speech gesture processing.

Jacob Momsen1, Jared Gordon2, Ying Choon Wu3

  • 1Joint Doctoral Program Language and Communicative Disorders, San Diego State University and UC San Diego, United States.

Brain and Cognition
|November 10, 2020
PubMed
Summary
This summary is machine-generated.

Cognitive processes for multimodal discourse comprehension are affected by verbal working memory. High memory load disrupts speech-gesture integration, suggesting verbal working memory is crucial for speech processing under demanding conditions.

Keywords:
Iconic gesturesMultisensory integrationRepresentational gesturesSpeech-gesture integrationWorking memory

More Related Videos

Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks
08:32

Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks

Published on: September 5, 2019

5.8K
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

10.5K

Related Experiment Videos

Last Updated: Dec 1, 2025

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
07:18

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

Published on: January 26, 2024

1.1K
Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks
08:32

Examining Online Syntactic Processing of Spoken Complex Sentences in Chinese Using Dual-Modal Interference Tasks

Published on: September 5, 2019

5.8K
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

10.5K

Area of Science:

  • Cognitive Neuroscience
  • Psycholinguistics
  • Communication Studies

Background:

  • Multimodal discourse comprehension relies on cognitive processes for integrating various communication forms.
  • Understanding the interplay between verbal working memory and processing multimodal information is crucial for explaining language acquisition and social cognition.

Purpose of the Study:

  • To investigate the impact of verbal working memory load on the online integration of speech and iconic gestures during discourse comprehension.
  • To examine how cognitive resource availability influences the processing of congruent versus incongruent multimodal information.

Main Methods:

  • Event-related potentials (ERPs) were recorded from participants performing a digit memory task under low (1 digit) and high (4 digits) verbal working memory load conditions.
  • Participants viewed discourse videos with congruent or incongruent speech-gesture combinations during the memory task's maintenance phase.

Main Results:

  • Speech-gesture congruity effects were observed under low memory load conditions.
  • High memory load trials showed enhanced frontal positivities, indicating an interaction between speech-gesture integration and verbal working memory capacity.
  • These findings suggest that verbal working memory is more critical for speech processing under high cognitive demands than for integrating speech with gestures.

Conclusions:

  • The integration of speech and gestures in multimodal discourse is influenced by the availability of cognitive resources, specifically verbal working memory.
  • High cognitive load associated with verbal working memory demands can impair the seamless integration of multimodal information.
  • Verbal working memory plays a differential role in multimodal discourse, being more vital for speech processing under load than for gesture integration.