Related Experiment Video
Updated: Dec 11, 2025
07:18
Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
Published on: January 26, 2024
1.2K
Gesture's body orientation modulates the N400 for visual sentences primed by gestures
Yifei He1, Svenja Luell2, R Muralikrishnan3
1Department of Psychiatry and Psychotherapy, Philipps-University Marburg, Marburg, Germany.
Human Brain Mapping
|August 19, 2020
Summary
Gesture body orientation impacts how we understand speech. Frontal gestures create a stronger mismatch effect with sentences than lateral gestures, influencing semantic processing.
Area of Science:
- Neuroscience
- Cognitive Science
- Linguistics
Background:
- Body orientation influences gesture perception and comprehension.
- Limited research explores body orientation's role in gesture-language interaction.
Purpose of the Study:
- Investigate how body orientation affects the semantic interaction between gestures and language.
- Examine neural correlates of gesture perception and comprehension based on body orientation.
Main Methods:
- Electroencephalography (EEG) experiment with 21 participants.
- Presented videos of frontal and lateral hand gestures paired with congruent/incongruent sentences.
- Utilized a semantic probe task to assess gesture-sentence relatedness.
Main Results:
- Both gesture types decreased alpha and beta band power.
- Lateral gestures showed reduced beta band power decrease in the medial prefrontal cortex compared to frontal gestures.
- Frontal gestures elicited a significant N400 effect for gesture-sentence incongruency, which was reduced for lateral gestures.
Conclusions:
- Body orientation is crucial for gesture perception and influences gesture-language semantic interaction.
- The inferred social-communicative intention of gesture orientation modulates semantic processing.
More Related Videos
05:38Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
2.7K
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
16.2K
Related Concept Videos
01:29Non-Verbal Cues
173
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
173
01:24Facial Feedback Hypothesis
444
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
444
01:28Lateralization
822
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
822
01:24Prosopagnosia
585
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
585
01:12Visual Agnosia
712
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
712
01:13Nonconscious Mimicry
5.0K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
5.0K