Related Experiment Video
Updated: Nov 30, 2025

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
Published on: January 26, 2024
Semantic Relationships Between Representational Gestures and Their Lexical Affiliates Are Evaluated Similarly for
Sarah S Hughes-Berheim1, Laura M Morett1, Raymond Bulger1
1Department of Educational Studies in Psychology, Research Methodology and Counseling, University of Alabama, Tuscaloosa, AL, United States.
Abstract:
This research examined whether the semantic relationships between representational gestures and their lexical affiliates are evaluated similarly when lexical affiliates are conveyed via speech and text. In two studies, adult native English speakers rated the similarity of the meanings of representational gesture-word pairs presented via speech and text. Gesture-word pairs in each modality consisted of gestures and words matching in meaning (semantically-congruent pairs) as well as gestures and words mismatching in meaning (semantically-incongruent pairs). The results revealed that ratings differed by semantic congruency but not language modality. These findings provide the first evidence that semantic relationships between representational gestures and their lexical affiliates are evaluated similarly regardless of language modality. Moreover, this research provides an open normed database of semantically-congruent and semantically-incongruent gesture-word pairs in both text and speech that will be useful for future research investigating gesture-language integration.
More Related Videos
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
05:38Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
Related Concept Videos
Language and Cognition
Non-Verbal Cues
Components of Language
The Representativeness Heuristic
Nonconscious Mimicry
Lateralization