Related Experiment Video
Updated: Sep 7, 2025
07:18
Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
Published on: January 26, 2024
963
Gesture-Speech Integration in Typical and Atypical Adolescent Readers
Ru Yao1, Connie Qun Guan2, Elaine R Smolen3
1China National Institute of Education Sciences, Beijing, China.
Frontiers in Psychology
|June 20, 2022
Summary
Adolescents who are deaf or hard of hearing (DHH) show enhanced gesture-speech integration (GSI) compared to hearing peers. This finding highlights the crucial role of visual cues in language processing for DHH individuals.
Area of Science:
- Cognitive Science
- Developmental Psychology
- Linguistics
Background:
- Gesture-speech integration (GSI) is a fundamental aspect of human communication.
- Understanding GSI in deaf or hard of hearing (DHH) adolescents is crucial for language development.
- Previous research has primarily focused on hearing populations.
Purpose of the Study:
- To investigate and compare gesture-speech integration (GSI) in adolescents who are deaf or hard of hearing (DHH) and those with typical hearing.
- To determine if DHH adolescents exhibit different GSI effects compared to their hearing counterparts.
- To explore the impact of GSI on language processing and communication in DHH individuals.
Main Methods:
- A Stroop-like task was administered to 38 adolescents (19 DHH).
- Participants viewed video clips of gestures and actions, responding to word-gesture relatedness.
- Accuracy rates and response times were recorded to measure GSI effects.
Main Results:
- Deaf or hard of hearing (DHH) participants demonstrated stronger gesture-speech integration (GSI) effects than hearing participants.
- A significantly larger semantic congruency effect was observed in DHH individuals.
- DHH participants also showed a significantly larger gender congruency effect compared to hearing participants.
Conclusions:
- Adolescents who are deaf or hard of hearing (DHH) exhibit enhanced gesture-speech integration (GSI).
- These findings suggest that visual cues, like gestures, play a significant role in language processing for DHH individuals.
- Further research is recommended to explore the implications of GSI for communication in the DHH population.
Keywords:
automaticitydeaf and hard of hearinggesturegesture–speech integrationspoken language comprehensionMore Related Videos
Related Concept Videos
01:18Cognitive Development During Adolescence
122
During adolescence, individuals experience significant cognitive development that enhances their understanding of others' emotions and thoughts, known as cognitive empathy. This period is marked by an increased ability to adapt to others' perspectives and a more nuanced understanding of others' mental states, a skill that is foundational for social problem-solving and conflict avoidance. The development of cognitive empathy relies heavily on the theory of mind — the...
122
01:25Learning Disabilities
270
Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
Dyslexia
Dyslexia is a...
270
01:27Language and Cognition
435
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
435
01:19Autism Spectrum Disorder
290
Autism spectrum disorder (ASD) is a neurodevelopmental condition marked by persistent deficits in social communication and interaction alongside restrictive and repetitive behaviors or interests. ASD is sometimes accompanied by intellectual impairment.
These core symptoms manifest differently among individuals, ranging from mild to severe. The disorder's complexity extends beyond its clinical presentation, encompassing a diverse range of biological, cognitive, and sociocultural influences.
These core symptoms manifest differently among individuals, ranging from mild to severe. The disorder's complexity extends beyond its clinical presentation, encompassing a diverse range of biological, cognitive, and sociocultural influences.
290
01:22Language Development
443
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
443