Related Experiment Video
Updated: Jun 5, 2026

Recording and Analyzing Multimodal Large-Scale Neuronal Ensemble Dynamics on CMOS-Integrated High-Density Microelectrode Array
Published on: March 8, 2024
Sign language narrative reveals universal and modality-specific features of cortical timescale hierarchy
Maria Zimmermann1,2, Piotr Tomaszewski3, Artur Marchewka4
1Department of Psychology, University of Warsaw, Warsaw, Poland. maria.zimmermann@psych.uw.edu.pl.
This study reveals how the brain processes sign language narratives, showing universal brain networks for language structure and plot comprehension across different language modalities. It identifies unique neural patterns for sign language processing.
Area of Science:
- Neuroscience
- Linguistics
- Cognitive Science
Background:
- Human languages uniquely enable storytelling, engaging hierarchical neural processing from words to narratives.
- Neuroimaging studies show spoken language comprehension involves a neural time-scale hierarchy.
- Sign languages share features with spoken languages but use unique modality-specific elements (hands, face, space).
Purpose of the Study:
- To investigate which aspects of the language hierarchy are speech-specific versus modality-general.
- To examine neural processing of sign language narrative comprehension using naturalistic fMRI.
- To identify universal and modality-specific neural signatures in language processing.
Main Methods:
- Functional magnetic resonance imaging (fMRI) was used with native signers.
- Participants watched a sign language interpretation of a narrative and its scrambled versions.
- Naturalistic stimuli were employed to study brain activity during comprehension.
Main Results:
- Signed narratives synchronize hierarchical neural networks, similar to spoken language.
- A modality-invariant dissociation was found: frontotemporal regions track sentence structure, while the Default Mode Network tracks plot.
- New neural signatures for sign language were identified: superior parietal cortex for discourse timescales and ventral occipital cortex for word/sentence processing.
Conclusions:
- Signed narratives engage hierarchical neural networks, supporting modality-invariant aspects of language processing.
- The study identified novel neural correlates for sign language processing, including discourse-level and word/sentence-level tracking.
- These findings highlight both universal mechanisms and potential modality-specific adaptations in the neurobiology of language.
Related Concept Videos
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Neurons as Communicators of the Brain
Cell Body
The cell body, also known...
Neuronal Communication
Language
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Language Development
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...

