Related Experiment Video
Updated: Sep 6, 2025

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition
Published on: February 19, 2018
Reimagining Language
Neil Cohn1, Joost Schilperoord1
1Department of Communication and Cognition, Tilburg School of Humanities and Digital Sciences, Tilburg University.
Cognitive science must embrace multimodality beyond speech. Rethinking language models is crucial for understanding the full spectrum of human communication, moving past the traditional amodal view.
Area of Science:
- Cognitive Science
- Linguistics
- Psycholinguistics
Background:
- The traditional view of language in Cognitive Science prioritizes speech, often termed the "amodal view."
- This perspective suggests language processing is modality-independent, but evidence increasingly challenges this.
- Despite growing acknowledgment of non-vocal and multimodal communication over 40 years, the mainstream linguistic paradigm remains largely unchanged.
Discussion:
- The 'amodal view' of language processing is challenged by the diverse ways humans communicate.
- Evidence suggests that nonvocal and multimodal communication are integral to the linguistic system, not peripheral.
- Integrating these modalities requires a re-evaluation of existing theoretical frameworks in linguistics and psycholinguistics.
Key Insights:
- Speech is not the sole or prototypical modality for language; nonvocal and multimodal communication are equally vital.
- Current linguistic models are insufficient, failing to account for the full spectrum of human communication.
- A paradigm shift is needed to embrace multimodality in understanding language.
Outlook:
- Future research should focus on developing new cognitive models that incorporate multimodality.
- A more inclusive Cognitive Science is necessary, one that acknowledges the richness of all human communication forms.
- This shift will enhance our understanding of language acquisition, processing, and evolution.
More Related Videos
05:35Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization
Published on: April 19, 2017
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Related Concept Videos
Language and Cognition
Components of Language
Language
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language Development
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
Elaborative Rehearsals
The effectiveness of...