Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Language and Cognition01:27

Language and Cognition

434
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
434
Components of Language01:24

Components of Language

382
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
382
Language01:16

Language

417
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
417
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

1.0K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
1.0K
Language Development01:22

Language Development

443
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
443
Elaborative Rehearsals01:07

Elaborative Rehearsals

129
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
129

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The properties of panels in global comics: frequency and size of 76 K panels in 1,030 comics from 144 countries.

Language resources and evaluation·2026
Same author

Whoosh! visual depictions of direction, speed, and temporality: a corpus analysis of motion events in global comics.

Multimodal communication·2025
Same author

Understanding lightbulb moments: Meaning-making in visual morphology from comics and emoji.

Memory & cognition·2025
Same author

Mark the Unexpected! Animacy Preference and Directed Movement in Visual Language.

Cognitive science·2025
Same author

Processing Incongruity for Mental Events in Comics: Contours of Character Inferences.

Metaphor and symbol·2025
Same author

Are We Moving Too Fast?: Representation of Speed in Static Images.

Journal of cognition·2025
Same journal

Pronoun Resolution in Turkish: The Interplay of Referential Form, Word Order, and Implicit Causality.

Cognitive science·2026
Same journal

What's in a Color?: Language, Synesthesia, and Categorical Perception.

Cognitive science·2026
Same journal

Reasoning Beyond Explicit Rules: Adults' and Children's Use of Closure Principles in Novel Cases.

Cognitive science·2026
Same journal

Intermediary Object States Are Activated by Sentences Describing Completed Events.

Cognitive science·2026
Same journal

Large Language Models Estimate Fine-Grained Human Color-Concept Associations.

Cognitive science·2026
Same journal

Computational Models of Causal Reasoning: Bayesian Accounts of Normative Violations.

Cognitive science·2026
See all related articles

Related Experiment Video

Updated: Sep 6, 2025

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition
05:15

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition

Published on: February 19, 2018

10.9K

Reimagining Language.

Neil Cohn1, Joost Schilperoord1

  • 1Department of Communication and Cognition, Tilburg School of Humanities and Digital Sciences, Tilburg University.

Cognitive Science
|June 23, 2022
PubMed
Summary
This summary is machine-generated.

Cognitive science must embrace multimodality beyond speech. Rethinking language models is crucial for understanding the full spectrum of human communication, moving past the traditional amodal view.

Keywords:
DrawingGestureLanguageLanguage architectureMultimodality

More Related Videos

Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization
05:35

Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization

Published on: April 19, 2017

6.8K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

677

Related Experiment Videos

Last Updated: Sep 6, 2025

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition
05:15

The Spatial Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition

Published on: February 19, 2018

10.9K
Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization
05:35

Experience is Instrumental in Tuning a Link Between Language and Cognition: Evidence from 6- to 7- Month-Old Infants' Object Categorization

Published on: April 19, 2017

6.8K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

677

Area of Science:

  • Cognitive Science
  • Linguistics
  • Psycholinguistics

Background:

  • The traditional view of language in Cognitive Science prioritizes speech, often termed the "amodal view."
  • This perspective suggests language processing is modality-independent, but evidence increasingly challenges this.
  • Despite growing acknowledgment of non-vocal and multimodal communication over 40 years, the mainstream linguistic paradigm remains largely unchanged.

Discussion:

  • The 'amodal view' of language processing is challenged by the diverse ways humans communicate.
  • Evidence suggests that nonvocal and multimodal communication are integral to the linguistic system, not peripheral.
  • Integrating these modalities requires a re-evaluation of existing theoretical frameworks in linguistics and psycholinguistics.

Key Insights:

  • Speech is not the sole or prototypical modality for language; nonvocal and multimodal communication are equally vital.
  • Current linguistic models are insufficient, failing to account for the full spectrum of human communication.
  • A paradigm shift is needed to embrace multimodality in understanding language.

Outlook:

  • Future research should focus on developing new cognitive models that incorporate multimodality.
  • A more inclusive Cognitive Science is necessary, one that acknowledges the richness of all human communication forms.
  • This shift will enhance our understanding of language acquisition, processing, and evolution.