Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Encoding01:19

Encoding

712
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
712
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

3.3K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.3K
Language and Cognition01:27

Language and Cognition

676
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
676
Reason and Intuition01:37

Reason and Intuition

7.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
7.4K
Components of Language01:24

Components of Language

714
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
714
Neurons as Communicators of the Brain01:22

Neurons as Communicators of the Brain

2.8K
Neurons, the fundamental units of the brain and nervous system, function as the primary transmitters of information throughout the body. Their ability to communicate through electrical and chemical signals is vital for every bodily function, from regulating the heartbeat to processing complex thoughts. Each neuron has three main components: the cell body (soma), dendrites, and an axon, each specialized to facilitate swift and efficient neural communication.
Cell Body
The cell body, also known...
2.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Neural decoding of autobiographical mental image features with a general semantic model.

Nature communications·2025
Same author

A Common Representational Code for Event and Object Concepts in the Brain.

bioRxiv : the preprint server for biology·2025
Same author

Dynamic modeling of EEG responses to natural speech reveals earlier processing of predictable words.

PLoS computational biology·2025
Same author

Challenges and opportunities for advancing functional MRI in clinical practice.

Brain : a journal of neurology·2025
Same author

Lesion correlates of impaired acoustic-phonetic perception after unilateral left hemisphere stroke.

Brain : a journal of neurology·2025
Same author

Deep-learning models reveal how context and listener attention shape electrophysiological correlates of speech-to-language transformation.

PLoS computational biology·2024

Related Experiment Video

Updated: Jan 6, 2026

Decoding Natural Behavior from Neuroethological Embedding
08:00

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

541

An Integrated Neural Decoder of Linguistic and Experiential Meaning.

Andrew James Anderson1,2, Jeffrey R Binder3, Leonardo Fernandino3

  • 1Department of Neuroscience, University of Rochester, Rochester, New York 14642, aander41@ur.rochester.edu.

The Journal of Neuroscience : the Official Journal of the Society for Neuroscience
|October 2, 2019
PubMed
Summary

Integrating nonlinguistic "experiential" knowledge with text-based models improves decoding of neural representations of sentence meaning. This approach enhances understanding of how the brain processes language beyond word co-occurrence.

Keywords:
conceptsfMRIlexical semanticsmultivoxel pattern analysissemantic modelsentence comprehension

More Related Videos

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.4K
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.7K

Related Experiment Videos

Last Updated: Jan 6, 2026

Decoding Natural Behavior from Neuroethological Embedding
08:00

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

541
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.4K
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.7K

Area of Science:

  • Cognitive Neuroscience
  • Computational Linguistics
  • Neuroimaging

Background:

  • The brain integrates linguistic and nonlinguistic knowledge to understand sentence meaning.
  • Previous neuroimaging studies primarily used text-based distributional models for decoding language meaning.
  • Nonlinguistic "experiential" knowledge, derived from sensory and motor experiences, is crucial for word meaning.

Purpose of the Study:

  • To investigate whether modeling nonlinguistic experiential knowledge improves decoding of neural representations of sentence meaning.
  • To compare the effectiveness of integrated models versus isolated text-based or experiential models.
  • To identify limitations in current models and guide future development in brain-based language decoding.

Main Methods:

  • Modeled experiential attributes (sensory, motor, social, emotional, cognitive) using behavioral ratings.
  • Utilized a representation-similarity-based framework for decoding functional magnetic resonance imaging (fMRI) data from sentence reading.
  • Employed a cross-participant decoding method to estimate an upper bound on decoding accuracy.

Main Results:

  • Integrating experiential knowledge with text-based models significantly improved decoding accuracy compared to using either model alone.
  • Text-based models were more effective for abstract words, while experiential models showed promise for concrete sentences.
  • A considerable portion of neural signal remained unexplained, highlighting areas for model improvement.

Conclusions:

  • Nonlinguistic experiential knowledge plays a vital role in the neural representation of sentence meaning.
  • Combining linguistic and experiential knowledge offers a more comprehensive approach to brain-based language decoding.
  • Further model development is needed to capture the full complexity of neural language processing.