Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

786
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
786
Lateralization01:28

Lateralization

319
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
319
Language and Cognition01:27

Language and Cognition

340
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
340
Cerebral Hemispheres01:05

Cerebral Hemispheres

321
The human brain, a complex organ, is functionally divided into two cerebral hemispheres—left and right. These hemispheres are interconnected by a structure of paramount importance, the corpus callosum. This substantial bundle of neural fibers is not just a bridge between the hemispheres but a crucial element for the brain's comprehensive functioning. It enables efficient communication between the two hemispheres, allowing each side of the brain to control and receive sensory and motor...
321
Organization of the Brain01:30

Organization of the Brain

764
The brain is an integral component of the nervous system and serves as the center for processing sensory inputs, making decisions, and directing bodily actions. This complex organ is organized into three primary sections: the hindbrain, midbrain, and forebrain, each responsible for a range of vital functions.
Hindbrain
The hindbrain, located at the base of the brain, plays a vital role in regulating automatic processes that sustain life. It includes the medulla oblongata, which is essential for...
764
Brain Imaging01:14

Brain Imaging

225
Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans),  magnetic resonance imaging (MRI),  functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...
225

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Meta-awareness, mind-wandering, and the control of automatic external and internal orientations of attention.

Communications biology·2026
Same author

A reporting checklist for large language models in behavioural science.

Nature human behaviour·2026
Same author

Resolving Feynman's restaurant problem reveals optimal solutions and human strategies.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Levels of analysis for large language models.

Philosophical transactions. Series A, Mathematical, physical, and engineering sciences·2026
Same author

Author Correction: Temporal structure of natural language processing in the human brain corresponds to layered hierarchy of large language models.

Nature communications·2026
Same author

Binding items to contexts through conjunctive neural representations with the method of loci.

Nature communications·2026
Same journal

Demonstration of a quantum C-NOT gate in a time-multiplexed fully reconfigurable photonic processor.

Nature communications·2026
Same journal

Nonlinear quantum light source with van der Waals ferroelectric NbOX<sub>2</sub> (X = Br, I).

Nature communications·2026
Same journal

Antagonistic histone H2A variants and autonomous heterochromatin formation shape epigenomic patterns in Arabidopsis.

Nature communications·2026
Same journal

The long tail of nitrate pollution in groundwater challenges governance of global water quality.

Nature communications·2026
Same journal

Select microbial metabolites promote tau aggregation in a murine tauopathy model.

Nature communications·2026
Same journal

Warming climate has lengthened global intense tropical cyclone seasons.

Nature communications·2026
See all related articles

Related Experiment Video

Updated: Jun 22, 2025

Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
13:12

Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping

Published on: August 12, 2019

45.4K

Shared functional specialization in transformer-based language models and the human brain.

Sreejan Kumar1, Theodore R Sumers2, Takateru Yamakoshi3

  • 1Princeton Neuroscience Institute, Princeton University, Princeton, NJ, 08540, USA. sreejank@princeton.edu.

Nature Communications
|July 1, 2024
PubMed
Summary
This summary is machine-generated.

Researchers analyzed brain activity during language processing, focusing on artificial neural network computations. They found specific "attention heads" in Transformers predict brain activity in distinct cortical regions, revealing how the brain processes complex language.

More Related Videos

Modeling the Functional Network for Spatial Navigation in the Human Brain
05:55

Modeling the Functional Network for Spatial Navigation in the Human Brain

Published on: October 13, 2023

1.0K
Transcranial Magnetic Stimulation for Investigating Causal Brain-behavioral Relationships and their Time Course
11:33

Transcranial Magnetic Stimulation for Investigating Causal Brain-behavioral Relationships and their Time Course

Published on: July 18, 2014

43.0K

Related Experiment Videos

Last Updated: Jun 22, 2025

Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
13:12

Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping

Published on: August 12, 2019

45.4K
Modeling the Functional Network for Spatial Navigation in the Human Brain
05:55

Modeling the Functional Network for Spatial Navigation in the Human Brain

Published on: October 13, 2023

1.0K
Transcranial Magnetic Stimulation for Investigating Causal Brain-behavioral Relationships and their Time Course
11:33

Transcranial Magnetic Stimulation for Investigating Causal Brain-behavioral Relationships and their Time Course

Published on: July 18, 2014

43.0K

Area of Science:

  • Neuroscience
  • Computational Linguistics
  • Artificial Intelligence

Background:

  • The brain processes language using specialized computations to derive meaning from complex structures.
  • Artificial neural networks, particularly Transformers, have advanced natural language processing by integrating contextual information through circuit computations.
  • Previous research focused on internal representations (embeddings), but this study examines the circuit computations directly.

Purpose of the Study:

  • To deconstruct Transformer computations into functionally-specialized transformations that integrate contextual information.
  • To investigate how these transformations and individual attention heads relate to brain activity during naturalistic language comprehension.
  • To map the functional specialization of attention heads within the cortical language network.

Main Methods:

  • Analysis of functional MRI (fMRI) data from participants listening to naturalistic stories.
  • Deconstruction of Transformer computations into functionally-specialized transformations.
  • Correlation of brain activity with computations performed by individual attention heads.

Main Results:

  • Transformer transformations explain significant variance in brain activity across the cortical language network.
  • Individual, functionally-specialized attention heads differentially predict brain activity in specific cortical regions.
  • Attention heads exhibit gradients related to network layers and context lengths within a low-dimensional cortical space.

Conclusions:

  • The study provides a novel computational account of language processing in the brain by analyzing circuit computations directly.
  • Emergent computations in artificial neural networks, specifically attention heads, offer insights into neural mechanisms of language comprehension.
  • This work bridges artificial intelligence and neuroscience, suggesting a framework for understanding how the brain integrates linguistic context.