Related Experiment Video
Updated: Jul 8, 2025
12:49
Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
Published on: July 13, 2019
17.0K
Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings
Andrea Bruera1,2, Yuan Tao3, Andrew Anderson4
1School of Electronic Engineering and Computer Science, Cognitive Science Research Group, Queen Mary University of London.
Cognitive Science
|December 16, 2023
Summary
Understanding how the brain processes nuanced word meanings, like concrete versus abstract concepts, is key. This study uses brain imaging and AI models to map where and how these subtle semantic variations are encoded in the brain.
Area of Science:
- Neuroscience
- Computational Linguistics
- Cognitive Science
Background:
- Understanding how the human brain processes contextualized meaning is a significant scientific challenge.
- Advances in neuroscience and artificial intelligence offer new tools to study brain activity during language comprehension.
- Contextualized language models can capture subtle meaning variations, including polysemous words and abstract/concrete dimensions.
Purpose of the Study:
- To investigate how the brain processes fine-grained lexical meaning variations along the concrete/abstract dimension.
- To identify the brain regions involved in coding these subtle meaning differences during verb-noun semantic composition.
- To determine if contextualized language models and human ratings can predict brain activity related to semantic composition.
Main Methods:
- Analysis of functional magnetic resonance imaging (fMRI) data from Italian speakers.
- Utilizing a contextualized language model to assess semantic composition.
- Employing human concreteness ratings for nouns within verb-noun phrases.
- Comparing complex, nonlinear composition models with simpler approaches.
Main Results:
- Phrase concreteness judgments and the contextualized language model successfully predicted blood-oxygen-level-dependent (BOLD) activation within the brain's language network.
- Complex, nonlinear semantic composition models significantly outperformed simpler models in predicting brain activity.
- Specific brain areas, including the posterior superior temporal sulcus, inferior frontal gyrus, anterior temporal lobe, and motor areas, showed significant encoding performance.
- Differential involvement patterns suggest specialized roles for these brain regions in processing abstract and concrete meanings.
Conclusions:
- Semantic composition in the brain appears to be a holistic process where representations are dynamically modified.
- The study provides evidence for the neural basis of fine-grained semantic variation, particularly along the concrete-abstract spectrum.
- AI-driven language models and neuroimaging techniques are powerful tools for decoding complex cognitive processes like language understanding.
Keywords:
Computational linguisticsConcretenessLanguage modelsMachine learningPolysemySemantic compositionSemanticsfMRIMore Related Videos
06:48Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
Published on: June 25, 2019
9.2K
13:12Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
Published on: August 12, 2019
45.6K
Related Concept Videos
01:24Concepts and Prototypes
151
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
151
02:13The Representativeness Heuristic
15.8K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.8K
01:17Cognitivism
1.4K
Cognitive psychology emerged as a significant field in the mid-20th century. It focused on understanding humans' internal mental processes. This approach emphasizes how people perceive, remember, think, and solve problems—elements critical to human cognition.
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
1.4K
02:16Stereotype Content Model
14.7K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.7K
01:10Higher Mental Functions of the Brain: Language
876
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
876