人类大脑中自然语言处理的时间结构与大型语言模型的分层层次结构相对应
Ariel Goldstein1,2,3, Eric Ham4,5, Mariano Schain6
1Department of Cognitive and Brain Sciences, Hebrew University, Jerusalem, Israel. ariel.y.goldstein@mail.huji.ac.il.
Nature communications
|November 26, 2025
概括
大型语言模型 (LLM) 反映了人类大脑的语言处理. 较深的LLM层与后来的大脑活动相关,揭示了对语言理解动态的洞察力.
科学领域:
- 神经科学是一个神经科学.
- 计算语言学 计算语言学
- 人工智能的人工智能
背景情况:
- 大型语言模型 (LLM) 为理解大脑语言处理提供了新的框架.
- 法律法规使用层次数字嵌入词语和上下文,不同于传统的模型.
研究的目的:
- 调查LLM的等级结构与人类语言理解的时间动态之间的对齐.
- 探索LLM层深度如何与语言相关的大脑区域的神经活动有关.
主要方法:
- 在叙事听力过程中利用了参与者的心电图 (ECoG) 数据.
- 从GPT-2 XL和Llama-2中提取了上下文嵌入.
- 采用线性模型来预测基于时间跨度LLM嵌入的神经反应.
主要成果:
- 证明了在语言理解过程中LLM层层次结构和大脑活动的时间动态之间存在显著的相关性.
- 发现更深层的LLM层与晚期的神经反应相对应,特别是在布罗卡的区域.
- 展示了模型深度和大脑的时间接收窗口之间的强烈联系.
结论:
- LLM提供了一个有价值的计算框架,用于模拟人类语言处理的时间方面.
- 在LLMs的层次结构有效地捕捉了理解过程中神经活动的进展.
- 该研究提供了一个公共数据集,以推进计算神经科学和语言处理理论的研究.
相关概念视频
01:10Higher Mental Functions of the Brain: Language
3.4K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.4K
01:22Language Development
810
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
810
01:27Language and Cognition
696
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
696
01:22Lobes of the Cerebrum
4.0K
The cerebral cortex, a critical structure of the brain, is intricately divided into two hemispheres, each consisting of four distinct lobes: occipital, temporal, frontal, and parietal. These lobes function cooperatively to regulate various cognitive and sensory functions, forming the basis of our complex neural capabilities.
Frontal lobe
The frontal lobes, located behind the forehead, are the command center of our brain, controlling personality, intelligence, and voluntary muscle movements....
Frontal lobe
The frontal lobes, located behind the forehead, are the command center of our brain, controlling personality, intelligence, and voluntary muscle movements....
4.0K
01:24Components of Language
732
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
732
01:30Organization of the Brain
2.3K
The brain is an integral component of the nervous system and serves as the center for processing sensory inputs, making decisions, and directing bodily actions. This complex organ is organized into three primary sections: the hindbrain, midbrain, and forebrain, each responsible for a range of vital functions.
Hindbrain
The hindbrain, located at the base of the brain, plays a vital role in regulating automatic processes that sustain life. It includes the medulla oblongata, which is essential for...
Hindbrain
The hindbrain, located at the base of the brain, plays a vital role in regulating automatic processes that sustain life. It includes the medulla oblongata, which is essential for...
2.3K