大型语言模型与人类大脑中的语言处理越来越一致
Changjiang Gao1,2, Zhengwu Ma1, Jiajun Chen2
1Department of Linguistics and Translation, City University of Hong Kong, Hong Kong, China.
Nature computational science
|September 16, 2025
概括
较大的语言模型 (LLM) 比指令调整模型更好地捕捉阅读期间的人类大脑活动. 扩展LLM,而不是调整指令,可以提高语言理解研究的认知可信性.
科学领域:
- 认知科学 认知科学
- 神经科学是一个神经科学.
- 人工智能的人工智能
背景情况:
- 基于变压器的大型语言模型 (LLM) 为大脑的含义表示提供了洞察力.
- 由于广泛的数据和长时间的上下文访问,人们对大型LLM的有效性存在担忧.
- 指令调整是一个关键的LLM技术,超出了简单的扩展.
研究的目的:
- 调查指令调是否提高了LLM捕获人类大脑语言信息的能力.
- 将不同尺寸的基础和指令调整的LLM与人类阅读数据进行比较.
- 评估LLM用于自然语言理解的认知合理性.
主要方法:
- 将基础和指令调整的LLM (不同大小) 与人类数据进行比较.
- 利用眼睛跟踪和功能磁共振成像 (fMRI) 检测大脑活动.
- 在自然主义阅读任务中分析数据.
主要成果:
- 增加LLM大小,而不是指令调,导致更接近人类大脑活动.
- 基础LLM显示与人类认知过程的调整比指令调整模型更好.
- 模型大小是一个比指令调更关键的因素,用于大脑的表示相似性.
结论:
- 缩放LLM比指令调更有效,可以模仿人类大脑的语言处理.
- 这些发现挑战了针对语言理解的学习指令调整的LLM的认知可信性.
- 在认知神经科学研究中,LLM的大小是其应用的关键考虑因素.
更多相关视频
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
814
13:12Translational Brain Mapping at the University of Rochester Medical Center: Preserving the Mind Through Personalized Brain Mapping
Published on: August 12, 2019
46.3K
相关概念视频
Language and Cognition
716
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
716
Higher Mental Functions of the Brain: Language
3.5K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.5K
Lateralization
968
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
968
Language Development
853
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
853
Parallel Processing
638
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
638
Improving Translational Accuracy
14.1K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.1K
