从任务结构到世界模型:LLMs知道什么?
1Department of Psychology, Yale University, New Haven, CT, USA; Department of Statistics and Data Science, Yale University, New Haven, CT, USA; Wu-Tsai Institute, Yale University, New Haven, CT, USA; Foundations of Data Science Institute, Yale University, New Haven, CT, USA.
Trends in cognitive sciences
|March 5, 2024
概括
大型语言模型 (LLM) 通过下一个词代拥有工具知识. 本研究探讨了LLM仪器知识如何与人类的世界知识和认知世界模型有关.
科学领域:
- 人工智能的人工智能
- 认知科学 认知科学
- 思想的哲学 思想的哲学
背景情况:
- 大型语言模型 (LLM) 展示了复杂的语言能力,引发了关于其基础知识表示的疑问.
- 人工系统中知识的性质,特别是LLM,仍然是人工智能和认知科学中的重要辩论.
- 区分不同类型的知识 (例如,工具与世俗) 对于理解AI认知至关重要.
研究的目的:
- 通过下一个词代来定义和分析LLM通过下一个词代获得的"工具知识".
- 研究LLM仪器知识与人类"世俗知识"之间的关系.
- 探索LLM知识在多大程度上结合了认知科学的结构化世界模型.
主要方法:
- 通过预测下一个词来获得LLM知识的概念分析.
- 比较框架检查仪器知识与人类的世界知识.
- 在法学士课程中探索认知科学原则,以整合世界模式.
主要成果:
- 通过其核心的下一个词生成机制,LLM获得了"工具知识".
- 仪器知识可能包含结构化世界模型的各个方面,尽管隐含.
- 资源合理性权衡影响了LLM能够恢复世界知识的程度.
结论:
- 士知识最好被理解为"工具性",来自预测性文本生成.
- 在LLMs中恢复"世俗知识"受到计算资源限制的限制.
- 这项研究挑战了关于人工智能和人类知识和智能的基本假设.
相关概念视频
Language and Cognition
345
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
345
Language Development
362
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
362
Observational Learning
171
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
171
Higher Mental Functions of the Brain: Language
824
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
824
Concepts and Prototypes
141
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
141
Generalization, Discrimination, and Extinction
552
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
552


