结合结构学习代理人的可能原则
Lancelot Da Costa1, Tomáš Gavenčiak2, David Hyland3
1VERSES AI Research Lab, Los Angeles, CA 90067 USA lance.dacosta@verses.ai.
Neural computation
|November 14, 2025
概括
这项研究提出了可扩展人工智能 (AI) 的路线图,使代理商能够学习世界模型和人类偏好. 重点是结构学习和思维理论,用于开发对齐的AI系统.
科学领域:
- 人工智能的人工智能
- 认知科学 认知科学
- 机器学习 机器学习
背景情况:
- 开发可扩展和对齐的人工智能 (AI) 是一个重大挑战.
- 目前的人工智能发展缺乏从自然智能原则的清晰路径.
- 了解代理世界模型和偏好对于AI调整至关重要.
研究的目的:
- 为可扩展的对齐人工智能开发提供路线图.
- 探索结构学习 (因果表示学习) 作为人工智能的核心组成部分.
- 整合自然智能,数学,统计学和认知科学的原则.
主要方法:
- 从数学,统计学和认知科学中合成想法.
- 研究结构学习,信息几何学和模型缩小.
- 开发核心结构模块来学习自然主义世界.
主要成果:
- 通过学习世界模型和偏好,提出了一条通向可扩展的对准AI的道路.
- 确定了结构学习和思维理论作为人工智能调整的关键要素.
- 用阿西莫夫定律的数学草图说明了对齐原理.
结论:
- 结构学习对于创造能够理解世界和偏好的代理人至关重要.
- 思想理论是开发对齐的AI的一个关键组成部分.
- 拟议的框架可以指导新对齐的AI系统的开发.
相关概念视频
Introduction to Learning
912
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
912
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Cognitive Learning
990
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
990
Purposive Learning
428
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
428
Observational Learning
804
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
804
Impression Management Techniques III: Aligning Actions
120
Aligning actions are communicative strategies individuals employ to maintain social harmony and preserve personal identity in the face of potential disruptions to social norms. These actions are particularly important in managing social impressions when one's behavior might be seen as inappropriate, incompetent, or morally questionable.Types of Aligning ActionsThe three principal types of aligning actions are disclaimers, accounts, and apologies.DisclaimersDisclaimers are preventive; they are...
120


