计划学习:在基于模型的规划过程中积极学习的新算法
Rowan Hodson1, Bruce Bassett2,3,4, Charel van Hoof5
1Laureate Institute for Brain Research. Tulsa, OK, USA.
ArXiv
|August 30, 2023
概括
复杂学习 (SL) 通过结合主动学习来增强计划的积极推理. 在复杂的环境中,SL优于其他算法,包括贝叶斯式RL和UCB,在复杂的环境中需要平衡的目标寻找和探索.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 强化学习是一种强化学习.
背景情况:
- 积极推理 (AI) 模型在不确定性下做决定.
- 复杂推理 (SI) 改进了人工智能,用于多步计划.
- 在SI和已建立的强化学习 (RL) 算法之间存在有限的比较.
研究的目的:
- 将SI表现与贝叶斯式RL方案进行比较.
- 介绍和评估复杂学习 (SL),这是SI的延伸.
- 通过考虑未来的观察学习,SL将积极学习纳入计划.
主要方法:
- 开发了一个新的,生物灵感的环境.
- 环境需要平衡目标寻求与积极获取信息.
- 模拟和比较SI,SL,贝叶斯适应RL和UCB算法.
主要成果:
- 复杂学习 (SL) 在所有测试的算法中都表现出卓越的性能.
- SL的表现优于贝叶斯适应型RL和UCB,它们使用类似的定向勘探原则.
- 新的环境凸显了SL在平衡勘探和开采方面的独特能力.
结论:
- 主动推理,特别是SL,对于复杂的,生物相关的规划问题是有效的.
- SL提供了一种新的方法来对抗事实推理和计划代理人的积极学习.
- 这些发现支持AI的实用性,并为认知科学研究提供工具.
相关概念视频
Observational Learning
209
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
209
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
79
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
79
Purposive Learning
140
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
140
Principle of Moments: Problem Solving
869
The principle of moments is a fundamental concept in physics and engineering. It refers to the balancing of forces and moments around a point or axis, also known as the pivot. This principle is used in many real-life scenarios, including construction, sports, and daily activities like opening doors and pushing objects.
One such scenario involves a pole placed in a three-dimensional system with a cable attached. When a tension is applied to the cable, the moment about the z-axis passing through...
One such scenario involves a pole placed in a three-dimensional system with a cable attached. When a tension is applied to the cable, the moment about the z-axis passing through...
869
Associative Learning
439
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
439
Statically Indeterminate Problem Solving
448
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
448


