一种生物启发的强化学习模型,解释了惩罚后的快速适应
1Department of Mathematics and Computing, Mount Royal University, 4825 Mt Royal Gate SW, Calgary, AB T3E 6K6, Canada.
Neurobiology of learning and memory
|August 29, 2024
概括
这项研究引入了一种新的强化学习规则,通过缩小奖励预测错误来改善适应不断变化的策略. 这个新模型更好地反映了人类和动物如何从惩罚中学习,与传统方法不同.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算心理学 计算心理学
背景情况:
- 传统的强化学习 (RL) 努力模拟对惩罚的快速适应,经常表现出坚持不.
- 解决逆向学习的现有RL模型是复杂的,并且与神经机制脱离.
- 一个新的神经元级学习规则为全脑学习原则提供了潜在的基础.
研究的目的:
- 将神经元级学习规则概括为一种新的强化学习框架.
- 开发一种更具生物学可信性和更简单的RL模型,用于适应和惩罚反应.
- 为了解释类似人类的学习行为,包括失去转移和选择悖论效应.
主要方法:
- 概括了一个最近发现的神经元级学习规则.
- 开发了一个新的强化学习规则,通过动作概率将奖励预测错误扩大到动作概率.
- 在卡片排序和可变的爱荷华州博任务上测试了模型.
主要成果:
- 新的RL规则成功地模拟了适应和失去转移行为.
- 该模型展示了类似人类的选择悖论效应.
- 该规则使用标准的RL参数,提供了更简单,更综合的方法.
结论:
- 一般化神经元级学习规则提供了一个新且有效的强化学习框架.
- 这种方法提供了一种更节,可能更有神经基础的学习和决策模式.
- 这些发现对于研究人员模拟动物和人类学习行为的研究人员来说非常有价值.
相关概念视频
Punishment
160
Negative reinforcement and punishment are often confused but serve distinct functions in behavior modification. Reinforcement, whether positive or negative, increases the likelihood of a desired behavior, while punishment decreases it.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
160
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
Timing and Consequences on Behavior
87
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
87
Reinforcement
190
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
190
Behavior Modification
134
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
134
Reinforcement Schedules
138
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
138


