强化的概率和速率都会影响条件反应的获得和维持
Jorge Mallea1, Atara Schulhof2, Charles R Gallistel3
1Department of Psychology, Columbia University.
Journal of experimental psychology. Animal learning and cognition
|October 21, 2024
概括
强化概率在帕夫洛夫条件下影响响应率,即使强化频率是恒定的. 这一发现通过将概率与速率效应分开来挑战现有的学习理论.
科学领域:
- 行为神经科学 行为神经科学
- 学习和记忆的学习和记忆
背景情况:
- 帕夫洛夫条件强度与强化概率有关.
- 以前的研究经常将强化概率与强化率混为一谈.
研究的目的:
- 为了研究强化概率对食欲调节和小鼠灭绝的影响.
- 通过控制强化速率来隔离概率的影响.
主要方法:
- 两项实验使用控制强化速率的小鼠进行.
- 实验1:改变每次试验的奖励数量以等同强化率.
- 实验2:使用分割试验设计来操纵概率,同时保持CS持续时间不变.
主要成果:
- 强化概率影响了收购期间的响应率,独立于强化率.
- 概率和率都影响了有反应的试验比例.
- 概率对响应出现的速度的影响最小.
结论:
- 强化学习的概率影响响应,即使速度是恒定的.
- 这些发现需要对正式学习理论进行修订,以考虑概率和速率效应.
相关概念视频
Generalization, Discrimination, and Extinction
451
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
451
Reinforcement Schedules
133
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
133
Timing and Consequences on Behavior
82
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
82
Operant Conditioning
1.5K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.5K
Principles of Classical Conditioning
503
Classical conditioning, as described by Ivan Pavlov, is a foundational concept in associative learning, where a neutral stimulus becomes capable of eliciting a conditioned response through association with an unconditioned stimulus. The process of acquisition, where this learning occurs, and the subsequent phenomena of contiguity, contingency, generalization, discrimination, extinction, and spontaneous recovery are crucial for a comprehensive understanding of classical conditioning.
During the...
During the...
503
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K


