相关实验视频
Updated: Jun 7, 2025

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
10.9K
奖励基础:一个简单的机制,以适应性获得多种奖励类型的简单机制
Beren Millidge1, Yuhang Song1, Armin Lak2
1MRC Brain Network Dynamics Unit, University of Oxford, Oxford, United Kingdom.
PLoS computational biology
|November 19, 2024
概括
动物根据生理需求灵活地适应奖励偏好. 强化学习模型通过学习不同奖励的价值来解释这一点,指导行为并预测多巴胺神经元对食物和液体的反应.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 动物行为 动物行为
背景情况:
- 动物根据生理状态 (如饥渴) 调整奖励偏好.
- 了解适应性决策的神经机制至关重要.
研究的目的:
- 解释动物如何灵活地适应奖励偏好.
- 模拟多巴胺神经元在多维奖励学习中的作用.
- 为了研究在基底腺中的神经执行.
主要方法:
- 开发了一个多目标的强化学习模型.
- 分析了灵长类动物多巴胺神经元记录.
- 模拟基底状腺网络功能.
主要成果:
- 该模型通过根据需求加权学习值来证明灵活的行为适应.
- 发现多巴胺神经元编码不同的奖励维度 (食物与液体).
- 基底可以学习多维值,支持适应性行为.
结论:
- 一个简单的神经回路可以灵活地根据动物当前的需求来引导行为.
- 该模型为理解适应性决策和多巴胺功能提供了一个框架.
相关概念视频
Reinforcement Schedules
132
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
132
Primary and Secondary Reinforcers
198
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
198
Reinforcement
180
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
180
Timing and Consequences on Behavior
82
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
82
Incentive Theory: Pull Theory of Motivation
378
Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between...
The theory differentiates between...
378
Instinctive Drift
188
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
188

