相关实验视频
Updated: Jul 5, 2025

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
11.0K
奖励对选择的多巴胺独立效应通过隐藏状态推断推断
Marta Blanco-Pozo1,2, Thomas Akam3,4, Mark E Walton5,6
1Department of Experimental Psychology, Oxford University, Oxford, UK. martabp@stanford.edu.
Nature neuroscience
|January 12, 2024
概括
多巴胺信号使用推断的任务知识奖励预测错误 (RPEs). 然而,多巴胺独立的信息驱动选择,表明奖励通过传递状态信息来影响决策,而不仅仅是通过RPE.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 行为经济学是一种行为经济学.
背景情况:
- 多巴胺在奖励预测错误 (RPE) 中的作用对于适应性行为至关重要.
- 结构化环境中的推理过程增强了行为灵活性.
- 在决策中RPE和推理的整合仍然不清楚.
研究的目的:
- 调查多巴胺如何在推断值方面发出RPE信号.
- 为了确定多巴胺在结构化任务中的选择行为中的作用.
- 阐明奖励导向决策中多巴胺依赖和独立机制之间的相互作用.
主要方法:
- 在小鼠身上使用了两步的行为任务.
- 在任务执行期间监测多巴胺神经元活动.
- 开发了一个神经网络模型来模拟观察到的数据.
主要成果:
- 多巴胺信号的RPEs包含推断的任务结构,奖励率和运动.
- 激活或抑制多巴胺神经元不会改变奖励后的未来选择.
- 一个神经网络模型成功地重复了实验数据,区分皮质状态推断和基底质价值学习.
结论:
- 多巴胺将推断的知识整合到RPE信号中.
- 奖励对选择的影响可以通过多巴胺独立状态信息进行调解.
- 这表明在决策中学习价值和推断环境状态的独特途径.
相关概念视频
Timing and Consequences on Behavior
95
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
95
Purposive Learning
121
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
121
Incentive Theory: Pull Theory of Motivation
446
Incentive theory, or the "pull theory" of motivation, suggests that external rewards primarily drive behavior. Individuals are motivated to engage in activities when they anticipate a desirable outcome. This is why people often work hard for promotions or study intensively to achieve high grades. These incentives can be tangible, physical rewards such as money or promotions, or intangible, non-physical rewards like praise and social recognition.
The theory differentiates between...
The theory differentiates between...
446
Instinctive Drift
225
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
225
Law of Effect
1.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.4K
Decision Making: P-value Method
5.4K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.4K

