相关实验视频
Updated: Jun 3, 2025

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
10.9K
多巴胺基预测错误的奇怪案例和超越价值的学习关联信息
Thorsten Kahnt1, Geoffrey Schoenbaum2
1Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, USA. thorsten.kahnt@nih.gov.
Nature reviews. Neuroscience
|January 8, 2025
概括
多巴胺神经元活动,以前只与奖励价值预测错误相关,也可能信号价值中立的信息. 本综述探讨了证据表明多巴胺提供比以前假设的更丰富的信号.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 强化学习是一种强化学习.
背景情况:
- 中脑多巴胺神经元传统上与时间差模型中的奖励预测错误有关.
- 现有的研究广泛支持多巴胺在基于价值的学习中的作用.
- 假设多巴胺不参与学习价值中立特征的假设仍然在很大程度上未经测试.
研究的目的:
- 审查挑战多巴胺短暂物单维基于价值的预测错误假设的证据.
- 调查多巴胺神经元参与学习的奖励的价值中立方面.
- 探索多巴胺信号编码的信息的全部范围.
主要方法:
- 审查现有的研究在老鼠和人类.
- 分析与多巴胺信号传递相关的行为和神经数据.
- 将多巴胺反应与已建立的强化学习模型进行比较.
主要成果:
- 有证据表明,多巴胺短暂物编码的信息超出了整合值.
- 研究表明,多巴胺在学习奖励的价值中立特征中发挥着作用.
- 多巴胺信号似乎比最初假设的更复杂.
结论:
- 多巴胺神经元活动提供了比仅基于价值的预测错误更丰富的信号.
- 多巴胺在学习中的作用扩展到价值中立的信息.
- 未来的研究应该考虑多巴胺信号的多方面的性质.
相关概念视频
Associative Learning
287
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
287
Higher Mental Functions of Brain: Learning and Memory
658
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
658
Purposive Learning
98
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
98
Cognitive Learning
219
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
219
Real-World Application of Classical Conditioning
520
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
520
Generalization, Discrimination, and Extinction
428
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
428

