相关实验视频
Updated: Jun 13, 2025

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
10.9K
强化学习的整体感知起源 强化学习的整体感知起源
Lilian A Weber1, Debbie M Yee2, Dana M Small3
1Department of Psychiatry, University of Oxford, Oxford, UK; Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK.
Trends in cognitive sciences
|June 11, 2025
概括
生物奖励,对于有动机的行为至关重要,起源于消化过程中的内部,而不仅仅是感官快乐. 这表明了基于生理需求的强化学习的新观点.
科学领域:
- 神经科学是一个神经科学.
- 行为经济学是一种行为经济学.
- 生理学 生理学 生理学
背景情况:
- 强化学习传统上侧重于外部奖励如何塑造行为.
- 主要奖励的起源和性质仍然不完全理解.
研究的目的:
- 调查奖励信号的内部,潜意识的起源.
- 提出修订后的强化学习框架,包括生物奖励机制.
主要方法:
- 概念分析整合了神经科学,生理学和学习理论的发现.
- 发展理论框架.发展理论框架.
主要成果:
- 食物的主要奖励信号是在消化过程中内部生成的.
- 这种信号在潜意识中运作,影响有动机的行为.
- 生物奖励是对生理影响的状态依赖的评估.
结论:
- 需要从感官满足到生理状态依赖的奖励评估的范式转变.
- 一个修订后的强化学习模型应该包含潜意识,内在的生物奖励以及它们与目标的联系.
相关概念视频
Instinctive Drift
193
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
193
Reinforcement Schedules
135
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
135
Associative Learning
309
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
309
Purposive Learning
104
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
104
Cognitive Learning
229
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
229
Reinforcement
186
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
186

