相关实验视频
Updated: Jun 20, 2025

08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
20.8K
人类在强化学习任务中寻求奖励
Meriam Zid1, Veldon-James Laurie1, Jorge Ramírez-Ruiz1
1Department of Neuroscience, University of Montreal, Montreal, QC , H3T 1J4, Canada.
bioRxiv : the preprint server for biology
|July 19, 2024
概括
人类通过将选择与门进行比较来做出决定,而不仅仅是通过比较替代品. 这种新的"食"模型更好地解释了在不确定的环境中决策和选择的重复.
科学领域:
- 认知神经科学 认知神经科学
- 决策科学 决策科学 决策科学
- 行为经济学是一种行为经济学.
背景情况:
- 经典模型建议比较选项价值来选择.
- 伦理学观点建议承诺一个选项,直到它的价值下降.
研究的目的:
- 调查哪个决策模式 (比较-替代与比较-值) 更好地描述在不确定的环境中的人类行为.
- 开发和验证一种基于比较到值计算的新增强化学习 (RL) 模型.
主要方法:
- 参与者从事经典的比较-替代决策任务.
- 一个新的计算模型,称为"食",是基于比较到值逻辑开发的.
- 模型性能与参与者行为进行了评估,并与现有的RL模型进行了比较.
主要成果:
- 在比较替代任务中的人类决策与比较值计算保持一致.
- 与之前的RL模型相比",食"模型显示出与参与者行为相比更好的适应性.
- 食模型准确地预测了选择的重复,并保留了参与者数据.
结论:
- 在不确定的环境中,人类的顺序决策依赖于比较值机制.
- 采集模型为理解这些决策提供了一个比传统的比较替代模型更准确的计算框架.
相关概念视频
Instinctive Drift
203
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
203
Behaviorism
2.3K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.3K
What is Behavior?
9.0K
Behaviors are actions that an organism engages in—they can be related to finding food, reproducing, defending against threats, and many other possible actions. Behaviors include activities related to the environment around the animal—such as migration—as well as social interactions within a species or population. Many behaviors involve motor output—that is, muscle movements—while others involve less visible actions, such as learning.
9.0K
Timing and Consequences on Behavior
88
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
88
Cognitive Learning
237
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
237
Primary and Secondary Reinforcers
233
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
233

