相关实验视频
Updated: Aug 14, 2026

08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
腹部和背部条纹体在仪器调节中的可分离作用
John O'Doherty1, Peter Dayan, Johannes Schultz
1Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK. j.odoherty@fil.ion.ucl.ac.uk
概括
这项研究揭示了在仪器调节中用于奖励预测和动作选择的独特大脑区域. 腹部条纹体作为奖励预测的批评者,而背部条纹体作为行动选择的演员.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 强化学习是一种强化学习.
背景情况:
- 仪器条件化涉及学习行动-结果关联.
- 强化学习模型提出了不同的批评者和演员角色.
- 评论家预测未来的奖励,而演员选择行动.
研究的目的:
- 为了研究人类仪器调节的神经基础.
- 为了区分与批评者和演员功能相关的大脑区域.
主要方法:
- 使用了功能磁共振成像 (fMRI).
- 人类参与者接受了仪器调节任务.
- 在任务过程中分析了大脑活动.
主要成果:
- 观察到腹部和背部条纹体的部分不同贡献.
- 腹部条纹体与关键功能 (奖励预测) 相相关.
- 背上条纹体与演员功能 (动作选择) 相关联.
结论:
- 腹部和背部条纹体在仪器调节中起着不可分割的作用.
- 这些发现支持了人类大脑中强化学习的批评者-演员模型.
相关概念视频
Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
Classical Conditioning
Associative learning, a core principle in behavioral psychology, involves forming connections between events and facilitating learned responses. This concept is vividly illustrated by classical conditioning, a process extensively studied by the Russian physiologist Ivan Pavlov. Pavlov's pioneering research on dogs' digestive systems led to the discovery that behaviors can be learned through association, laying the groundwork for classical conditioning.
Ivan Pavlov observed that dogs salivated...
Ivan Pavlov observed that dogs salivated...
Principles of Classical Conditioning
Classical conditioning, as described by Ivan Pavlov, is a foundational concept in associative learning, where a neutral stimulus becomes capable of eliciting a conditioned response through association with an unconditioned stimulus. The process of acquisition, where this learning occurs, and the subsequent phenomena of contiguity, contingency, generalization, discrimination, extinction, and spontaneous recovery are crucial for a comprehensive understanding of classical conditioning.
During the...
During the...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Role of Shaping in Operant Conditioning
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
Instinctive Drift
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...

