関連する実験動画
Updated: Aug 14, 2026

08:30
Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
インストゥルメンタル・コンディショニングにおける腹部と背部のストライアトムの分離可能な役割
John O'Doherty1, Peter Dayan, Johannes Schultz
1Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK. j.odoherty@fil.ion.ucl.ac.uk
まとめ
この研究は,報酬の予測と,インストゥルメンタル・コンディショニングにおける行動の選択のための,異なる脳領域を明らかにしている. 腹筋のストライアタムは報酬予測の批評家として機能し,背筋のストライアタムは行動選択の俳優として機能する.
科学分野:
- 神経科学は神経科学である.
- コグニティブ・サイエンス コグニティブ・サイエンス
- 強化学習による学習です.
背景:
- インストゥルメンタル・コンディショニングは,学習行動と結果の関連性を含む.
- 強化学習モデルでは,批評家と俳優の役割が区別されている.
- 批評家は将来の報酬を予測し,俳優は行動を選択する.
研究 の 目的:
- ヒトにおける楽器的条件付けの神経基礎を調査する.
- 批評家と俳優の機能に関連する脳領域を区別する.
主な方法:
- 機能性磁気共鳴画像 (fMRI) が使用されました.
- 人間参加者は,インストゥルメンタル・コンディショニング・タスクを受けた.
- タスク中に脳活動が分析されました.
主要な成果:
- 腹部と背部のストライアタムの部分的に異なる貢献が観察されました.
- 腹筋のストライアタムは,批判的機能 (報酬予測) と相関していた.
- 背面のストライアタムは俳優の機能 (アクション・セレクション) と相関していた.
結論:
- 腹部と背面のストライアタムは,楽器の条件付けで分離可能な役割を果たします.
- 発見は,人間の脳における強化学習の批評家-俳優モデルを支持しています.
関連する概念動画
Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
Classical Conditioning
Associative learning, a core principle in behavioral psychology, involves forming connections between events and facilitating learned responses. This concept is vividly illustrated by classical conditioning, a process extensively studied by the Russian physiologist Ivan Pavlov. Pavlov's pioneering research on dogs' digestive systems led to the discovery that behaviors can be learned through association, laying the groundwork for classical conditioning.
Ivan Pavlov observed that dogs salivated...
Ivan Pavlov observed that dogs salivated...
Principles of Classical Conditioning
Classical conditioning, as described by Ivan Pavlov, is a foundational concept in associative learning, where a neutral stimulus becomes capable of eliciting a conditioned response through association with an unconditioned stimulus. The process of acquisition, where this learning occurs, and the subsequent phenomena of contiguity, contingency, generalization, discrimination, extinction, and spontaneous recovery are crucial for a comprehensive understanding of classical conditioning.
During the...
During the...
Operant Conditioning
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Role of Shaping in Operant Conditioning
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
Instinctive Drift
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...

