報酬に関連する学習の細胞メカニズム
J N Reynolds1, B I Hyland, J R Wickens
1The Neuroscience Research Centre, University of Otago, School of Medical Sciences, Dunedin, New Zealand.
Nature
|September 7, 2001
まとめ
ポジティブな補強学習は,脳のメカニズムによって制御されます. Substantia nigraの刺激は,皮質からのストレータムへのインプットを強化し,学習した行動を強化します.
科学分野:
- 神経科学は神経科学である.
- 行動神経科学は,行動神経科学である.
- 細胞メカニズム 細胞メカニズム
背景:
- ポジティブな補強は,学習と行動に不可欠です.
- ブラック物質は,報酬と運動制御に役割を果たします.
- 強化学習のニューラル基盤を理解することは,重要な研究分野です.
研究 の 目的:
- ポジティブな強化の基礎となる細胞メカニズムを調査する.
- 強化学習における substantia nigraの役割を探求する.
- substantia nigraの電気刺激が,ストライアトームのシナプス可塑性に影響する方法を決定する.
主な方法:
- ネズミの脳内自己刺激 (ICSS) を補強学習のモデルとして利用した.
- 線状神経細胞への皮質の入力に対する黒い物質の刺激の影響を測定した.
- シナプス増強とレバーを押す行動の習得の速度との相関を評価した.
主要な成果:
- Substantia nigraの刺激により,大脳皮質とストライアトームの間のシナプスの強化が誘発された.
- このシナプス増強はドーパミン受容体の活性化に依存していた.
- シナプス増強の程度は,ICSS行動の学習速度と相関しています.
結論:
- Substantia nigraの刺激が学習した行動を強化する細胞メカニズムを提案しています.
- 強化学習中のストライアタムにおけるドーパミン媒介のシナプス可塑性の役割を強調する.
- ストライアタムへの皮質のインプットの強化が,ポジティブな強化における重要な細胞イベントであることを示唆しています.
関連する概念動画
Intracellular Signaling Cascades
Once a ligand binds to a receptor, the signal is transmitted through the membrane and into the cytoplasm. The continuation of a signal in this manner is called signal transduction. Signal transduction only occurs with cell-surface receptors, which cannot interact with most components of the cell, such as DNA. Only internal receptors can interact directly with DNA in the nucleus to initiate protein synthesis. When a ligand binds to its receptor, conformational changes occur that affect the...
Higher Mental Functions of Brain: Learning and Memory
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or playing an...
Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
Real-World Application of Classical Conditioning
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Law of Effect
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...
Timing and Consequences on Behavior
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant factor...


