関連する実験動画
Updated: May 27, 2025

09:45
New Variations for Strategy Set-shifting in the Rat
Published on: January 23, 2017
8.1K
配分強化学習のための対抗線状回路
Adam S Lowet1,2,3, Qiao Zheng1,4, Melissa Meng1,2
1Center for Brain Science, Harvard University, Cambridge, MA, USA.
Nature
|February 19, 2025
まとめ
分布強化学習 (DL) モデルでは 平均値だけでなく 分布値も評価されます この研究は ドーパミンと線状神経が 報酬の分散をどのようにコードするかを明らかにし 脳のRLに関する理解を深めています
科学分野:
- 神経科学
- 計算神経科学
- 機械学習
背景:
- 機械学習の進歩は,報酬分布全体を考慮することによって,分布強化学習 (RL) を利用します.
- 哺乳類の脳のメソリンビック・ドーパミンは,主にストライアトムの平均値更新によって,RLに関与しています.
- ストライタルニューロンが報酬分布のより高次の瞬間をどのようにコードするかについては,限られた知識が存在する.
研究 の 目的:
- 哺乳類の脳の報酬分配の 神経コードを調査する
- 配分RLにおけるストライアタムとドーパミンの役割を決定する.
- 異なるストライタルニューロンタイプが 差異コード化に与える貢献を明らかにする.
主な方法:
- 高密度ニューロピクセルで クラシックなコンディショニングタスク中のマウスの ストライタル活動の記録
- 報酬の平均値,変数,および刺激のアイデンティティの独立した操作.
- 慢性ドーパミンインプットアブレーション 2フォトンのカルシウム画像と光遺伝学
主要な成果:
- ストライタルニューロンは報酬の多様性の抽象的なエンコーディングを示し,従来のRLモデルに挑戦しています.
- ドーパミンのインプットアブレーションは 分布表現を混乱させたが,平均値のコーディングはしなかった.
- D1とD2の中間の脊髄神経は,それぞれ報酬分布の右と左の尾を差異的にコードした.
結論:
- ストライアタムとメソリンビック・ドーパミンは,抽象的差異エンコーディングを通じて分布RLをサポートします.
- ドーパミンはこれらの分布表現を維持する上で重要な役割を果たします.
- D1/D2ニューロンの対抗性を利用してRLの分配を図る.
関連する概念動画
Neural Circuits
996
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
996
Diencephalon: Thalamus and Information Relay
1.4K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
1.4K
Instinctive Drift
177
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
177
Associative Learning
283
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
283
Indirect Motor Pathways
1.4K
The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
1.4K

