相关实验视频
Updated: May 27, 2025

09:45
New Variations for Strategy Set-shifting in the Rat
Published on: January 23, 2017
8.1K
用于分配强化学习的对手条形电路
Adam S Lowet1,2,3, Qiao Zheng1,4, Melissa Meng1,2
1Center for Brain Science, Harvard University, Cambridge, MA, USA.
Nature
|February 19, 2025
概括
分布式强化学习 (RL) 模式奖励的是分布,而不是平均值. 这项研究揭示了多巴胺和条状神经元如何编码奖励差异,
科学领域:
- 神经科学
- 计算神经科学
- 机器学习
背景情况:
- 机器学习的进步通过考虑整个奖励分布来利用分布式强化学习 (RL).
- 哺乳动物大脑的半边缘多巴胺系统与RL有关,主要是通过状体的平均值更新.
- 关于纹状神经元如何编码高阶奖励分布的知识有限.
研究的目的:
- 研究哺乳动物大脑中奖励分配时刻的神经编码.
- 确定条形体和多巴胺在分布性RL中的作用.
- 阐明不同条状神经元类型对奖励差异编码的贡献.
主要方法:
- 高密度的神经像素记录小鼠在经典调节任务中的条纹活动.
- 奖励平均值,差异和刺激标识的独立操纵.
- 慢性多巴胺输入切除,双光子成像和光遗传学.
主要成果:
- 状神经元表现出奖励差异的抽象编码,挑战传统的RL模型.
- 多巴胺输入切除破坏了分布表征,但没有平均值编码.
- D1和D2中等状神经元分别对奖励分布的右和左尾进行编码.
结论:
- 条形体和中边缘多巴胺系统通过抽象差异编码支持分布式RL.
- 多巴胺在维持这些分布表征方面起着至关重要的作用.
- 一个新的条状功能模型利用D1/D2神经元对抗来分配RL的好处.
相关概念视频
Neural Circuits
996
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
996
Diencephalon: Thalamus and Information Relay
1.4K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
1.4K
Instinctive Drift
177
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
177
Associative Learning
283
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
283
Indirect Motor Pathways
1.4K
The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
1.4K

