相关实验视频
Updated: Jul 5, 2025

09:45
New Variations for Strategy Set-shifting in the Rat
Published on: January 23, 2017
8.2K
一个对手的条形电路用于分布式增强学习
Adam S Lowet1,2,3, Qiao Zheng1,4, Melissa Meng1,2
1Center for Brain Science, Harvard University, Cambridge, MA, USA.
bioRxiv : the preprint server for biology
|January 23, 2024
概括
这项研究表明,条形体编码奖励差异,这是分布式强化学习 (RL) 的一个关键方面. 多巴胺是一种多巴胺.
科学领域:
- 神经科学是一个神经科学.
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 分布强化学习 (RL) 通过考虑奖励分布来增强机器学习.
- 半边缘多巴胺系统与RL有关,更新条形体中的平均值表示.
- 大脑中高阶奖励时刻的神经编码在很大程度上是未知的.
研究的目的:
- 调查状体中奖励分配时刻的神经编码.
- 确定多巴胺和条状神经元在分布式RL中的作用.
- 提出一个新的模型,用于RL的条状功能.
主要方法:
- 高密度神经像素记录在小鼠中执行经典的调节任务.
- 独立操纵奖励平均值,差异和刺激的身份.
- 多巴胺输入切除,双光子成像和光遗传学.
主要成果:
- 条纹体强大地编码奖励变异的抽象表示.
- 多巴胺输入消去破坏了差异编码,但没有中值编码.
- D1和D2中等状神经元 (MSN) 编码不同的奖励分布尾巴.
结论:
- 条纹体编码奖励差异,扩展了传统的RL模型.
- 多巴胺调节条纹体中的分布表征.
- 一个D1/D2MSN对立性的模型解释了分布式RL的好处.
相关概念视频
Neural Circuits
1.2K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Diencephalon: Thalamus and Information Relay
1.6K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
1.6K
Instinctive Drift
224
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
224
Associative Learning
370
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
370
Indirect Motor Pathways
1.5K
The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
1.5K

