Related Experiment Video
Updated: Jul 5, 2025

09:45
New Variations for Strategy Set-shifting in the Rat
Published on: January 23, 2017
8.2K
An opponent striatal circuit for distributional reinforcement learning.
Adam S Lowet1,2,3, Qiao Zheng1,4, Melissa Meng1,2
1Center for Brain Science, Harvard University, Cambridge, MA, USA.
Biorxiv : the Preprint Server for Biology
|January 23, 2024
Summary
This study reveals that the striatum encodes reward variance, a key aspect of distributional reinforcement learning (RL). Dopamine
Area of Science:
- Neuroscience
- Computational Neuroscience
- Machine Learning
Background:
- Distributional reinforcement learning (RL) enhances machine learning by considering reward distributions.
- The mesolimbic dopamine system is implicated in RL, updating mean value representations in the striatum.
- Neural encoding of higher-order reward moments in the brain remains largely unknown.
Conclusions:
- The striatum encodes reward variance, extending traditional RL models.
- Dopamine modulates distributional representations in the striatum.
- A model of D1/D2 MSN opponency explains distributional RL benefits.
Related Concept Videos
Neural Circuits
1.2K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Diencephalon: Thalamus and Information Relay
1.6K
The thalamus, often called “the gateway to the cerebral cortex,” is vital in processing and directing sensory and motor signals throughout the brain. Almost all inputs destined for the cerebral cortex, except for olfactory signals, are relayed through the thalamus. The thalamus is a sophisticated relay station, channeling information from various brain regions to the cerebral cortex, as well as a filter, prioritizing certain signals over others based on current physiological...
1.6K
Instinctive Drift
224
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
224
Associative Learning
370
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
370
Indirect Motor Pathways
1.5K
The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
1.5K

