Related Experiment Video
Updated: Mar 13, 2026

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
11.6K
Dopamine neurons learn relative chosen value from probabilistic rewards
Armin Lak1, William R Stauffer1, Wolfram Schultz1
1Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, United Kingdom.
Elife
|October 28, 2016
Summary
Dopamine neurons in monkeys learn reward value from experienced reward frequencies. This flexible signal reflects economic decision variables and updates neuronal decision mechanisms.
Area of Science:
- Neuroscience
- Behavioral Economics
- Decision Science
Background:
- Economic theories link reward probability to value.
- Individuals learn cue values from reward frequencies.
- Dopamine neuron responses correlate with reward probability and expected value.
Purpose of the Study:
- Investigate how dopamine neurons acquire value signals.
- Determine if dopamine neurons represent economic decision variables.
- Analyze dopamine neuron responses during probabilistic reward choices.
Main Methods:
- Pavlovian learning task in monkeys.
- Assessment of neuronal response acquisition during choices.
- Monitoring dopamine neuron activity.
Main Results:
- Dopamine neurons acquired reward probability-dependent value signals from experienced frequencies.
- Dopamine responses became sensitive to the value of chosen and unchosen options.
- Novelty responses of dopamine neurons decreased with learning.
Conclusions:
- Dopamine neurons acquire predictive value signals based on reward frequency.
- This signal represents a flexible economic decision variable.
- The findings suggest dopamine signals can update neuronal decision mechanisms.
Related Concept Videos
Purposive Learning
558
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
558
Observational Learning
1.1K
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1.1K
Associative Learning
1.7K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.7K
Instinctive Drift
1.1K
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
1.1K
Decision Making: P-value Method
7.1K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
7.1K
Reinforcement Schedules
660
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
660

