Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Primary and Secondary Reinforcers01:23

Primary and Secondary Reinforcers

571
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
571
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

234
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
234
Reinforcement Schedules01:24

Reinforcement Schedules

316
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
316
Spare Receptors01:30

Spare Receptors

4.3K
Some receptors remain unoccupied even when an agonist produces a maximal response. Such empty ones are called spare receptors. In presence of spare receptors the maximum effect of an agonist drug is achieved with fewer than 100% of the receptors being occupied. To determine the presence of spare receptors, scientists often compare the concentration of the drug needed to produce 50% of the maximum effect (EC50) with the concentration of the drug needed to occupy 50% of the receptors (Kd). If the...
4.3K
Adrenergic Agonists: Indirect-Acting Agents01:25

Adrenergic Agonists: Indirect-Acting Agents

2.3K
Indirect-acting adrenergic agonists potentiate the effects of endogenous catecholamines through different mechanisms without directly binding to adrenoceptors.
One mechanism involves depleting stored catecholamines by displacing them from synaptic vesicles. These agents, known as "displacers," are transported into vesicles at the expense of noradrenaline. Examples include amphetamine and tyramine, which lack a catechol moiety, resulting in prolonged action, improved oral...
2.3K
Drugs Affecting Neurotransmitter Synthesis01:29

Drugs Affecting Neurotransmitter Synthesis

1.8K
Drugs affecting neurotransmitter synthesis can impact the adrenergic neuron and the synthesis of neurotransmitters. For example, α-methyltyrosine and carbidopa target specific enzymes involved in catecholamine synthesis. α-methyltyrosine inhibits the enzyme tyrosine hydroxylase, which converts tyrosine into dopamine. By blocking this enzyme, α-methyltyrosine reduces dopamine production and other catecholamines. Carbidopa, on the other hand, inhibits the enzyme dopa decarboxylase,...
1.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Fine-mapping candidate neuropsychiatric regulatory variants using cell type-aware comparative genomics.

bioRxiv : the preprint server for biology·2026
Same author

Neural correlates of combinatorial reasoning in prefrontal cortex.

bioRxiv : the preprint server for biology·2026
Same author

Rhesus macaque choices reveal that ambiguity aversion is driven by pessimistic probability estimates.

bioRxiv : the preprint server for biology·2025
Same author

A Multimodal Atlas Reveals the Anatomical Distribution of Medium Spiny Neuron Subtypes and a Novel RGS6+ Population in the Primate Striatum.

bioRxiv : the preprint server for biology·2025
Same author

Challenges in Predicting Chromatin Accessibility Differences between Species.

bioRxiv : the preprint server for biology·2025
Same author

Dissociable Effects of Curiosity and Hedonic Valence on Reinforcement Learning.

bioRxiv : the preprint server for biology·2025
Same journal

Neural timescales from a computational perspective.

Nature neuroscience·2026
Same journal

Author Correction: Spinal cord Tau pathology induces tactile deficits and cognitive impairment in Alzheimer's disease via dysregulation of CCK neurons.

Nature neuroscience·2026
Same journal

Hippocampal theta sweeps indicate goal direction during navigation.

Nature neuroscience·2026
Same journal

Just how goal-directed are hippocampal theta sweeps, anyway?

Nature neuroscience·2026
Same journal

Goal-directed hippocampal theta sweeps during memory-guided navigation.

Nature neuroscience·2026
Same journal

Connectomic evidence that ordered activity drives neuromuscular network formation.

Nature neuroscience·2026
See all related articles

Related Experiment Video

Updated: Nov 14, 2025

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.6K

Rare rewards amplify dopamine responses.

Kathryn M Rothenhoefer1,2,3,4, Tao Hong2,3,4,5, Aydin Alikaya1,2,3,4

  • 1Center for Neuroscience, University of Pittsburgh, Pittsburgh, PA, USA.

Nature Neuroscience
|March 9, 2021
PubMed
Summary
This summary is machine-generated.

Dopamine neurons signal reward prediction errors, crucial for learning. Rare rewards significantly amplify these dopamine signals, even with similar prediction errors, revealing complex incentive learning.

More Related Videos

Investigating Drivers of Antireward in Addiction Behavior with Anatomically Specific Single-Cell Gene Expression Methods
09:29

Investigating Drivers of Antireward in Addiction Behavior with Anatomically Specific Single-Cell Gene Expression Methods

Published on: August 4, 2022

2.4K
Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry
08:49

Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry

Published on: January 12, 2012

22.2K

Related Experiment Videos

Last Updated: Nov 14, 2025

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.6K
Investigating Drivers of Antireward in Addiction Behavior with Anatomically Specific Single-Cell Gene Expression Methods
09:29

Investigating Drivers of Antireward in Addiction Behavior with Anatomically Specific Single-Cell Gene Expression Methods

Published on: August 4, 2022

2.4K
Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry
08:49

Presynaptic Dopamine Dynamics in Striatal Brain Slices with Fast-scan Cyclic Voltammetry

Published on: January 12, 2012

22.2K

Area of Science:

  • Neuroscience
  • Computational Neuroscience
  • Behavioral Economics

Background:

  • Dopamine prediction error signals are fundamental to reinforcement learning.
  • The influence of reward distribution shape on dopamine neuron activity remains largely unexplored.

Purpose of the Study:

  • To investigate how dopamine neurons encode information about the shape of reward distributions.
  • To determine if reward frequency and prediction error magnitude differentially impact dopamine signals.

Main Methods:

  • Utilized symmetrical reward distributions with varying tail weights in a behavioral task.
  • Recorded dopamine neuron activity in response to different reward schedules and prediction errors.

Main Results:

  • Dopamine responses were amplified by rare rewards, independent of conventional prediction error magnitude.
  • This amplification suggests a specific encoding of reward rarity within dopamine signals.

Conclusions:

  • Dopamine neurons encode more than just prediction errors; they reflect reward distribution complexities.
  • This finding offers a mechanism for learning intricate, real-world incentive structures.