Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

360
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
360
Reinforcement Schedules01:24

Reinforcement Schedules

462
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
462
Nonlinear Pharmacokinetics: Causes of Nonlinearity01:22

Nonlinear Pharmacokinetics: Causes of Nonlinearity

711
Nonlinearity in drug pharmacokinetics is caused by various factors influencing how a drug is absorbed, distributed, metabolized, and excreted. Understanding these nonlinear processes is crucial for predicting drug behavior in the body and optimizing drug dosing regimens.
Nonlinear drug absorption can occur when the process is rate-limited by solubility, carrier-mediated transport systems, or saturation of the presystemic gut wall or hepatic metabolism. For instance, high doses of riboflavin...
711
Reinforcement01:23

Reinforcement

842
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
842
Regression Toward the Mean01:52

Regression Toward the Mean

6.9K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.9K
Avoidance Learning and Learned Helplessness01:14

Avoidance Learning and Learned Helplessness

2.5K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Humans adapt rationally to approximate estimates of uncertainty.

eLife·2025
Same author

Individualistic attitudes in Iterated Prisoner's Dilemma undermine evolutionary fitness and may drive cooperative human players to extinction.

Royal Society open science·2024
Same author

Adaptive learning from outcome contingencies in eating-disorder risk groups.

Translational psychiatry·2023
Same author

Depression is associated with reduced outcome sensitivity in a dual valence, magnitude learning task.

Psychological medicine·2023
Same author

Using a generative model of affect to characterize affective variability and its response to treatment in bipolar disorder.

Proceedings of the National Academy of Sciences of the United States of America·2022
Same author

Dynamic modulation of inequality aversion in human interpersonal negotiations.

Communications biology·2022

Related Experiment Video

Updated: Jan 18, 2026

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder
08:51

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

Published on: December 15, 2023

2.0K

A nonlinear relationship between prediction errors and learning rates in human reinforcement-learning.

Boluwatife Ikwunne1, Jolie Parham1, Erdem Pulcu1,2,3

  • 1Psychopharmacology and Emotion Research Lab, Department of Psychiatry, University of Oxford, Oxford, United Kingdom.

Plos Computational Biology
|September 12, 2025
PubMed
Summary
This summary is machine-generated.

This study reveals a novel nonlinear relationship between prediction errors and learning rates in reinforcement learning models. An exponential-logarithmic function explains how prediction errors instantly update learning rates, impacting agent adaptation.

More Related Videos

New Variations for Strategy Set-shifting in the Rat
09:45

New Variations for Strategy Set-shifting in the Rat

Published on: January 23, 2017

8.6K
Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task
11:18

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

Published on: June 1, 2015

11.1K

Related Experiment Videos

Last Updated: Jan 18, 2026

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder
08:51

Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

Published on: December 15, 2023

2.0K
New Variations for Strategy Set-shifting in the Rat
09:45

New Variations for Strategy Set-shifting in the Rat

Published on: January 23, 2017

8.6K
Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task
11:18

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

Published on: June 1, 2015

11.1K

Area of Science:

  • Computational Neuroscience
  • Machine Learning
  • Cognitive Science

Background:

  • Reinforcement learning (RL) models explain adaptive behavior in dynamic environments.
  • The precise relationship between prediction errors (PEs) and learning rates in RL is not well understood.

Purpose of the Study:

  • To investigate the nonlinear relationship between PEs and learning rates in RL.
  • To introduce a novel RL model incorporating an exponential-logarithmic function for PEs and learning rates.

Main Methods:

  • Simulations of RL agents.
  • Reanalysis of existing RL datasets.
  • A novel experiment to test the proposed model.

Main Results:

  • Demonstrated a nonlinear relationship between PEs and learning rates across simulations, dataset reanalyses, and a new experiment.
  • Developed an exponential-logarithmic function to model the instantaneous transformation of PEs into learning rates.
  • Observed physiological correlates of learning rates accumulating during belief updating, aligning with model predictions.

Conclusions:

  • The study introduces a novel, nonlinear model for understanding PE-learning rate dynamics in RL.
  • This framework provides a more accurate representation of how agents adapt to changing environments.
  • Findings suggest physiological mechanisms underlying learning rate adjustments based on prediction errors.