Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement Schedules01:24

Reinforcement Schedules

144
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
144
Reinforcement01:23

Reinforcement

204
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
204
Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

548
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
548
Law of Effect01:06

Law of Effect

1.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.4K
Primary and Secondary Reinforcers01:23

Primary and Secondary Reinforcers

249
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
249
Behavior Modification01:21

Behavior Modification

146
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
146

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Latent subdimensions of anxiety and depression differentially influence exertion of effort in pursuit of reward versus avoidance of threat.

Translational psychiatry·2026
Same author

Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum.

eLife·2026
Same author

Uncertainty for better and worse.

Current opinion in neurobiology·2026
Same author

Dopamine dynamics in human anterior cingulate cortex during Pavlovian-instrumental conflict.

bioRxiv : the preprint server for biology·2026
Same author

Modality-general sensitivity of pupil responses to regularity violations.

Cognitive, affective & behavioral neuroscience·2026
Same author

Metacognitive efficiency in learned value-based choice.

PLoS computational biology·2026
Same journal

Double dissociation in the involvement of noradrenergic and endocannabinoid systems in classical and higher-order conditioning in newborn rabbits.

Neurobiology of learning and memory·2026
Same journal

An occasion for reflection: Pavlovian modulation of conditioned responding by interoceptive drug stimuli.

Neurobiology of learning and memory·2026
Same journal

Chemogenetic disruption of the hippocampus impairs gustatory preconditioning in rats.

Neurobiology of learning and memory·2026
Same journal

Corrigendum to "Dynamic regulation of neuronal vault trafficking and RNA cargo by the noncoding RNA, Vaultrc5" [Neurobiol. Learn. Memory 225 (2026) 108161].

Neurobiology of learning and memory·2026
Same journal

Modeling the coexistence of NMDAR-dependent LTP and LTD mediated by changes in AMPAR conductance.

Neurobiology of learning and memory·2026
Same journal

No evidence for a protein-synthesis-dependent form of long-term fear memory: Translational inhibition and neural inactivation disrupt short- and long-term memory measures to the same degree.

Neurobiology of learning and memory·2026
See all related articles

Related Experiment Video

Updated: Jun 29, 2025

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.0K

Bayesian reinforcement learning: A basic overview.

Pyungwon Kang1, Philippe N Tobler1, Peter Dayan2

  • 1University of Zurich, Department of Economics, Laboratory for Social and Neural Systems Research, Zurich, Switzerland.

Neurobiology of Learning and Memory
|April 5, 2024
PubMed
Summary
This summary is machine-generated.

Learning occurs due to uncertainty about the world. The influential Rescorla-Wagner rule is reviewed within a Bayesian framework, linking uncertainty and prediction errors to learning and its extensions.

Keywords:
Bayesian approachReinforcement learning

More Related Videos

Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

11.0K
A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis
05:41

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

Published on: February 6, 2020

9.4K

Related Experiment Videos

Last Updated: Jun 29, 2025

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents
07:05

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published on: September 10, 2018

6.0K
Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

11.0K
A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis
05:41

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

Published on: February 6, 2020

9.4K

Area of Science:

  • Cognitive Science
  • Neuroscience
  • Machine Learning

Background:

  • Learning is driven by uncertainty and prediction errors.
  • The Rescorla-Wagner rule is a foundational model in associative learning.
  • This rule is equivalent to the delta rule in engineering applications.

Purpose of the Study:

  • To review the Rescorla-Wagner rule within a Bayesian framework.
  • To precisely link uncertainty and learning.
  • To discuss extensions accommodating broader learning phenomena.

Main Methods:

  • Bayesian embedding of the Rescorla-Wagner rule.
  • Analysis of prediction error-driven learning.
  • Exploration of extensions like Kalman filters and structure learning.

Main Results:

  • The Bayesian context clarifies the relationship between uncertainty and learning.
  • Extensions allow for modeling a wider range of uncertainties.
  • The framework accommodates diverse conditioning phenomena.

Conclusions:

  • A Bayesian approach enhances understanding of the Rescorla-Wagner rule.
  • This framework provides a unified view of learning under uncertainty.
  • Future research can explore further extensions for complex learning scenarios.