Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Punishment01:27

Punishment

404
Negative reinforcement and punishment are often confused but serve distinct functions in behavior modification. Reinforcement, whether positive or negative, increases the likelihood of a desired behavior, while punishment decreases it.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
404
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

166
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
166
Reinforcement Schedules01:24

Reinforcement Schedules

257
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
257
Reinforcement01:23

Reinforcement

416
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
416
Observational Learning01:12

Observational Learning

361
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
361
Avoidance Learning and Learned Helplessness01:14

Avoidance Learning and Learned Helplessness

1.9K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Clinical, immunohistochemical, and pathological assessment of a mouse model of experimental autoimmune encephalomyelitis induced by a eukaryotic RpfE-MOG<sub>(35-55)</sub>-expressing plasmid.

Molecular biology reports·2026
Same author

Rethinking MS Therapeutics: From Disease Pathogenesis Mechanisms to AI-Driven Drug Discovery.

Journal of neuroimmune pharmacology : the official journal of the Society on NeuroImmune Pharmacology·2026
Same author

Resilience-related neural similarity during naturalistic movie watching.

Imaging neuroscience (Cambridge, Mass.)·2026
Same author

Ultra-high field brain MRI for functional neurological disorder: opportunities and challenges.

NeuroImage. Clinical·2026
Same author

Increased functional integration of emotional control network across the adult lifespan.

Aging brain·2026
Same author

Magnetic resonance spectroscopy as a non-invasive tool for assessing brain and muscle adaptation to exercise training in older age: a scoping review into existing research.

Experimental gerontology·2026

Related Experiment Video

Updated: Oct 6, 2025

A Procedure to Study Stress-Induced Relapse of Heroin Seeking after Punishment-Imposed Abstinence
08:05

A Procedure to Study Stress-Induced Relapse of Heroin Seeking after Punishment-Imposed Abstinence

Published on: March 23, 2022

2.7K

Self-Punishment and Reward Backfill for Deep Q-Learning.

Mohammad Reza Bonyadi, Rui Wang, Maryam Ziaei

    IEEE Transactions on Neural Networks and Learning Systems
    |January 18, 2022
    PubMed
    Summary

    This study introduces self-punishment (SP) and reward backfill (RB) strategies to solve the credit assignment problem in reinforcement learning (RL). These methods improve agent performance in over 65% of tested games.

    More Related Videos

    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice
    08:59

    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

    Published on: March 3, 2023

    2.3K
    Pavlovian Conditioned Approach Training in Rats
    06:57

    Pavlovian Conditioned Approach Training in Rats

    Published on: February 4, 2016

    11.1K

    Related Experiment Videos

    Last Updated: Oct 6, 2025

    A Procedure to Study Stress-Induced Relapse of Heroin Seeking after Punishment-Imposed Abstinence
    08:05

    A Procedure to Study Stress-Induced Relapse of Heroin Seeking after Punishment-Imposed Abstinence

    Published on: March 23, 2022

    2.7K
    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice
    08:59

    An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

    Published on: March 3, 2023

    2.3K
    Pavlovian Conditioned Approach Training in Rats
    06:57

    Pavlovian Conditioned Approach Training in Rats

    Published on: February 4, 2016

    11.1K

    Area of Science:

    • Artificial Intelligence
    • Machine Learning
    • Computational Neuroscience

    Background:

    • Reinforcement learning (RL) agents learn optimal behaviors by maximizing cumulative rewards from the environment.
    • The credit assignment problem arises when rewards are sparse, making it difficult for agents to determine which actions contributed to the outcome.
    • Existing RL methods struggle with delayed or infrequent rewards, hindering efficient learning.

    Purpose of the Study:

    • To propose novel strategies, self-punishment (SP) and reward backfill (RB), inspired by behavioral psychology to address the credit assignment problem in RL.
    • To develop methods for agents to intrinsically estimate more informative reward values for actions preceding delayed rewards.
    • To ensure proposed strategies maintain policy order and optimality, integrating seamlessly with existing RL algorithms.

    Main Methods:

    • Introduced self-punishment (SP) to penalize actions leading to undesirable terminal states.
    • Implemented reward backfill (RB) to propagate rewards between consecutive rewarded actions.
    • Integrated SP and RB into three popular deep reinforcement learning algorithms.
    • Evaluated the combined strategies on 30 Atari games.

    Main Results:

    • The proposed SP and RB strategies were proven to maintain policy order and optimality under specific assumptions, irrespective of the underlying RL algorithm.
    • Integration with deep RL approaches demonstrated significant performance improvements across various games.
    • Tested methods showed performance enhancements in over 65% of the 30 Atari games.
    • Achieved up to a 25-fold performance improvement in certain games after parameter tuning.

    Conclusions:

    • Self-punishment and reward backfill are effective intrinsic reward estimation strategies for tackling the credit assignment problem in RL.
    • These methods enhance the performance of popular deep RL algorithms, particularly in environments with sparse rewards.
    • The strategies offer a generalizable approach to improve RL agent learning and policy optimization across diverse applications.