Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement Schedules01:24

Reinforcement Schedules

144
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
144
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

90
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
90
Reinforcement01:23

Reinforcement

202
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
202
Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

532
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
532
Real-World Application of Classical Conditioning01:15

Real-World Application of Classical Conditioning

550
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
550
Law of Effect01:06

Law of Effect

1.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Towards adaptive optimal personalization control of robotic hip exoskeleton assistance for individuals with paretic stroke.

IEEE transactions on bio-medical engineering·2026
Same author

Reinforcement Learning Control With Knowledge Shaping.

IEEE transactions on neural networks and learning systems·2023
Same author

Continuous-Time Reinforcement Learning Control: A Review of Theoretical Results, Insights on Performance, and Needs for New Designs.

IEEE transactions on neural networks and learning systems·2023
Same author

A Novel Framework to Facilitate User Preferred Tuning for a Robotic Knee Prosthesis.

IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society·2023
Same author

Hierarchical Optimization for Control of Robotic Knee Prostheses Toward Improved Symmetry of Propulsive Impulse.

IEEE transactions on bio-medical engineering·2022
Same author

Deep Reinforcement Learning for Load Shedding Against Short-Term Voltage Instability in Large Power Systems.

IEEE transactions on neural networks and learning systems·2021
Same journal

Intervention Feasible Region and Driver Risk Capacity Aware Human-Machine Collaborative Safe Trajectory Planning.

IEEE transactions on neural networks and learning systems·2026
Same journal

A Unified Differential Denoising Learning Framework With a Pre-Trained Model and Fuzzy Graph Networks for Drug-Drug Interaction Prediction.

IEEE transactions on neural networks and learning systems·2026
Same journal

Self-Supervised Continuous Dynamic Graph Representation Learning via Hawkes Processes.

IEEE transactions on neural networks and learning systems·2026
Same journal

cPU: Consistent Risk Estimator for Positive-Unlabeled Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing.

IEEE transactions on neural networks and learning systems·2026
Same journal

Hidden Data Recovery and Forecasting via Next-Generation Reservoir Computing With Multiscale Delay Selection.

IEEE transactions on neural networks and learning systems·2026
See all related articles

Related Experiment Video

Updated: Jun 26, 2025

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
09:12

Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

Published on: March 17, 2019

9.5K

Continuous-Time Reinforcement Learning: New Design Algorithms With Theoretical Insights and Performance Guarantees.

Brent A Wallace, Jennie Si

    IEEE Transactions on Neural Networks and Learning Systems
    |May 10, 2024
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces new excitable integral reinforcement learning (EIRL) algorithms for continuous-time affine nonlinear systems. These methods enhance excitation and reduce complexity for better control performance and data efficiency in real-world applications.

    More Related Videos

    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
    09:43

    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

    Published on: April 15, 2014

    10.6K
    Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder
    08:51

    Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

    Published on: December 15, 2023

    1.3K

    Related Experiment Videos

    Last Updated: Jun 26, 2025

    Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats
    09:12

    Three Laboratory Procedures for Assessing Different Manifestations of Impulsivity in Rats

    Published on: March 17, 2019

    9.5K
    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments
    09:43

    A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

    Published on: April 15, 2014

    10.6K
    Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder
    08:51

    Author Spotlight: Unveiling Neural Mechanisms Through Automated Evaluation of Motor Learning and Myelin Plasticity Studies Using the Erasmus Ladder

    Published on: December 15, 2023

    1.3K

    Area of Science:

    • Control Theory
    • Machine Learning
    • Nonlinear Systems

    Background:

    • Continuous-time reinforcement learning (CT-RL) shows promise but lacks real-world application.
    • Adaptive dynamic programming (ADP) has theoretical successes but limited practical demonstration.
    • Existing CT-RL methods struggle with realistic control challenges.

    Purpose of the Study:

    • Introduce novel excitable integral reinforcement learning (EIRL) algorithms.
    • Develop an excitation framework for improved persistence of excitation (PE) and numerical performance.
    • Address control of continuous-time (CT) affine nonlinear systems.

    Main Methods:

    • Developed a new excitation framework using classical control insights.
    • Partitioned complex systems into smaller, manageable subproblems.
    • Leveraged known affine nonlinear dynamics for improved system responses.

    Main Results:

    • Achieved well-behaved system responses and enhanced data efficiency.
    • Demonstrated reduced complexity by breaking problems into subproblems.
    • Provided guarantees for convergence, solution optimality, and closed-loop stability.

    Conclusions:

    • EIRL algorithms offer a viable solution for realistic CT-RL control problems.
    • The proposed methods ensure theoretical guarantees and practical performance.
    • Successfully applied to control an unstable hypersonic vehicle (HSV).