Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Decision Making: P-value Method01:09

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Associative Learning01:27

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Law of Effect01:06

Law of Effect

B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle boxes...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Novel meta-diamide insecticide, broflanilide, suppresses the population of common cutworm Spodoptera litura through its lethal and sublethal effects.

Pest management science·2021
Same author

Transcriptomics Analysis Reveals the Immune Response Mechanism of Rabbits with Diarrhea Fed an Antibiotic-Free Diet.

Animals : an open access journal from MDPI·2021
Same author

A needle-like cobalt-based bifunctional catalyst supported on carbon materials for effective overall water splitting.

Nanotechnology·2021
Same author

Bone marrow mesenchymal stem cell-derived exosomes inhibit chondrocyte apoptosis and the expression of MMPs by regulating Drp1-mediated mitophagy.

Acta histochemica·2021
Same author

Herbal medicine derived carbon dots: synthesis and applications in therapeutics, bioimaging and sensing.

Journal of nanobiotechnology·2021
Same author

<i>cis</i>-1,4 Selective Coordination Polymerization of 1,3-Butadiene and Copolymerization with Polar 2-(4-Methoxyphenyl)-1,3-butadiene by Acenaphthene-Based <i>α</i>-Diimine Cobalt Complexes Featuring Intra-Ligand π-π Stacking Interactions.

Polymers·2021
Same journal

Hidden Data Recovery and Forecasting via Next-Generation Reservoir Computing With Multiscale Delay Selection.

IEEE transactions on neural networks and learning systems·2026
Same journal

CAFF-CIL: Causality-Aware Freedom Forgetting Approach for Class-Incremental Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Harmonic Autoencoding Framework for Multiple Tasks in Magnetic Particle Imaging Reconstruction.

IEEE transactions on neural networks and learning systems·2026
Same journal

A Survey on Human-Centric Voice-Face Multimodal Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Vision-Assisted Foundation Model for Solving Multitask Vehicle Routing Problems.

IEEE transactions on neural networks and learning systems·2026
Same journal

FP3O: Enabling Proximal Policy Optimization in Multiagent Cooperation With Parameter-Sharing Versatility.

IEEE transactions on neural networks and learning systems·2026
See all related articles

Related Experiment Videos

Intrinsic Value-Aligned Policy Optimization for Offline-to-Online Reinforcement Learning.

Tenglong Liu, Xin Xu, Xuhui Xie

    IEEE Transactions on Neural Networks and Learning Systems
    |May 19, 2026
    PubMed
    Summary
    This summary is machine-generated.

    Intrinsic Value-Aligned Policy Optimization (IVPO) enhances offline-to-online reinforcement learning by balancing optimism and pessimism in Q-value estimation. This novel approach mitigates performance drops during online finetuning, achieving state-of-the-art results.

    Related Experiment Videos

    Area of Science:

    • Artificial Intelligence
    • Machine Learning
    • Reinforcement Learning

    Background:

    • Offline-to-online reinforcement learning (O2O RL) leverages pretrained policies for efficient adaptation.
    • Distribution shift during online finetuning causes significant performance degradation.
    • Current methods struggle to balance optimism and pessimism in Q-value estimation.

    Purpose of the Study:

    • To introduce a novel method, Intrinsic Value-Aligned Policy Optimization (IVPO), to address performance drops in O2O RL.
    • To improve Q-value estimation by integrating intrinsic value extraction.
    • To enhance policy improvement in O2O RL settings.

    Main Methods:

    • Developed IVPO, incorporating intrinsic value extraction to compress offline state knowledge.
    • Learned an intrinsic value function to guide Q-value updates during online learning.
    • Integrated intrinsic and Q-value functions to calibrate estimations and suppress overestimation of out-of-distribution actions.

    Main Results:

    • IVPO effectively mitigates Q-value estimation errors.
    • Achieved state-of-the-art performance on the D4RL benchmark.
    • Improved overall task performance by 54.3% across 18 tasks initialized from offline policies.

    Conclusions:

    • IVPO offers a principled approach to balancing optimism and pessimism in O2O RL.
    • The method significantly enhances policy performance by improving Q-value accuracy.
    • Theoretical analysis supports IVPO's regret bound and convergence properties.