Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

Reinforcement Schedules

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

Avoidance Learning and Learned Helplessness

Avoidance Learning and Learned Helplessness

Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...

Generalization, Discrimination, and Extinction

Generalization, Discrimination, and Extinction

Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

Reinforcement

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Self-Organized Nanoplasmonic Artificial Leaf for Hot-Carrier Bioelectronic Interfaces.

Nature photonics·2026

Same author

Toxic effects of perfluoroalkyl and polyfluoroalkyl substances (PFAS) on the gut microenvironment and their potential association with colorectal cancer.

Toxicology mechanisms and methods·2026

Same author

Engineering next-generation organoids: A review on bioprinting strategies, bioink innovations, and frontier applications.

Journal of tissue engineering·2026

Same author

Development and validation of a predictive nomogram for cage migration after posterior lumbar interbody fusion: a retrospective study of 517 patients.

Frontiers in surgery·2026

Same author

Single- and Multi-Trait GWASs Combined with Genetic Parameter Estimation Reveal Candidate Genes for Body Conformation Traits in Sika Deer (<i>Cervus nippon</i>).

Animals : an open access journal from MDPI·2026

Same author

All-solution-processed mid-infrared electrochromics (ASPIRE) for thermoregulation with arbitrary curvatures.

Materials horizons·2026

Search research articles

Related Experiment Video

Updated: Aug 3, 2025

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

Improvement of Reinforcement Learning With Supermodularity.

Ying Meng, Fengyuan Shi, Lixin Tang

IEEE Transactions on Neural Networks and Learning Systems

|April 7, 2023

Summary

This summary is machine-generated.

This study introduces a monotonicity cut to reduce action spaces in reinforcement learning (RL) by leveraging supermodularity. This method effectively improves RL performance in dynamic decision-making tasks.

More Related Videos

The "Motor" in Implicit Motor Sequence Learning: A Foot-stepping Serial Reaction Time Task

The "Motor" in Implicit Motor Sequence Learning: A Foot-stepping Serial Reaction Time Task

Published on: May 3, 2018

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

Related Experiment Videos

Last Updated: Aug 3, 2025

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Investigating Motor Skill Learning Processes with a Robotic Manipulandum

Published on: February 12, 2017

The "Motor" in Implicit Motor Sequence Learning: A Foot-stepping Serial Reaction Time Task

The "Motor" in Implicit Motor Sequence Learning: A Foot-stepping Serial Reaction Time Task

Published on: May 3, 2018

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

Area of Science:

Artificial Intelligence
Operations Research

Background:

Reinforcement learning (RL) addresses dynamic decision-making but often struggles with large action spaces.
Current RL research primarily focuses on state or action evaluation improvements.

Purpose of the Study:

To investigate reducing action space in RL using supermodularity.
To introduce a monotonicity cut for pruning unpromising actions.

Main Methods:

Parameterized optimization problems are used to model multistage decision processes in dynamic environments.
Monotone comparative statics are applied to Markov decision processes (MDPs) with supermodularity.
A monotonicity cut is proposed to eliminate suboptimal actions, demonstrated with the bin packing problem (BPP).

Main Results:

The study demonstrates the effectiveness of the monotonicity cut in pruning the action space.
Evaluations on benchmark datasets show improved performance compared to baseline RL algorithms.
Supermodularity and the monotonicity cut are shown to enhance RL efficiency.

Conclusions:

The monotonicity cut is an effective technique for improving reinforcement learning performance.
Leveraging supermodularity offers a novel approach to action space reduction in RL.
This method enhances decision-making efficiency in dynamic environments.