Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reinforcement Schedules

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...

Generalization, Discrimination, and Extinction

Generalization, Discrimination, and Extinction

Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

Reinforcement

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

Purposive Learning

Purposive Learning

E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Inferring genotype-phenotype maps using attention models.

PNAS nexus·2026

Same author

Phenotypic heterogeneity in lag reflects an evolutionarily stable bet-hedging strategy.

bioRxiv : the preprint server for biology·2025

Same author

Reconciling time and prediction error theories of associative learning.

Nature communications·2025

Same author

Adaptive algorithms for shaping behavior.

PLoS computational biology·2025

Same author

Manifold learning for olfactory habituation to strongly fluctuating backgrounds.

bioRxiv : the preprint server for biology·2025

Same author

Distinct information conveyed to the olfactory bulb by feedforward input from the nose and feedback from the cortex.

Nature communications·2024

Search research articles

Related Experiment Video

Updated: Aug 19, 2025

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

Published on: June 1, 2015

A reinforcement-based mechanism for discontinuous learning.

Gautam Reddy^1,2,3

¹Physics & Informatics Laboratories, NTT Research, Inc., Sunnyvale, CA 94085.

Proceedings of the National Academy of Sciences of the United States of America

|November 28, 2022

Summary

This summary is machine-generated.

Reinforcement learning (RL) combined with exploration shows sudden learning insights, not gradual progress. This occurs in structured environments when a "reinforcement wave" reaches the start point, explaining sudden insight phenomena.

Keywords:

foraging navigation physics of behavior reinforcement learning

More Related Videos

Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning

Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning

Published on: June 2, 2014

A Method for Remotely Silencing Neural Activity in Rodents During Discrete Phases of Learning

A Method for Remotely Silencing Neural Activity in Rodents During Discrete Phases of Learning

Published on: June 22, 2015

Related Experiment Videos

Last Updated: Aug 19, 2025

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

Quantifying Learning in Young Infants: Tracking Leg Actions During a Discovery-learning Task

Published on: June 1, 2015

Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning

Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning

Published on: June 2, 2014

A Method for Remotely Silencing Neural Activity in Rodents During Discrete Phases of Learning

A Method for Remotely Silencing Neural Activity in Rodents During Discrete Phases of Learning

Published on: June 22, 2015

Area of Science:

Cognitive Science
Neuroscience
Artificial Intelligence

Background:

Problem-solving and reasoning mimic spatial navigation in complex environments.
Recent mouse experiments reveal a learning discontinuity, suggesting sudden insight.
This contrasts with traditional reinforcement learning's gradual value signal increase.

Purpose of the Study:

To investigate if biologically plausible reinforcement learning (RL) rules with exploration can explain discontinuous learning.
To analyze the dynamics of reinforcement propagation in structured environments.
To establish quantitative relationships between learning rules, exploration, and learning speed.

Main Methods:

Simulated RL agents in tree-like structured environments.
Analysis of nonlinear dynamics of reinforcement propagation.
Examination of agent exploration biases and learning rules.

Main Results:

Biologically plausible RL rules with persistent exploration generically exhibit discontinuous learning.
A
reinforcement wave
with a steep profile emerges in tree-like environments.
Discontinuous learning occurs when the reinforcement wave reaches the starting point.

Conclusions:

Discontinuous learning and sudden insight are emergent properties of RL with exploration in structured environments.
The study provides a quantitative framework linking learning dynamics to exploration strategies.
Findings explain existing data and propose new experimental directions.