Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement Schedules01:24

Reinforcement Schedules

342
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
342
Observational Learning01:12

Observational Learning

669
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
669
Real-World Application of Classical Conditioning01:15

Real-World Application of Classical Conditioning

1.0K
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
1.0K
Primary and Secondary Reinforcers01:23

Primary and Secondary Reinforcers

620
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
620
Reinforcement01:23

Reinforcement

635
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
635
Cognitive Learning01:21

Cognitive Learning

882
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
882

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Latent subdimensions of anxiety and depression differentially influence exertion of effort in pursuit of reward versus avoidance of threat.

Translational psychiatry·2026
Same author

AI-Discovered Cognitive Models Reveal Novel Insights into Human and Animal Learning.

bioRxiv : the preprint server for biology·2026
Same author

Functional reorganization of motor cortex connectivity during learning.

bioRxiv : the preprint server for biology·2026
Same author

Hybrid neural-cognitive models reveal how memory shapes human reward learning.

Nature human behaviour·2026
Same author

A habit and working memory model as an alternative account of human reward-based learning.

Nature human behaviour·2025
Same author

Striatal dopamine can enhance both fast working memory, and slow reinforcement learning, while reducing implicit effort cost sensitivity.

Nature communications·2025

Related Experiment Video

Updated: Nov 29, 2025

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.7K

Computational evidence for hierarchically structured reinforcement learning in humans.

Maria K Eckstein1, Anne G E Collins2

  • 1Department of Psychology, University of California, Berkeley, CA 94704.

Proceedings of the National Academy of Sciences of the United States of America
|November 24, 2020
PubMed
Summary
This summary is machine-generated.

Human decision-making utilizes hierarchical reinforcement learning (RL) for complex environments. This biologically inspired algorithm explains human flexibility and learning speed, surpassing current machine learning models.

Keywords:
computational modelinghierarchyreinforcement learningstructure learningtask-sets

More Related Videos

Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning
11:20

Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning

Published on: June 2, 2014

12.2K
The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents
09:01

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

Published on: July 8, 2015

12.9K

Related Experiment Videos

Last Updated: Nov 29, 2025

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents
09:13

A Fully Automated and Highly Versatile System for Testing Multi-cognitive Functions and Recording Neuronal Activities in Rodents

Published on: May 3, 2012

14.7K
Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning
11:20

Recording Single Neurons' Action Potentials from Freely Moving Pigeons Across Three Stages of Learning

Published on: June 2, 2014

12.2K
The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents
09:01

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

Published on: July 8, 2015

12.9K

Area of Science:

  • Cognitive Science
  • Neuroscience
  • Artificial Intelligence

Background:

  • Humans excel at flexible goal achievement in dynamic environments, outperforming machine learning.
  • Abstract, hierarchical representations are key to human learning and decision-making, but their mechanisms remain unclear.

Purpose of the Study:

  • To investigate whether human behavior aligns with hierarchical reinforcement learning (RL) principles.
  • To identify behavioral markers indicative of hierarchical RL in human decision-making.

Main Methods:

  • An experiment was designed with subtasks to elicit context-based learning.
  • Behavioral data were collected and analyzed for specific markers of hierarchical RL.
  • Simulations of classic RL, hierarchical RL, and hierarchical Bayesian models were compared against human data.

Main Results:

  • Observed behavioral markers included asymmetric switch costs, faster learning in higher-valued contexts, and context preference.
  • Hierarchical RL models accurately predicted all observed human behavioral patterns.
  • Flat RL and hierarchical Bayesian models partially explained human behavior but not comprehensively.

Conclusions:

  • Human behavior in complex, hierarchical environments can be effectively characterized by hierarchical RL.
  • This biologically inspired and computationally simple algorithm offers a powerful framework for understanding human cognition.
  • Findings open new avenues for research integrating cognitive science and artificial intelligence.