Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

From recurrent choice to skill learning: a reinforcement-learning model.

Wai-Tat Fu1, John R Anderson

  • 1Department of Psychology, Carnegie Mellon University, USA. wfu@uiuc.edu

Journal of Experimental Psychology. General
|May 25, 2006
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Combining EEG signals from the 2 members of a team to improve event identification.

Neuroimage. Reports·2026
Same author

Using the environment to predict memory performance.

Journal of experimental psychology. Learning, memory, and cognition·2026
Same author

Reducing Mass Spectrometry Noise via Coupled Desorption Flux and Background Modeling.

Journal of the American Society for Mass Spectrometry·2025
Same author

Tracking the Cognitive Band in an Open-Ended Task.

Cognitive science·2024
Same author

UV damage induces production of mitochondrial DNA fragments with specific length profiles.

Genetics·2024
Same author

The leader RNA of SARS-CoV-2 sequesters polypyrimidine tract binding protein (PTBP1) and influences pre-mRNA splicing in infected cells.

Virology·2024
Same journal

Executive function and social behavior: Causal evidence from loading working memory and inhibitory control.

Journal of experimental psychology. General·2026
Same journal

Correction to "Your research is public engagement: A case for more intentional science communication in research with human subjects" by Vaughn (2026).

Journal of experimental psychology. General·2026
Same journal

Correction to "Costs and benefits of acting extraverted: A randomized controlled trial" by Jacques-Hamilton et al. (2019).

Journal of experimental psychology. General·2026
Same journal

Conveying (discrete) emotionality with novel words.

Journal of experimental psychology. General·2026
Same journal

Physical actions shape moral choices: Environment-directed movements reduce cheating in young children.

Journal of experimental psychology. General·2026
Same journal

From chunks to schemas: Learning in the Hebb repetition paradigm.

Journal of experimental psychology. General·2026
See all related articles

This study introduces a reinforcement-learning model for recurrent choice and skill acquisition, inspired by basal ganglia research. The model successfully explains complex behaviors and learning in multistep tasks.

Area of Science:

  • Cognitive Science
  • Neuroscience
  • Machine Learning

Background:

  • Recurrent choice behavior and skill learning are fundamental cognitive processes.
  • Existing models may not fully integrate these phenomena or account for neurophysiological findings.
  • The basal ganglia are implicated in reinforcement learning and action selection.

Purpose of the Study:

  • To propose a unified reinforcement-learning mechanism for recurrent choice and skill learning.
  • To integrate neurophysiological insights from basal ganglia research into a computational model.
  • To explain a wide range of behavioral effects associated with reinforcement learning.

Main Methods:

  • Developed a reinforcement-learning mechanism modeling recurrent choice.
  • Extended the model to incorporate skill learning principles.

Related Experiment Videos

  • Utilized neurophysiological data from basal ganglia studies to inform model design.
  • Conducted an experiment on learning action sequences in a multistep task.

    • Main Results:

    • The model accounts for effects of reinforcement probability, magnitude, variability, and delay.
    • It reproduces behavioral phenomena like violation of independence and preference reversals.
    • The model successfully explains the goal gradient in maze learning.
    • Experimental data on action sequence learning showed a strong fit with the model's predictions.

    Conclusions:

    • The proposed reinforcement-learning mechanism provides an integrated explanation for recurrent choice and complex skill learning.
    • The model's ability to replicate diverse behavioral effects highlights its explanatory power.
    • Integrating this mechanism into larger cognitive architectures offers promising avenues for future research.