Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Solving the credit assignment problem: explicit and implicit learning of action sequences with probabilistic

Wai-Tat Fu1, John R Anderson

  • 1University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA. wfu@uiuc.edu

Psychological Research
|April 21, 2007
PubMed
Summary

This study reveals credit assignment involves two learning processes: explicit memory and implicit reinforcement learning. Understanding these distinct mechanisms aids in solving complex, sequential decision-making problems.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Combining EEG signals from the 2 members of a team to improve event identification.

Neuroimage. Reports·2026
Same author

Using the environment to predict memory performance.

Journal of experimental psychology. Learning, memory, and cognition·2026
Same author

Reducing Mass Spectrometry Noise via Coupled Desorption Flux and Background Modeling.

Journal of the American Society for Mass Spectrometry·2025
Same author

Tracking the Cognitive Band in an Open-Ended Task.

Cognitive science·2024
Same author

UV damage induces production of mitochondrial DNA fragments with specific length profiles.

Genetics·2024
Same author

The leader RNA of SARS-CoV-2 sequesters polypyrimidine tract binding protein (PTBP1) and influences pre-mRNA splicing in infected cells.

Virology·2024

Area of Science:

  • Cognitive Psychology
  • Neuroscience
  • Machine Learning

Background:

  • The credit-assignment problem arises when feedback follows a sequence of actions, making it difficult to link outcomes to specific choices.
  • Interdependent actions in problem-solving necessitate remembering past decisions to learn effectively.

Purpose of the Study:

  • To investigate explicit and implicit learning processes in addressing the credit-assignment problem.
  • To differentiate the roles of memory rehearsal and reinforcement learning in sequential decision-making.

Main Methods:

  • Two studies employed a probabilistic sequential choice task.
  • A secondary memory task was used in one study to manipulate learning processes.
  • Performance was analyzed based on whether explicit or implicit learning dominated.

Related Experiment Videos

Main Results:

  • When explicit learning was dominant, participants learned faster in initial choices.
  • When implicit reinforcement learning was dominant, learning accelerated in later choices.
  • Results align with probability and sequence learning literature.

Conclusions:

  • Credit assignment comprises two distinct processes: explicit memory encoding and implicit reinforcement learning.
  • Explicit learning relies on memory rehearsal, while implicit learning propagates backward credit.
  • These findings offer insights into how humans and machines learn from sequential feedback.