Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 31, 2026

Perspectives on Neuroscience
26:41

Perspectives on Neuroscience

Published on: July 31, 2007

Spatio-temporal credit assignment in neuronal population learning.

Johannes Friedrich1, Robert Urbanczik, Walter Senn

  • 1Department of Physiology, University of Bern, Bern, Switzerland.

Plos Computational Biology
|July 9, 2011
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Propagation of Action Potentials01:23

Propagation of Action Potentials

The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Temporal stimulus segmentation by reinforcement learning in populations of spiking neurons.

Physical review. E·2026
Same author

Direct RNA sequencing enables improved transcriptome assessment and tracking of RNA modifications for medical applications.

Nucleic acids research·2025
Same author

Increased Perceptual Reliability Reduces Membrane Potential Variability in Cortical Neurons.

The Journal of neuroscience : the official journal of the Society for Neuroscience·2025
Same author

Differential modulation of positive and negative prediction errors by stimulus variability in the mouse posterior parietal cortex.

Communications biology·2025
Same author

The coming decade of digital brain research: A vision for neuroscience at the intersection of technology and computing.

Imaging neuroscience (Cambridge, Mass.)·2025
Same author

ModiDeC: a multi-RNA modification classifier for direct nanopore sequencing.

Nucleic acids research·2025
Same journal

Development of whole-limb skeletal patterning through the coordination of growth and self-organization models.

PLoS computational biology·2026
Same journal

The energetic cost of human standing balance and gait initiation over a range of natural postures.

PLoS computational biology·2026
Same journal

Combinatorial multiomic analysis from a pedigree of Sox10Dom Hirschsprung mice identifies multiple high confidence candidate modifiers of Enteric Nervous System development.

PLoS computational biology·2026
Same journal

Extracting host-specific developmental signatures from longitudinal microbiome data.

PLoS computational biology·2026
Same journal

Population sparseness determines strength of Hebbian plasticity for maximal memory lifetime in associative networks.

PLoS computational biology·2026
Same journal

Predictive coding explains asymmetric connectivity in the brain: A neural network study.

PLoS computational biology·2026
See all related articles

This study introduces a novel synaptic plasticity cascade model for reinforcement learning. The model effectively solves the temporal credit assignment problem in animals, even with delayed rewards.

Area of Science:

  • Neuroscience
  • Computational Neuroscience
  • Machine Learning

Background:

  • Animals learn through trial and error, linking actions to rewards.
  • The credit-assignment problem is complex due to uncertain outcomes and delayed reinforcement.
  • Behavioral decisions arise from intricate synaptic activity.

Purpose of the Study:

  • To present a biophysical model for reinforcement learning.
  • To address the credit-assignment problem in neural systems.
  • To explore synaptic plasticity as a mechanism for learning.

Main Methods:

  • Developed a model of plasticity induction using leaky integrate-and-fire neurons.
  • Incorporated a cascade of synaptic memory traces.
  • Simulated operant conditioning and sequential decision-making tasks.

More Related Videos

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond
08:08

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Published on: June 24, 2015

Related Experiment Videos

Last Updated: May 31, 2026

Perspectives on Neuroscience
26:41

Perspectives on Neuroscience

Published on: July 31, 2007

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond
08:08

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Published on: June 24, 2015

Main Results:

  • The model successfully handles delayed reinforcement, solving temporal credit assignment.
  • Learning speed increases with larger neural population sizes, addressing spatial credit assignment.
  • Demonstrated robustness in simulations, outperforming temporal difference-based learning in some aspects.

Conclusions:

  • Synaptic plasticity cascades offer a viable mechanism for temporal and spatial credit assignment in reinforcement learning.
  • The proposed model provides a robust framework for understanding learning in the brain.
  • These cascades are attractive fundamental models for neural reinforcement learning.