Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Self-organizing neural systems based on predictive learning.

Rajesh P N Rao1, Terrence J Sejnowski

  • 1Department of Computer Science and Engineering, University of Washington, Box 352350, Seattle, WA 98195-2350, USA. rao@cs.washington.edu

Philosophical Transactions. Series A, Mathematical, Physical, and Engineering Sciences
|June 21, 2003
PubMed
Summary

Temporal-difference (TD) learning enables organisms to predict future events using past experiences. This study shows how TD learning models bee conditioning and cellular plasticity for predictive abilities.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026
Same author

Transition of the presynaptic vesicle cluster from a compact to dispersed organization during long-term potentiation.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Synaptic spine head morphodynamics from graph grammar rules for actin dynamics.

bioRxiv : the preprint server for biology·2026
Same author

Dynamical mechanisms for coordinating long-term working memory based on the precision of spike-timing in cortical neurons.

Biological cybernetics·2026
Same author

Balancing Stability and Flow in Hippocampal Networks via Inductive Bias and Learned Symmetry Breaking.

bioRxiv : the preprint server for biology·2026
Same author

A Spatiotemporal Perspective on Dynamical Computation in Neural Information Processing Systems.

ArXiv·2026

Area of Science:

  • Computational neuroscience
  • Animal behavior
  • Cellular neurobiology

Background:

  • Adaptive behavior relies on predicting future events from past data.
  • Temporal-difference (TD) learning is a computational method for prediction.
  • TD learning is suitable for modeling biological conditioning and reward prediction.

Purpose of the Study:

  • To review a TD learning model for conditioning in bees.
  • To demonstrate TD learning's application at the cellular level for spike-timing-dependent plasticity.
  • To explore how TD learning mechanisms contribute to neural computation.

Main Methods:

  • Reviewing a TD learning model for bee conditioning.
  • Utilizing a biophysical model of a neocortical neuron.

Related Experiment Videos

  • Analyzing spike-timing-dependent plasticity in relation to TD learning.

    • Main Results:

    • The TD learning model explains how bees learn action sequences for rewards based on reinforcement.
    • Spike-timing-dependent plasticity can be interpreted as TD learning at the cellular level.
    • Spike-based TD learning can generate direction selectivity and predict neural inputs.

    Conclusions:

    • TD learning provides a unified framework for understanding prediction in biological systems, from behavior to cellular mechanisms.
    • TD learning mechanisms are crucial for adaptive behaviors and neural computation, including sensory processing and prediction in circuits.