Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Reinforcement learning by Hebbian synapses with adaptive thresholds

C M Pennartz1

  • 1California Institute of Technology, Pasadena, USA.

Neuroscience
|September 23, 1997
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Enhanced NMDA receptor activity in retinal inputs to the rat suprachiasmatic nucleus during the subjective night.

The Journal of physiology·2001
Same author

The glutamate hypothesis of reinforcement learning.

Progress in brain research·2000
Same author

Plasticity of neuronal firing in deep layers of the medial prefrontal cortex in rats engaged in operant conditioning.

Progress in brain research·2000
Same author

A reexamination of the role of GABA in the mammalian suprachiasmatic nucleus.

Journal of biological rhythms·1999
Same author

Neurons of the rat suprachiasmatic nucleus show a circadian rhythm in membrane properties that is lost during prolonged whole-cell recording.

Brain research·1999
Same author

Membrane properties and morphology of vasopressin neurons in slices of rat suprachiasmatic nucleus.

Journal of neurophysiology·1998
Same journal

Chronic stress primes TLR3-mediated systemic inflammation to produce persistent post-viral fatigue syndrome-like symptoms in mice.

Neuroscience·2026
Same journal

Contribution of muscarinic acetylcholine receptors to bottom-up amplification of frontal and parietal cortical responses to rare deviant tones in rats.

Neuroscience·2026
Same journal

Developmental switch of GABAergic signaling in starburst amacrine cells driven by chloride transporter dynamics.

Neuroscience·2026
Same journal

Epileptiform discharges are associated with increased theta activity over time in patients with Lewy body dementia.

Neuroscience·2026
Same journal

Response times from gap detection threshold testing relate to cognitive processing speed in young adults.

Neuroscience·2026
Same journal

The timing of visual selective attention in fronto-parietal network: TMS behavioral and brain structural evidence.

Neuroscience·2026
See all related articles

This study presents a novel reinforcement learning model that modifies neural network synapses using Hebbian learning principles. This biologically plausible model successfully trains networks on complex sensorimotor tasks, offering insights into brain function.

Area of Science:

  • Neuroscience
  • Computational Neuroscience
  • Machine Learning

Background:

  • Supervised learning in neural networks relies on error-based modification of synaptic connectivity.
  • Understanding how the brain processes reinforcing stimuli for complex sensorimotor tasks is a central problem in learning theory.

Purpose of the Study:

  • To present a novel reinforcement learning model that modifies synaptic plasticity based on Hebbian learning principles.
  • To demonstrate how this model can train neural networks on complex computational tasks, mimicking biological learning processes.

Main Methods:

  • Developed a reinforcement learning model where feedback influences postsynaptic calcium levels to modify synapses (long-term potentiation/depression).
  • Incorporated history-dependent modification thresholds for synaptic plasticity.

Related Experiment Videos

  • Trained neural networks on tasks including matching sensory-motor vectors and coordinate transformations.

    • Main Results:

    • The model successfully trained networks on sensorimotor matching and coordinate transformation tasks.
    • The model demonstrated robustness when using more biologically realistic single-compartment neurons operating in continuous time.
    • The learning rule integrated Hebbian synaptic plasticity, bridging supervised and unsupervised learning models.

    Conclusions:

    • The novel reinforcement learning model successfully integrates Hebbian synaptic plasticity for supervised learning.
    • The model shows potential for explaining learning processes in brain areas like the amygdala, prefrontal, and cingulate cortex.
    • Findings suggest further experimental validation for synaptic plasticity and learning in these brain regions.