Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
State Space Representation01:27

State Space Representation

The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
State Space to Transfer Function01:21

State Space to Transfer Function

The conversion of state-space representation to a transfer function is a fundamental process in system analysis. It provides a method for transitioning from a time-domain description to a frequency-domain representation, which is crucial for simplifying the analysis and design of control systems.
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:
Propagation of Action Potentials01:23

Propagation of Action Potentials

The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Identification of drug candidates for rescue of SOX17 gene targets in pulmonary arterial hypertension.

bioRxiv : the preprint server for biology·2026
Same author

Does Support Meet the Need? A Focus Group Study on Parental Support and Students' Psychological Need Satisfaction in a Minority School Context.

Healthcare (Basel, Switzerland)·2026
Same author

Metrics for spin-based computing.

Nature reviews. Physics·2026
Same author

Representational similarity modulates neural and behavioral signatures of novelty.

Neuron·2026
Same author

Temporal stimulus segmentation by reinforcement learning in populations of spiking neurons.

Physical review. E·2026
Same author

Linking neural manifolds to circuit structure in recurrent networks.

Neuron·2026

Related Experiment Videos

Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail.

Eleni Vasilaki1, Nicolas Frémaux, Robert Urbanczik

  • 1Laboratory of Computational Neuroscience, EPFL, Lausanne, Switzerland. E.Vasilaki@sheffield.ac.uk

Plos Computational Biology
|December 10, 2009
PubMed
Summary
This summary is machine-generated.

A new synaptic learning rule combining reward modulation and Hebbian bias enables spiking neural networks to solve complex tasks like the Morris Water Maze, mimicking biological learning speeds.

Related Experiment Videos

Area of Science:

  • Computational Neuroscience
  • Machine Learning
  • Synaptic Plasticity

Background:

  • Synaptic plasticity is the neural basis of learning, modulated by reward signals.
  • Understanding reward-modulated learning rules is crucial for artificial intelligence and neuroscience.

Purpose of the Study:

  • To investigate reward-modulated synaptic learning rules for spiking neural networks.
  • To model learning in a continuous spatial task inspired by the Morris Water Maze.

Main Methods:

  • Developed and tested a family of synaptic update rules for spiking neurons.
  • Implemented rules in a neural network with feedforward and lateral connections.
  • Compared a standard policy gradient rule with a Hebbian-biased variant.

Main Results:

  • A standard policy gradient rule failed to solve the Morris Water Maze task.
  • A variant incorporating a Hebbian bias learned the task within 20 trials.
  • Results were independent of neuronal population size.

Conclusions:

  • Reward-modulated Hebbian-biased plasticity provides an effective mechanism for learning complex behaviors.
  • This approach bridges formal reinforcement learning theory with neuronal and synaptic properties.
  • Predicts specific voltage and spike-timing dependencies for synaptic plasticity and neuromodulation.