Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reinforcement01:23

Reinforcement

277
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
277
Reinforcement Schedules01:24

Reinforcement Schedules

204
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
204
Neural Regulation01:37

Neural Regulation

39.5K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
39.5K
Associative Learning01:27

Associative Learning

444
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
444
Observational Learning01:12

Observational Learning

210
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
210

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Giant Optical Anisotropy and Visible-Frequency Epsilon-near-Zero in Hyperbolic van der Waals MoOCl<sub>2</sub>.

Nano letters·2026
Same author

Multifunctional van der Waals PdSe<sub>2</sub> for light detection, guiding and modulation.

Nature communications·2025
Same author

Combining aggregated attention and transformer architecture for accurate and efficient performance of Spiking Neural Networks.

Neural networks : the official journal of the International Neural Network Society·2025
Same author

Artificial intelligence guided search for van der Waals materials with high optical anisotropy.

Materials horizons·2024
Same author

Impact of Perception Errors in Vision-Based Detection and Tracking Pipelines on Pedestrian Trajectory Prediction in Autonomous Driving Systems.

Sensors (Basel, Switzerland)·2024
Same author

Reliable Memristive Synapses Based on Parylene-MoO<sub></sub> Nanocomposites for Neuromorphic Applications.

ACS applied materials & interfaces·2023

Related Experiment Video

Updated: Jul 19, 2025

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments
05:19

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments

Published on: November 12, 2019

7.1K

Memristor-based spiking neural network with online reinforcement learning.

Danila Vlasov1, Anton Minnekhanov1, Roman Rybka2

  • 1NRC "Kurchatov Institute", Akademika Kurchatova sq., 1 Moscow, Russian Federation.

Neural Networks : the Official Journal of the International Neural Network Society
|August 14, 2023
PubMed
Summary

This study introduces an online reinforcement learning algorithm for spiking neural networks (SNNs) using memristor-based synapses. The novel algorithm enables efficient, real-time learning in neuromorphic systems for control tasks.

Keywords:
Conductive filamentMemristorReinforcement learningResistive switchingSTDPSpiking neural network

More Related Videos

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.4K
Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond
08:08

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Published on: June 24, 2015

11.5K

Related Experiment Videos

Last Updated: Jul 19, 2025

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments
05:19

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments

Published on: November 12, 2019

7.1K
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.4K
Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond
08:08

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Published on: June 24, 2015

11.5K

Area of Science:

  • Neuromorphic Engineering
  • Artificial Intelligence
  • Materials Science

Background:

  • Memristor-based hardware offers efficient in-memory computation for neural networks.
  • Traditional learning methods like back-propagation are challenging for memristor hardware.
  • Spiking neural networks (SNNs) enable local, self-organized weight changes, suitable for such hardware.

Purpose of the Study:

  • To develop an online reinforcement learning algorithm for SNNs implemented on memristor hardware.
  • To integrate STDP-like learning rules derived from real memristor devices.
  • To demonstrate the feasibility of real-time agent learning in continuous-time environments using neuromorphic systems.

Main Methods:

  • An online reinforcement learning algorithm was developed where connection weights update after each environment state interaction.
  • The algorithm was applied to SNNs utilizing memristor-based STDP-like learning rules.
  • Plasticity functions were derived from experimentally assembled poly-p-xylylene and CoFeB-LiNbO3 nanocomposite memristors.

Main Results:

  • The SNN, composed of leaky integrate-and-fire neurons, successfully solved the Cart-Pole benchmark task.
  • Environmental states were encoded by input spike timings, and control actions decoded by the first spike.
  • The algorithm demonstrated effective weight changes based on local learning rules.

Conclusions:

  • The proposed online reinforcement learning algorithm is effective for SNNs with memristive synapses.
  • This work represents a significant step towards real-time agent learning in continuous-time environments on neuromorphic systems.
  • The use of memristor-derived STDP-like rules facilitates efficient and localized learning.