Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Neuroplasticity01:01

Neuroplasticity

940
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
940
Reinforcement Schedules01:24

Reinforcement Schedules

270
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
270
Associative Learning01:27

Associative Learning

682
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
682
Plasticity00:58

Plasticity

2.6K
Plasticity is the property where an object loses its elasticity and undergoes irreversible deformation, even after the deformation forces are eliminated. If a material deforms irreversibly without increasing stress or load, then this is called ideal plasticity. For example, when a force is applied to an aluminum rod, it changes its shape, but it does not return to its original shape once the force is removed. Plastic deformation or ductility is thus a permanent deformation or change in the...
2.6K
Reinforcement01:23

Reinforcement

466
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
466
Observational Learning01:12

Observational Learning

390
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
390

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Implementing Any Nonlinear Quantum Neuron.

IEEE transactions on neural networks and learning systems·2019
Same author

Clustering cancer gene expression data: a comparative study.

BMC bioinformatics·2008
Same author

Mechanism of KCl enhancement in detection of nonionic polymers by nanopore sensors.

Biophysical journal·2008
Same author

Clustering and co-evolution to construct neural network ensembles: an experimental study.

Neural networks : the official journal of the International Neural Network Society·2008
Same author

An optimization methodology for neural network weights and architectures.

IEEE transactions on neural networks·2006
Same author

Equivalence between RAM-based neural networks and probabilistic automata.

IEEE transactions on neural networks·2005

Related Experiment Video

Updated: Oct 18, 2025

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
07:34

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

Published on: March 25, 2014

10.0K

Combining STDP and binary networks for reinforcement learning from images and sparse rewards.

Sérgio F Chevtchenko1, Teresa B Ludermir1

  • 1Centro de Informática - CIn, Universidade Federal de Pernambuco, Av. Jornalista Aníbal Fernandes, s/n, Cidade Universitária, 50.740-560, Brazil.

Neural Networks : the Official Journal of the International Neural Network Society
|October 3, 2021
PubMed
Summary

This study combines spiking neural networks (SNNs) with deep reinforcement learning (DRL) models to improve accuracy and learning speed. The novel architecture shows competitive performance in complex environments, paving the way for advanced SNN applications.

Keywords:
Binary neural networksReinforcement learningSTDPSpiking neural networks

More Related Videos

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.5K
Ex Vivo Optogenetic Interrogation of Long-Range Synaptic Transmission and Plasticity from Medial Prefrontal Cortex to Lateral Entorhinal Cortex
11:31

Ex Vivo Optogenetic Interrogation of Long-Range Synaptic Transmission and Plasticity from Medial Prefrontal Cortex to Lateral Entorhinal Cortex

Published on: February 25, 2022

2.5K

Related Experiment Videos

Last Updated: Oct 18, 2025

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions
07:34

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

Published on: March 25, 2014

10.0K
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.5K
Ex Vivo Optogenetic Interrogation of Long-Range Synaptic Transmission and Plasticity from Medial Prefrontal Cortex to Lateral Entorhinal Cortex
11:31

Ex Vivo Optogenetic Interrogation of Long-Range Synaptic Transmission and Plasticity from Medial Prefrontal Cortex to Lateral Entorhinal Cortex

Published on: February 25, 2022

2.5K

Area of Science:

  • Artificial Intelligence
  • Computational Neuroscience
  • Machine Learning

Background:

  • Spiking neural networks (SNNs) mimic biological brains for efficiency and temporal processing.
  • Current SNNs lag behind traditional deep reinforcement learning (DRL) models in accuracy and learning speed.

Purpose of the Study:

  • To enhance SNN performance by integrating them with pre-trained binary convolutional neural networks.
  • To evaluate a novel SNN architecture trained online using reward-modulated spike-timing-dependent plasticity (STDP).

Main Methods:

  • A hybrid model combining a pre-trained binary convolutional neural network with an improved SNN.
  • Online training of the SNN using reward-modulated STDP.
  • Extensive experimental comparison against state-of-the-art baselines like Proximal Policy Optimization (PPO) and Deep Q Network (DQN).

Main Results:

  • The proposed hybrid SNN architecture demonstrates competitive performance against established DRL algorithms.
  • The model successfully tackles challenging tasks with high-dimensional RGB image observations (up to 256x256 pixels).

Conclusions:

  • The developed SNN architecture offers a viable alternative to DRL in specific environments.
  • This work lays the groundwork for future, more sophisticated applications of spiking neural networks.