Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Long-term Potentiation

Long-term Potentiation

Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.

Convolution: Math, Graphics, and Discrete Signals

Convolution: Math, Graphics, and Discrete Signals

In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...

Cognitive Learning

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...

Elaborative Rehearsals

Elaborative Rehearsals

Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...

Real-World Application of Classical Conditioning

Real-World Application of Classical Conditioning

Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...

Convolution Properties I

Convolution Properties I

Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Neural network compression for reinforcement learning tasks.

Scientific reports·2025

Same author

The state-of-the-art in cardiac MRI reconstruction: Results of the CMRxRecon challenge in MICCAI 2023.

Medical image analysis·2025

Same author

High-Strength, Self-Healing Copolymers of Acrylamide and Acrylic Acid with Co(II), Ni(II), and Cu(II) Complexes of 4'-Phenyl-2,2':6',2″-terpyridine: Preparation, Structure, Properties, and Autonomous and pH-Triggered Healing.

Polymers·2024

Same author

Tracking induced pluripotent stem cell differentiation with a fluorescent genetically encoded epigenetic probe.

Cellular and molecular life sciences : CMLS·2024

Same author

Epistemic uncertainty challenges aging clock reliability in predicting rejuvenation effects.

Aging cell·2024

Same author

Atomic force microscopy investigation of DNA denaturation on a highly oriented pyrolytic graphite surface.

International journal of biological macromolecules·2024

Same journal

A tri-axis optomechanical accelerometer with plasmonic MIM waveguide and structural direction-dependent optical signatures.

Scientific reports·2026

Same journal

Holographic leaky-wave antennas with independently controlled multiple counter-rotating vortex beams.

Scientific reports·2026

Same journal

Differential associations of longitudinal hearing and vision trajectories with dementia and mild cognitive impairment in older adults.

Scientific reports·2026

Same journal

Abdominal obesity and leisure-time sedentary behavior in relation to gastroesophageal reflux disease risk: a prospective cohort study from the UK Biobank.

Scientific reports·2026

Same journal

Effect of nitrogen-rich COF incorporation on the structure and separation performance of polyamide nanofiltration membranes.

Scientific reports·2026

Same journal

Withanolide A inhibits hIAPP aggregation: An In silico, biophysical, and drosophila-based In vivo validation.

Scientific reports·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Jul 9, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Deep reinforcement learning with significant multiplications inference.

Dmitry A Ivanov^1,2, Denis A Larionov^2,3, Mikhail V Kiselev^2,3

¹Lomonosov Moscow State University, GSP-1, Leninskie Gory, Moscow, 119991, Russia.

Scientific Reports

|November 27, 2023

Summary

This summary is machine-generated.

We developed a sparse computation method for neural networks in reinforcement learning (RL). This approach significantly reduces computations for faster neuromorphic computing with minimal performance impact.

More Related Videos

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

Published on: July 8, 2015

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Related Experiment Videos

Last Updated: Jul 9, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

The Double-H Maze: A Robust Behavioral Test for Learning and Memory in Rodents

Published on: July 8, 2015

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Area of Science:

Computational Neuroscience
Artificial Intelligence
Machine Learning

Background:

Neural network inference is computationally intensive, limiting applications in resource-constrained environments.
Reinforcement learning (RL) tasks often require complex neural network models.
Neuromorphic computing aims for efficient, brain-inspired computation.

Purpose of the Study:

To propose a novel sparse computation method for optimizing neural network inference in RL.
To reduce computational load, specifically the number of multiplications, for faster processing.
To leverage brain-inspired mechanisms for enhanced computational efficiency.

Main Methods:

Combined neural network pruning (mimicking neuroplasticity) with a delta-network algorithm.
Neural network pruning eliminates redundant connections.
Delta-network updates neuron states only when changes exceed a threshold, exploiting input data correlations.

Main Results:

Achieved up to a 100-fold reduction in multiplications during neural network inference.
Maintained performance levels in popular deep RL tasks.
Observed performance improvements in some instances.

Conclusions:

The proposed sparse computation method offers significant efficiency gains for neural network inference in RL.
This brain-inspired approach is suitable for fast neuromorphic computing.
The method effectively reduces computational cost without compromising, and sometimes enhancing, task performance.