Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Neuroplasticity

Neuroplasticity

Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...

Linear Approximation in Frequency Domain

Linear Approximation in Frequency Domain

Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....

Long-term Potentiation

Long-term Potentiation

Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Root causes of COVID-19 data backlogs: a mixed methods analysis in four African countries.

Oxford open digital health·2025

Same author

How emergency digital health and data use investments can strengthen health systems and support global health security.

Oxford open digital health·2025

Same author

Learning from digital health investments during COVID-19 vaccine program implementation: a research collaboration and theory of change.

Oxford open digital health·2025

Same author

Functional connectomics reveals general wiring rule in mouse visual cortex.

Nature·2025

Same author

Correction: On the relationship between predictive coding and backpropagation.

PloS one·2025

Same author

Global VAX: A U.S. contribution to global COVID-19 vaccination efforts, 2021-2023.

Vaccine·2024

Same journal

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling.

Neural computation·2026

Same journal

DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning.

Neural computation·2026

Same journal

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026

Same journal

W-Kernel and Its Principal Space for Frequentist Evaluation of Bayesian Estimators.

Neural computation·2026

Same journal

A Hidden Markov Model-Inspired Sequence Classification Method for Hyperdimensional Computing.

Neural computation·2026

Same journal

Sparse Graphical Modeling for Electrophysiological Phase-Based Connectivity Using Circular Statistics.

Neural computation·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Jun 20, 2025

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

Published on: March 25, 2014

Learning Fixed Points of Recurrent Neural Networks by Reparameterizing the Network Model.

Vicky Zhu¹, Robert Rosenbaum²

¹Babson College, Mathematics, Analytics, Science, and Technology Division, Wellesley, MA 02481, U.S.A. vzhu@babson.edu.

Neural Computation

|July 19, 2024

Summary

This summary is machine-generated.

Researchers developed new training methods for recurrent neural networks (RNNs) that avoid singularities, improving learning performance. These methods challenge the assumption that brain learning follows standard Euclidean gradient descent.

More Related Videos

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Related Experiment Videos

Last Updated: Jun 20, 2025

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

A Simple Stimulatory Device for Evoking Point-like Tactile Stimuli: A Searchlight for LFP to Spike Transitions

Published on: March 25, 2014

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Area of Science:

Computational Neuroscience
Machine Learning
Artificial Intelligence

Background:

Recurrent neural networks (RNNs) are crucial for modeling neural activity and learning in computational neuroscience.
Fixed points of RNNs are often used to model responses to static stimuli, mirroring visual cortical responses.
Training RNNs to minimize loss functions evaluated on fixed points is a key challenge, shared with deep equilibrium models in machine learning.

Purpose of the Study:

To investigate effective methods for training recurrent neural network weights to minimize loss functions evaluated at fixed points.
To address the limitations of standard Euclidean gradient descent due to singularities in the loss surface.
To develop alternative learning rules that offer more robust and effective training dynamics.

Main Methods:

Reparameterization of the recurrent neural network model.
Derivation of two novel learning rules.
Analysis of learning dynamics and comparison with standard gradient descent.
Interpretation of new rules as steepest descent and gradient descent under a non-Euclidean metric.

Main Results:

Standard gradient descent on the Euclidean space of weights can lead to poor learning performance due to loss surface singularities.
The derived alternative learning rules effectively avoid these singularities.
The new learning rules demonstrate significantly more robust and effective learning compared to standard gradient descent.
The improved learning rules can be understood through the lens of non-Euclidean geometry on the weight space.

Conclusions:

The common assumption that neural learning follows Euclidean gradients of synaptic weights is questioned.
Novel learning rules based on non-Euclidean metrics offer superior training for RNNs, particularly for fixed-point computations.
These findings have implications for both artificial intelligence and understanding biological learning mechanisms.