Related Experiment Video
Updated: Nov 3, 2025

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
Layer-Skipping Connections Improve the Effectiveness of Equilibrium Propagation on Layered Networks
Jimmy Gammell1,2, Sonia Buckley1, Sae Woo Nam1
1National Institute of Standards and Technology, Boulder, CO, United States.
Abstract:
Equilibrium propagation is a learning framework that marks a step forward in the search for a biologically-plausible implementation of deep learning, and could be implemented efficiently in neuromorphic hardware. Previous applications of this framework to layered networks encountered a vanishing gradient problem that has not yet been solved in a simple, biologically-plausible way. In this paper, we demonstrate that the vanishing gradient problem can be mitigated by replacing some of a layered network's connections with random layer-skipping connections in a manner inspired by small-world networks. This approach would be convenient to implement in neuromorphic hardware, and is biologically-plausible.
Related Concept Videos
Propagation of Action Potentials
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Theories of Dissolution: Diffusion Layer Model
This process starts with a thin layer, saturated with the drug, forming at the interface between the solid and liquid. The solute then diffuses from this layer into the main solution. The Noyes-Whitney equation suggests that the rate of dissolution relies on the diffusion...
Bewley Lattice Diagram
Traveling Waves: Lossless Lines
Relation Between the Distributed Load and Shear
Propagation of Waves
Consider a scenario where a wave propagates from a string of low linear mass density to a string of high linear mass density. In such a case, the reflected wave is out of phase with respect to the incident wave, however the...

