Randomized forward mode gradient for spiking neural networks in scientific machine learning.

Ruyin Wan1, Qian Zhang2, George Em Karniadakis2

  • 1School of Engineering, Brown University, Providence, 02912, RI, USA.

Summary

This study introduces a novel, biologically plausible training method for spiking neural networks (SNNs) using weight perturbation. This approach offers an efficient alternative to back-propagation for machine learning and neuromorphic hardware.

Related Concept Videos

Neural Regulation01:37

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
45.2K
What is an Electrochemical Gradient?01:26

What is an Electrochemical Gradient?

Adenosine triphosphate, or ATP, is considered the primary energy source in cells. However, energy can also be stored in the electrochemical gradient of an ion across the plasma membrane, which is determined by two factors: its chemical and electrical gradients.
The chemical gradient relies on differences in the abundance of a substance on the outside versus the inside of a cell and flows from areas of high to low ion concentration. In contrast, the electrical gradient revolves around an...
133.8K
Neural Circuits01:25

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
3.4K
Electrochemical Gradient and Channel Proteins: An Overview01:21

Electrochemical Gradient and Channel Proteins: An Overview

An electrochemical gradient is a fundamental concept in biology and chemistry. It regulates the movement of ions across cell membranes. This movement is influenced by two factors:
The electrical gradient: The electrical gradient across cell membranes refers to the difference in electric charge between the inside and outside of a cell.  This difference drives the movement of ions towards or away from the cells. For instance, if the inside of the cell is more negatively charged relative to...
5.7K