Device Stochasticity Directly Implements Bayesian Sampling in Spiking Neurons
Related Experiment Video
Updated: Nov 5, 2026

Stochastic Noise Application for the Assessment of Medial Vestibular Nucleus Neuron Sensitivity In Vitro
Published on: August 28, 2019
Huannan Zheng1, Jingli Liu1, Kezhou Yang1
1MICS Thrust, Function Hub, The Hong Kong University of Science and Technology (Guangzhou), Guangdong, China.
Abstract:
Device stochasticity is considered a non-ideality in neuromorphic hardware, although stochastic neural activity supports probabilistic computation in biological systems. We show that intrinsic stochastic switching of magnetic tunnel junctions (MTJs) can be mapped to stochastic-threshold spiking neurons, providing a physical sampling primitive for Bayesian spiking inference. We develop a spiking Bayesian neural network (SBNN) with neuronal threshold distributions learned during training and sampled during inference. We also introduce a rate-estimation method that propagates firing probabilities rather than explicit spike sequences, achieving up to a 22-fold speedup over surrogate-gradient training. Compared with representative Bayesian neural-network baselines, SBNN achieves favorable accuracy-calibration trade-offs, reaching high accuracy across static and event datasets and low negative log likelihood in both MNIST and Fashion-MNIST. On MNIST, SBNN retains accuracy under a normalized weight-noise standard deviation of 0.20 and under an input-noise standard deviation of 0.25, compared with and , respectively, for the spiking neural network (SNN). Hardware-in-the-loop validation using physical MTJ switching for sampling and software for network arithmetic closely matches software inference in spiking behavior and classification performance. This suggests that intrinsic device stochasticity can be transformed from a hardware non-ideality into a Bayesian computational resource for compact and noise-tolerant neuromorphic systems.
Related Concept Videos
Random Sampling Method
Sampling Continuous Time Signal
In the...
Random Variables
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Propagation of Uncertainty from Random Error
Sampling Methods: Overview
In analytical chemistry, the choice of sampling...
Propagation of Action Potentials
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...

