Related Experiment Video
Updated: May 4, 2026

A Tactile Automated Passive-Finger Stimulator TAPS
Published on: June 3, 2009
A network of Bayesian agents for reward prediction and noise tolerance
Daniela Gandolfi1, Mirco Tincani2,3, Giulia Maria Boiani1,4
1Department of Engineering "Enzo Ferrari", University of Modena and Reggio Emilia, Via P. Vivarelli 10, Modena 41125, Italy.
Abstract:
The development of computational models capable of performing biologically relevant tasks is essential for real-world applications. This work introduces a network of single neurons modeled as independent agents, each optimizing its own cost function. This optimization governs the firing probability, resulting in spike generation-the core unit of neural communication. The network is hierarchically structured to reflect the connectivity of the dopaminergic reward system. Neurons adapt their synaptic weights to improve input prediction, leading to the self-organization of circuit activity. While the network performs well on classical reward-based tasks, its performance degrades when noise is introduced at the level of individual neurons, affecting spike generation. In line with biological systems, spike generation is inherently noisy, yet the brain achieves reliable computation through evolved mechanisms. Similarly, increasing the network size restores performance. By incorporating strategies to counteract intrinsic noise, this model lays the foundation for robust, energy-efficient, scalable, and noise-tolerant neuromorphic architectures.
Related Concept Videos
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
Randomized Experiments
Simple randomization
Simple...
Propagation of Uncertainty from Random Error
Propagation of Uncertainty from Systematic Error
Reinforcement
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Observational Learning