Using noise to compute error surfaces in connectionist networks: a novel means of reducing catastrophic forgetting
Related Experiment Video
Updated: Sep 30, 2026

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
1Quantitative Psychology and Cognitive Science, Psychology Department, University of Liège, 4000 Liège, Belgium. rfrench@ulg.ac.be
Abstract:
In error-driven distributed feedforward networks, new information typically interferes, sometimes severely, with previously learned information. We show how noise can be used to approximate the error surface of previously learned information. By combining this approximated error surface with the error surface associated with the new information to be learned, the network's retention of previously learned items can be improved and catastrophic interference significantly reduced. Further, we show that the noise-generated error surface is produced using only first-derivative information and without recourse to any explicit error information.
Related Concept Videos
Forgetting
Encoding...
Interference and Decay
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
Propagation of Uncertainty from Systematic Error
Propagation of Uncertainty from Random Error
Neuroplasticity