A Bayesian attractor network with incremental learning
Related Experiment Videos
A Sandberg1, A Lansner, K M Petersson
1Department of Numerical Analysis and Computing Science, Royal Institute of Technology, Stockholm, Sweden. asa@nada.kth.se
Abstract:
A realtime online learning system with capacity limits needs to gradually forget old information in order to avoid catastrophic forgetting. This can be achieved by allowing new information to overwrite old, as in a so-called palimpsest memory. This paper describes an incremental learning rule based on the Bayesian confidence propagation neural network that has palimpsest properties when employed in an attractor neural network. The network does not suffer from catastrophic forgetting, has a capacity dependent on the learning time constant and exhibits faster convergence for newer patterns.
Related Concept Videos
Observational Learning
Associative Learning
Classical conditioning, also known...
Multi-input and Multi-variable systems
In the absence of...
Introduction to Learning
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
Sequence Networks of Rotating Machines
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...