A high-capacity model for one shot association learning in the brain

Area of Science:

• Computational neuroscience
• Artificial intelligence
• Network science

Background:

• One-shot association learning is crucial for efficient information processing in biological and artificial systems.
• Sparse neural networks offer a biologically plausible framework for complex cognitive functions.
• Existing models often struggle with high capacity and immediate learning from single instances.

Purpose of the Study:

• To develop a high-capacity model for one-shot hetero-associative memory in sparse networks.
• To investigate the learning capacity and retrieval enhancement through iterative processes.
• To provide a computationally efficient model for brain-like neural networks.

Main Methods:

• Combining Amit-Fusi and Willshaw type networks with sparse connectivity.
• Employing a palimpsest learning procedure adapted for one-shot pattern association.
• Utilizing iterative retrieval to enhance network capacity.
• Analyzing model performance using bootstrap percolation theory on random graphs.

Main Results:

• The proposed model demonstrates high capacity, learning hundreds of associations with single presentations.
• Iterative retrieval significantly enhances the associative learning capacity of the sparse network.
• The model effectively simulates brain-like networks with populations of a few thousand neurons.
• Theoretical analysis confirms the model's robustness and capacity through percolation theory.

Conclusions:

• The developed model offers a significant advancement in one-shot association learning for sparse neural networks.
• This framework provides a scalable and efficient approach for modeling memory in brain-like systems.
• The findings have implications for developing more sophisticated artificial memory systems and understanding biological learning.