Related Experiment Video
Updated: Jul 1, 2025

Aversive Associative Learning and Memory Formation by Pairing Two Chemicals in Caenorhabditis elegans
Published on: June 23, 2022
Exponential Capacity of Dense Associative Memories
Carlo Lucibello1, Marc Mézard1
1Department of Computing Sciences, Bocconi University, Milano 20136, Italy and Bocconi Institute for Data Science and Analytics (BIDSA), Milano 20136, Italy.
Abstract:
Recent generalizations of the Hopfield model of associative memories are able to store a number P of random patterns that grows exponentially with the number N of neurons, P=exp(αN). Besides the huge storage capacity, another interesting feature of these networks is their connection to the attention mechanism which is part of the Transformer architecture widely applied in deep learning. In this work, we study a generic family of pattern ensembles using a statistical mechanics analysis which gives exact asymptotic thresholds for the retrieval of a typical pattern, α_{1}, and lower bounds for the maximum of the load α for which all patterns can be retrieved, α_{c}, as well as sizes of attraction basins. We discuss in detail the cases of Gaussian and spherical patterns, and show that they display rich and qualitatively different phase diagrams.
Related Concept Videos
Higher Mental Functions of Brain: Learning and Memory
Storage
Long-Term Memory
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
Explicit Memories
Episodic memory contains information about personally experienced events and is reported as a story. An example of episodic memory is recalling a birthday celebration. This type of memory includes the what, where, and when of an event, as...
Chunking
The principle behind chunking...
Interference and Decay
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...

