Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

Higher Mental Functions of Brain: Learning and Memory

Higher Mental Functions of Brain: Learning and Memory

Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or playing an...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...

Cognitive Learning

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...

Real-World Application of Classical Conditioning

Real-World Application of Classical Conditioning

Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...

Long-Term Memory

Long-Term Memory

Long-term memory is a relatively permanent type of memory, capable of storing vast amounts of information over extended periods. Its storage capacity is generally considered unlimited.
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Power Function Error Initialization Can Improve Convergence of Backpropagation Learning in Neural Networks for Classification.

Neural computation·2021

Same author

Iterative Retrieval and Block Coding in Autoassociative and Heteroassociative Memory.

Neural computation·2019

Same author

Toward Self-Referential Autonomous Learning of Object and Situation Models.

Cognitive computation·2016

Same author

Structural Plasticity, Effectual Connectivity, and Memory in Cortex.

Frontiers in neuroanatomy·2016

Same author

Efficient Associative Computation with Discrete Synapses.

Neural computation·2015

Same author

Cognitive representations and cognitive processing of team-specific tactics in soccer.

PloS one·2015

Same journal

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling.

Neural computation·2026

Same journal

DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning.

Neural computation·2026

Same journal

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026

Same journal

W-Kernel and Its Principal Space for Frequentist Evaluation of Bayesian Estimators.

Neural computation·2026

Same journal

A Hidden Markov Model-Inspired Sequence Classification Method for Hyperdimensional Computing.

Neural computation·2026

Same journal

Sparse Graphical Modeling for Electrophysiological Phase-Based Connectivity Using Circular Statistics.

Neural computation·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Jun 3, 2026

Aversive Associative Learning and Memory Formation by Pairing Two Chemicals in Caenorhabditis elegans

Aversive Associative Learning and Memory Formation by Pairing Two Chemicals in Caenorhabditis elegans

Published on: June 23, 2022

Neural associative memory with optimal Bayesian learning.

Andreas Knoblauch¹

¹Honda Research Institute Europe GmbH, D-63073 Offenbach, Germany. andreas.knoblauch@honda-ri.de

Neural Computation

|March 15, 2011

Summary

This summary is machine-generated.

A new Bayesian model offers optimal synaptic learning for neural associative memories, unifying previous models and improving memory capacity. This framework enhances understanding of neural network performance across various activity sparseness levels.

More Related Videos

A Flexible Platform for Monitoring Cerebellum-Dependent Sensory Associative Learning

A Flexible Platform for Monitoring Cerebellum-Dependent Sensory Associative Learning

Published on: January 19, 2022

A Lateralized Odor Learning Model in Neonatal Rats for Dissecting Neural Circuitry Underpinning Memory Formation

A Lateralized Odor Learning Model in Neonatal Rats for Dissecting Neural Circuitry Underpinning Memory Formation

Published on: August 18, 2014

Related Experiment Videos

Last Updated: Jun 3, 2026

Aversive Associative Learning and Memory Formation by Pairing Two Chemicals in Caenorhabditis elegans

Aversive Associative Learning and Memory Formation by Pairing Two Chemicals in Caenorhabditis elegans

Published on: June 23, 2022

A Flexible Platform for Monitoring Cerebellum-Dependent Sensory Associative Learning

A Flexible Platform for Monitoring Cerebellum-Dependent Sensory Associative Learning

Published on: January 19, 2022

A Lateralized Odor Learning Model in Neonatal Rats for Dissecting Neural Circuitry Underpinning Memory Formation

A Lateralized Odor Learning Model in Neonatal Rats for Dissecting Neural Circuitry Underpinning Memory Formation

Published on: August 18, 2014

Area of Science:

Computational Neuroscience
Machine Learning
Artificial Neural Networks

Background:

Neural associative memories store associations using perceptron-like single-layer networks with fast synaptic learning.
Prior research optimized memory capacity using models like linear Hopfield, Willshaw (binary synapses), and BCPNN (Bayesian Confidence Propagation Neural Network).

Purpose of the Study:

To introduce a general optimal model for synaptic learning based on probabilistic Bayesian principles.
To unify and extend existing models of neural associative memory.
To provide a framework for analyzing memory capacity under varying conditions.

Main Methods:

Developed a general Bayesian model for synaptic learning in neural associative memories.
Analyzed the model's behavior in asymptotic limits (large networks, sparse activity) and for intermediate sparseness.
Established a unified analytical framework linking mutual information, Hamming distance, and signal-to-noise ratio for capacity determination.

Main Results:

The Bayesian model encompasses previous models (Willshaw, BCPNN, Hopfield) as specific limit cases.
For sparse activity, the Bayesian model aligns with inhibitory Willshaw and BCPNN models.
For less sparse patterns, it matches Hopfield networks using the covariance rule.
The optimal Bayesian rule offers improved memory performance for intermediate sparseness or finite networks.

Conclusions:

A unified Bayesian framework provides a more general and optimal approach to synaptic learning in neural associative memories.
This model reconciles and extends previous theoretical frameworks, offering enhanced memory capacity.
The analytical framework allows for precise determination of memory capacity based on noise levels and activity patterns.