Related Experiment Video
Updated: Nov 7, 2025
11:18
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
10.5K
Classic Hebbian learning endows feed-forward networks with sufficient adaptability in challenging reinforcement
1Okinawa Institute of Science and Technology Graduate University, Onna, Okinawa, Japan.
Journal of Neurophysiology
|April 28, 2021
Summary
This study enhances reinforcement learning agents by optimizing Hebbian learning rules, improving adaptability post-optimization. This approach offers a novel way to control artificial neural network weights dynamically.
Area of Science:
- Artificial Intelligence
- Computational Neuroscience
- Machine Learning
Background:
- Current reinforcement learning agents struggle with adaptability after optimization.
- Directly optimizing neural network weights limits their flexibility.
Purpose of the Study:
- To investigate a method for improving the adaptability of artificial feed-forward networks post-optimization.
- To explore the use of Hebbian learning rules for dynamic weight control in artificial intelligence.
Main Methods:
- Optimizing coefficients of classic Hebbian rules instead of directly optimizing network weights.
- Implementing dynamic control of network weights in artificial feed-forward networks.
Main Results:
- Demonstrated a method to salvage adaptability in artificial feed-forward networks.
- Showcased the potential of optimizing Hebbian rule coefficients for dynamic weight control.
Conclusions:
- Optimizing Hebbian rule coefficients offers a promising approach to enhance the adaptability of artificial neural networks.
- Integrating principles from neuroscience, like Hebbian plasticity, can yield significant benefits for artificial intelligence research.
Related Concept Videos
01:27Associative Learning
812
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
812
01:12Observational Learning
563
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
563
01:14Avoidance Learning and Learned Helplessness
2.2K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.2K
01:21Cognitive Learning
791
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
791
01:25Long-term Potentiation
3.0K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
3.0K
01:35Long-term Potentiation
56.9K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
56.9K