Related Experiment Videos
Stable online evolutionary learning of NN-MLP.
1Univ of Aizu.
IEEE Transactions on Neural Networks
|January 1, 1997
Summary
This study improves the R(4)-rule, an evolutionary algorithm for designing neural networks. The enhanced R(4)-rule stabilizes online learning by refining neuron reduction and review processes, leading to more robust and efficient network design.
Area of Science:
- Artificial Intelligence
- Machine Learning
- Computational Neuroscience
Background:
- Efficient design of nearest-neighbor-based multilayer perceptrons (NN-MLPs) is crucial for advanced AI applications.
- The R(4)-rule, a nongenetic evolutionary algorithm, has shown promise for offline NN-MLP design, yielding small networks with high generalization.
- Direct application of the R(4)-rule to online learning is hindered by instability issues stemming from over-reduction and over-review.
Purpose of the Study:
- To adapt and stabilize the R(4)-rule for effective online learning in NN-MLP design.
- To introduce robust modifications to the reduction and review operations of the R(4)-rule algorithm.
Main Methods:
- Proposed an improved reduction method where hidden neuron fitness is evaluated based on long-term behavior across multiple learning cycles.
- Developed a more efficient review process for adjusting hidden neurons with greater precision.
- Evaluated the performance of the improved R(4)-rule for online learning through experimental validation.
Main Results:
- The improved reduction strategy enhances robustness for online learning by considering the overall behavior of hidden neurons.
- The refined review process leads to more efficient adjustments of hidden neurons, improving learning dynamics.
- Experimental results demonstrate the effectiveness of the stabilized R(4)-rule in online NN-MLP design.
Conclusions:
- The modified R(4)-rule effectively addresses the instability issues of the original algorithm in online learning scenarios.
- The proposed enhancements enable the R(4)-rule to design efficient and robust NN-MLPs in real-time learning environments.
- This work contributes to the development of more stable and efficient evolutionary algorithms for neural network optimization.
Related Concept Videos
01:12Observational Learning
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
01:27Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
01:14Avoidance Learning and Learned Helplessness
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
01:22Multi-input and Multi-variable systems
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
01:18Introduction to Learning
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
01:24Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...