通过活动规范化进行生物灵感,无任务的持续学习
Francesco Lässig1, Pau Vilimelis Aceituno2, Martino Sorbaro2,3
1Institute of Neuroinformatics University of Zürich and ETH, Zürich, Switzerland. flaessig@ethz.ch.
Biological cybernetics
|August 17, 2023
概括
这项研究引入了一种由大脑功能启发的新型持续学习 (CL) 方法,使用稀疏的表示和反复连接来防止灾难性遗忘,而不需要任务界限.
科学领域:
- 神经科学是一个神经科学.
- 深度学习 (Deep Learning) 是一种深度学习.
- 人工智能的人工智能
背景情况:
- 深度学习中的持续学习 (CL) 与生物大脑不同,与灾难性遗忘作斗争.
- 现有的CL方法通常需要预定义的任务界限,限制了现实世界的适用性.
研究的目的:
- 开发一种生物启发的,无任务的持续学习算法.
- 调查稀疏的神经元表示和反复连接在防止灾难性遗忘中的作用.
主要方法:
- 实施了DFC (深度反控制) 的稀有版本.
- 结合DFC与获胜者获取所有稀疏性和横向反复连接.
- 在分拆MNIST计算机视觉基准上评估了该方法.
主要成果:
- 稀疏性和层内反复连接的组合显著改善了CL性能,而不是标准的反向传播.
- 拟议的方法实现了与已建立的CL技术 (如EWC和Synaptic Intelligence) 相当的性能.
- 这种方法成功地学习了,而不需要明确的任务边界信息.
结论:
- 生物启发的计算原理可以导致有效的无任务持续学习算法.
- 稀疏的表示和反复的连接对于强大的持续学习至关重要.
- 这项工作为开发更具适应性和类似大脑的人工智能提供了有希望的方向.
更多相关视频
相关概念视频
Observational Learning
209
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
209
Purposive Learning
141
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
141
Cognitive Learning
421
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
421
Introduction to Learning
471
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
471
Associative Learning
441
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
441
Avoidance Learning and Learned Helplessness
1.8K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.8K


