一个持续学习框架,具有长期和多个短期记忆网络
Shangge Liu1, Lei Wang2, Rui Yan3
1State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, 210008, China.
概括
这项研究引入了一种新的持续学习框架,包含多个短期记忆网络和高斯混合模型调节器. 它通过更好地平衡稳定性和可塑性来增强知识保留和新的学习.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 神经科学是一个神经科学.
背景情况:
- 持续学习旨在顺序积累知识,平衡稳定性和可塑性.
- 现有的方法往往优先考虑缓解灾难性遗忘,可能牺牲可塑性.
- 单个辅助内存网络可能无法捕捉到全新的任务知识的多样性.
研究的目的:
- 提出一种由神经科学启发的新型持续学习框架.
- 通过捕捉各种任务特定知识来增强可塑性.
- 提高知识保留和新学习之间的平衡.
主要方法:
- 结合多个短期记忆网络,用于各种知识捕获.
- 使用长期记忆网络来保存先前的知识.
- 开发基于高斯混合模型的调节器,用于灵活的知识集成,克服欧几里德距离调节器的局限性.
主要成果:
- 拟议的框架有效地平衡了知识的保留和新的学习.
- 理论分析和实验研究证实了该框架的有效性.
- 在持续学习基准指标中,与现有方法相比,有明显的优势.
结论:
- 新的框架通过利用分布式内存表示来增强持续学习.
- 高斯混合模型调节器促进了灵活的知识选择和集成.
- 该框架具有多功能性,并且与各种现有的持续学习算法兼容.
更多相关视频
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
8.1K
09:39Improved Preparation and Preservation of Hippocampal Mouse Slices for a Very Stable and Reproducible Recording of Long-term Potentiation
Published on: June 26, 2013
27.9K
相关概念视频
Long-Term Memory
791
Long-term memory is a relatively permanent type of memory, capable of storing vast amounts of information over extended periods. Its storage capacity is generally considered unlimited.
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
791
Long-term Potentiation
59.1K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
59.1K
Long-term Potentiation
3.7K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
3.7K
System of Memory
7.6K
Memory is categorized into three major systems: sensory memory, short-term memory (STM), and long-term memory (LTM). These systems differ in their capacity and the duration for which they can hold information. Sensory memory captures raw sensory input from the environment, holding it for just a few seconds or less. For example, on hearing a brief, loud sound, like a car horn honking, the sound seems to linger in the mind for a moment even after it stops. This is an instance of sensory memory...
7.6K
Higher Mental Functions of Brain: Learning and Memory
2.2K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
2.2K
Storage
452
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
452
