一个受大脑启发的算法,可以缓解人工神经网络的灾难性遗忘,并且具有较低的计算成本
Tielin Zhang1,2,3, Xiang Cheng1,2, Shuncheng Jia1,2
1Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
Science advances
|August 25, 2023
概括
这项研究引入了一种新的脑启发的算法,神经调节辅助信用分配 (NACA),用于人工神经网络. 通过模仿大脑神经调节,NACA有效地增强学习并减少灾难性遗忘.
科学领域:
- 计算神经科学是一种计算神经科学.
- 人工智能的人工智能是人工智能.
- 机器学习 机器学习
背景情况:
- 现有的人工神经网络 (ANN) 和尖端神经网络 (SNN) 很少包含元可塑性,这是神经调节器对突触可塑性的全球影响.
- 神经调节通过影响突触变化,在大脑学习和记忆中发挥着至关重要的作用.
研究的目的:
- 为ANN和SNN开发一种高效,以大脑为灵感的计算算法,该算法包含神经调节.
- 研究神经调节对合成神经网络中的突触可塑性和学习性能的影响.
主要方法:
- 介绍了神经调节辅助信用分配 (NACA) 算法,该算法使用预期信号来调节选择性突触中的神经调节器水平.
- 根据神经调节器水平,以非线性方式改变长期突触强化和抑郁.
- 评估了NACA在空间和时间分类任务以及不同复杂度的持续学习任务上的表现.
主要成果:
- 在学习空间和时间任务时,NACA实现了高识别精度,显著降低了计算成本.
- 该算法在持续学习任务中表现出效率,以低计算成本减轻灾难性遗忘.
- 对突触重量变化的分析表明,由基于预期的神经调节驱动的稀疏和有针对性的修改解释了NACA的好处.
结论:
- 通过整合神经调节原理,NACA算法提供了一种高效,以大脑为灵感的人工神经网络学习方法.
- 纳卡有效地提高了学习准确性和强度,防止灾难性遗忘,同时尽量减少计算需求.
- 这项工作强调了模仿大脑神经调节的潜力,以开发更复杂和更有效的AI系统.
相关概念视频
Forgetting
99
Forgetting is an intrinsic aspect of human memory, characterized by the gradual loss or inaccessibility of information over time. Hermann Ebbinghaus, a pioneering psychologist, extensively studied this phenomenon and formulated the forgetting curve. This curve illustrates that memory loss occurs rapidly immediately after learning and then decelerates over time. Several mechanisms contribute to forgetting, including encoding failure, storage decay, retrieval failure, and interference.
Encoding...
Encoding...
99
Interference and Decay
166
Forgetting is a complex cognitive phenomenon influenced by several factors, among which interference and decay are particularly prominent. These processes explain why individuals often struggle to retrieve specific information from memory, leading to lapses in recall that can be observed in everyday situations.
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
166
Neural Circuits
1.3K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.3K
Long-term Potentiation
55.3K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
55.3K
Neuroplasticity
567
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
567
Higher Mental Functions of Brain: Learning and Memory
871
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
871


