混合神经网络用于持续学习,其灵感来源于皮质和海马皮质电路
Qianqian Shi1,2,3,4,5, Faqiang Liu1,2,3,4,5, Hongyi Li1,2,3,4,5
1Center for Brain-Inspired Computing Research (CBICR), Tsinghua University, Beijing, China.
Nature communications
|February 2, 2025
概括
生物系统使用双重记忆表征来避免灾难性遗忘. 我们开发了一个混合神经网络 (CH-HNN),灵感来自于皮质和海马回路,以减轻人工智能中的这个问题,从而实现高效的终身学习.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 人工系统表现出灾难性的遗忘,与能够终身学习的生物系统不同.
- 生物记忆依赖于皮质海马体电路中的双重表示 (具体和通用).
- 这种双重的代表性促进了适应和学习新的概念,而不忘记以前的概念.
研究的目的:
- 开发一种能够克服灾难性遗忘的人工系统.
- 模拟生物记忆机制,以增强持续学习.
- 调查皮质和海马体电路在终身学习中的作用.
主要方法:
- 开发了一种混合神经网络 (CH-HNN),结合了人工神经网络和尖端神经网络.
- 在皮质海马体电路中发现的模拟双重记忆表示.
- 利用情节推断来学习利用先前知识的新概念.
主要成果:
- 在任务增量学习和类增量学习中显著缓解灾难性遗忘.
- 在没有增加内存需求的情况下,演示了任务不可知操作.
- 在动态环境中展示了适应能力和强度.
结论:
- 通过模仿生物记忆,CH-HNN模型有效地解决了灾难性遗忘问题.
- 这种方法提供了对皮质和海马皮带电路神经功能的洞察.
- 这种节能型号有可能用于现实世界的持续学习应用.
相关概念视频
Neural Circuits
1.0K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.0K
Long-term Potentiation
54.7K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
54.7K
Neuroplasticity
272
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
272


