在深度尖端神经网络中进行在线持续学习的天体细胞门式多时间尺度可塑性
1School of Computer and Data Science, Minjiang University, Fuzhou, China.
Frontiers in neuroscience
|February 12, 2026
概括
本研究介绍了Astrocyte-Gated Multi-Timescale Plasticity (AGMP),这是一个用于尖端神经网络 (SNN) 的新型在线学习框架. AGMP能够实现强大的持续学习,克服SNN中的灾难性遗忘和记忆限制.
科学领域:
- 神经形态工程的神经形态工程
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
背景情况:
- 尖端神经网络 (SNN) 提供节能,事件驱动的计算,非常适合实时感官数据.
- 在线训练深度SNN并不断面临诸如时间逆向传播 (BPTT) 的记忆瓶和当地学习规则中的稳定性-可塑性困境等挑战.
研究的目的:
- 为SNNs开发一个可扩展的在线学习框架,解决现有培训方法的局限性.
- 引入一种生物启发的机制,即天体细胞门式多时间尺度可塑性 (AGMP),用于SNN中强大的持续学习.
主要方法:
- AGMP通过广播教学信号和星细胞介导的门机制增加了资格跟踪.
- 一个缓慢的星细胞变量根据神经元活动动态调节可塑性,在稳定时期抑制更新,并在分布转移期间实现适应.
- 该框架是根据神经形态基准 (N-Caltech101,DVS128 Gesture,SHD) 和类增量持续学习任务 (Split CIFAR-100) 进行评估的.
主要成果:
- AGMP 实现了与线下 BPTT 相似的准确性,同时保持了恒定的 O(1) 时间内存复杂性.
- 在类增量持续学习中,AGMP显著减少了灾难性遗忘,而不需要重复缓冲器.
- 在持续学习场景中,AGMP的表现优于现有的最先进的在线学习规则.
结论:
- AGMP 提出了一种基于生物学和硬件友好的方法,用于自主代理的终身学习.
- 拟议的方法提供了一个可行的解决方案,用于SNNs的强大和高效的在线和持续培训.
相关概念视频
00:58Plasticity
3.1K
Plasticity is the property where an object loses its elasticity and undergoes irreversible deformation, even after the deformation forces are eliminated. If a material deforms irreversibly without increasing stress or load, then this is called ideal plasticity. For example, when a force is applied to an aluminum rod, it changes its shape, but it does not return to its original shape once the force is removed. Plastic deformation or ductility is thus a permanent deformation or change in the...
3.1K
01:31Plasticizers
378
Water-reducers, or plasticizers, are chemical admixtures used in concrete to improve strength and workability. These additives reduce the water-cement ratio without compromising workability, lower the cement content while maintaining the same workability, or increase workability to assist concrete placement in inaccessible areas.
Plasticizers function by using surface-active agents to create repulsive electrostatic forces between cement particles. This dispersion enhances the concrete's...
Plasticizers function by using surface-active agents to create repulsive electrostatic forces between cement particles. This dispersion enhances the concrete's...
378
02:18Network Covalent Solids
16.2K
Network covalent solids contain a three-dimensional network of covalently bonded atoms as found in the crystal structures of nonmetals like diamond, graphite, silicon, and some covalent compounds, such as silicon dioxide (sand) and silicon carbide (carborundum, the abrasive on sandpaper). Many minerals have networks of covalent bonds.
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
16.2K
02:26Protein Networks
4.6K
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
4.6K
01:21Plastic Behavior
585
A material's elastic behavior is characterized by the disappearance of stress once the load is removed, allowing the material to return to its original state. However, when stress surpasses the yield point, yielding commences, marking the onset of plastic deformation or permanent set. This change from elastic to plastic behavior is influenced by the peak stress value and the duration before the load is removed. An intriguing observation occurs when a specimen is loaded, unloaded, and...
585
01:14Plastic Deformations
477
It is essential to understand how structural members behave under plastic deformation when the bending stress exceeds the material's yield strength. This state of deformation permanently alters the shape of the member, in contrast to the linear elastic behavior observed before yielding. The strain at any point in the member is expressed in terms of maximum strain. Notably, the neutral axis, which coincides with the centroid during elastic bending, shifts away from the centroid under plastic...
477