STSF:用于尖端神经网络的尖端时间节省反学习.
概括
我们介绍了一种尖端时间短反 (STSF) 学习方法,用于高效地训练尖端神经网络 (SNN). 这种生物可信的方法提高了SNN的准确性,并降低了SNN的计算成本.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 尖端神经网络 (SNN) 提供了由于二进制尖端列车信息传输的计算效率.
- 传统的反向传播 (BP) 训练对于SNN来说是计算上昂贵的,因为它们的时空动态.
- 对SNN的无监督学习方法往往会导致低于最佳性能.
研究的目的:
- 提出一种新的,高效的,生物可信的学习方法,用于尖端神经网络.
- 为了应对当前SNN培训方法中高计算成本和低于最佳准确性的挑战.
- 为了提高并行性,并减少SNN中的存储开销.
主要方法:
- 开发了一种尖端时间稀疏反 (STSF) 学习方法,将全球监督学习与稀疏直接反对齐 (DFA) 和局部平衡学习与尖端时间依赖可塑性 (STDP) 结合起来.
- 利用神经调节器进行全球学习,并结合稀疏的固定随机反连接进行错误调制,用选择操作取代乘法.
- 专注于即时的突触活动,用于独立和同时优化网络层.
主要成果:
- 与现有的SNN培训算法相比,STSF方法显著降低了计算成本.
- 在各种分类任务中实现了显著更高的准确性,与最先进的方法相比.
- 证明了改善生物可信性,增强并行性和减少存储开销.
结论:
- 拟议的STSF学习方法为训练尖端神经网络提供了一种高效和生物可信的方法.
- STSF有效地平衡了计算效率和高精度,克服了传统培训方法的局限性.
- 该方法的架构促进了并行性,并减少了内存需求,使其适合神经形态硬件.
相关概念视频
Long-term Potentiation
54.6K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
54.6K
Integration of Synaptic Events
1.4K
Synaptic integration mainly includes the summation of graded potentials. Graded potentials, regardless of their type, cause subtle alterations in membrane voltage, resulting in either depolarization or hyperpolarization. These incremental changes, when combined or summed, can propel the neuron toward its threshold. Consider, for example, a membrane experiencing a +15 mV shift, causing it to depolarize from -70 mV to -55 mV. In this scenario, graded potentials govern the membrane's ability...
1.4K
The Role of Ion Channels in Neuronal Computation
3.1K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.1K


