低延迟和稀缺计算尖端神经网络与自动驱动的自适应值可塑性
IEEE transactions on neural networks and learning systems
|August 15, 2023
概括
尖端神经网络 (SNN) 通过新的自动驱动自适应值可塑性 (SATP) 机制实现更低的推断延迟和更低的计算密度. 这种方法提高了准确性,使神经元能够自主调整发射值.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
背景情况:
- 尖端神经网络 (SNN) 提供了诸如低功耗和生物可信性等优势.
- 对于SNN来说,一个关键的挑战是由于神经元触发值的推断延迟.
研究的目的:
- 引入一种新的机制,即自动驱动的自适应值可塑性 (SATP),以减轻SNN推断延迟.
- 通过优化发射值来提高SNN性能,以减少延迟,计算和提高准确性.
主要方法:
- 为SNN提出了自动驱动的自适应值可塑性 (SATP) 机制.
- 神经元根据个体状态信息和使用无监督学习的触发事件自主调整触发值.
- SATP的设计是为了最大限度地提高输出峰值速率分布中的信息.
主要成果:
- 广泛的实验表明,SATP有效地减少了SNN推断延迟.
- SATP导致计算密度降低,同时提高计算精度.
- 该机制促进了具有低延迟,稀疏计算和高精度的SNN模型.
结论:
- SATP是克服SNN中的延迟挑战的可行机制.
- 这种方法提高了SNN在各种领域的实际应用性.
- SATP有助于开发更高效,更准确的神经形态计算系统.
相关概念视频
Neuroplasticity
568
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
568
Long-term Potentiation
2.8K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.8K
Plasticity
2.2K
Plasticity is the property where an object loses its elasticity and undergoes irreversible deformation, even after the deformation forces are eliminated. If a material deforms irreversibly without increasing stress or load, then this is called ideal plasticity. For example, when a force is applied to an aluminum rod, it changes its shape, but it does not return to its original shape once the force is removed. Plastic deformation or ductility is thus a permanent deformation or change in the...
2.2K


