具有学习效率的尖端神经网络具有多个分区的时空空间反向传播
Yuqian Liu1, Yuechao Wang1, Chi Zhang1
1Department of Automation, Tsinghua University, Beijing 100084, China.
iScience
|July 24, 2025
概括
我们开发了一种用于尖端神经网络 (SNN) 的多隔间神经元模型 (MCN),可以提高学习动态和稳定性. 这种新的方法提高了复杂任务的SNN的融合速度和准确性.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 尖端神经网络 (SNN) 提供以生物神经元为灵感的节能计算.
- 传统的SNN受限于简单的点神经元模型,阻碍了复杂的学习.
- 模拟 soma-dendrite 相互作用对于先进的神经计算至关重要.
研究的目的:
- 介绍SNN的多分区神经元模型 (MCN).
- 研究可训练的跨部门连接在学习动态中的作用.
- 为MCN开发一个稳定的反向传播算法.
主要方法:
- 开发了一种具有可训练的跨分区连接的多分区尖端神经元模型 (MCN).
- 提供了理论证明,这些连接作为时空动量.
- 提出了一种用于增强梯度流的多隔间时空反向传播 (MCST-BP) 算法.
主要成果:
- 在基准数据集 (S-MNIST,CIFAR-10,SHD,ECG) 上,MC-SNN表现优于传统的SNN.
- 该MCN模型显著提高了融合速度和分类准确性.
- 可训练的跨部门连接被证明可以引导学习动态向全球最佳方向发展.
结论:
- 该MCN模型有效模拟soma-dendrite相互作用,增强SNN的能力.
- MCST-BP算法确保了稳定的梯度流,促进了有效的训练.
- 这项研究为高性能大脑启发的学习系统提供了理论和实践的基础.
相关概念视频
Propagation of Action Potentials
6.9K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
6.9K
Multi-input and Multi-variable systems
150
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
150
Neural Circuits
1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K
Long-term Potentiation
55.8K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
55.8K
Multicompartment Models: Overview
258
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
258


