通过模块化循环神经网络进行错误信号的辅助传播,以实现生物学上可信的学习
Zhuo Liu1, Hao Shu1, Linmiao Wang1
1School of Microelectronics, University of Science and Technology of China, Hefei, China.
eLife
|February 16, 2026
概括
我们介绍了辅助传播 (AP),这是神经网络的生物可信的学习框架. AP可以实现高效,可扩展的训练,与反向传播 (BP) 相似,同时与大脑功能原则保持一致.
科学领域:
- 神经科学是一个神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 了解大脑功能和工程智能系统需要生物学上可信的学习机制.
- 当前的人工神经网络训练通常依赖于反向传播 (BP),由于其反要求,它缺乏生物可信性.
研究的目的:
- 引入一个新的辅助传播 (AP) 框架,灵感来自大脑的多层次循环连接.
- 为训练人工神经网络开发一种生物学上可信且有效的学习机制.
- 为了使同一个反复神经网络 (RNN) 内的多个任务同时传播错误.
主要方法:
- 灵感来自于大脑中的多层次的反复连接,AP框架从反复的动态产生错误信号.
- 在AP框架中,模块化继承了多区域循环神经网络 (MR-RNN) 模型的模块性.
- 利用RNN模块的融合特性进行快速和可扩展的训练,消除生物学上不可思议的反.
主要成果:
- 在基准任务上,AP框架的准确性与BP训练的网络相提并论.
- 在训练中表现出强性,在长时间内保持性能.
- 支持灵活的资源分配用于多个认知任务,与神经科学观察保持一致.
结论:
- AP框架为BP提供了一个生物学上可信的替代方案,将人工和生物学习原则相结合.
- 为节能,脑启发的智能系统铺平了道路.
- 为指导实验神经科学研究提供了一种机械理论.
关键词:
神经科学 神经科学相关概念视频
Propagation of Uncertainty from Random Error
2.0K
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
2.0K
Propagation of Action Potentials
9.7K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
9.7K
Propagation of Uncertainty from Systematic Error
1.5K
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
1.5K
Neural Circuits
2.9K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.9K
Multi-input and Multi-variable systems
431
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
431
Associative Learning
1.5K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.5K

