生物学的に妥当な学習のためのモジュラーリキュアントニューラルネットワークを通じてエラー信号の補助的な伝播
Zhuo Liu1, Hao Shu1, Linmiao Wang1
1School of Microelectronics, University of Science and Technology of China, Hefei, China.
eLife
|February 16, 2026
まとめ
ニューラルネットワークのための生物学的に妥当な学習枠組みであるアジョイントプロパゲーション (AP) を導入します. APは,脳機能の原則と整合しながら,バックプロパガンダ (BP) と比較できる効率的でスケーラブルなトレーニングを可能にします.
科学分野:
- 神経科学は神経科学である.
- 人工知能 (AI) とは,人工知能 (AI) のことです.
- 機械学習 (Machine Learning) とは,機械学習 (Machine Learning) について学ぶことです.
背景:
- 脳機能を理解し,インテリジェントなシステムを設計するには,生物学的に妥当な学習メカニズムが必要です.
- 現在の人工ニューラルネットワークのトレーニングは,しばしばバックプロパガンダ (BP) に依存しており,そのフィードバック要件のために生物学的妥当性が欠けている.
研究 の 目的:
- 脳の複数のスケールで繰り返される接続性からインスパイアされた新しいアジョイントプロパガンダ (AP) フレームワークを導入する.
- 人工ニューラルネットワークを訓練するために,生物学的に妥当かつ効率的な学習メカニズムを開発する.
- 同じ再発性ニューラルネットワーク (RNN) 内の複数のタスクの同時エラー伝播を可能にします.
主な方法:
- 脳の多層次的な再帰的な接続性からインスパイアされたAPフレームワークは,再帰的なダイナミクスからエラーシグナルを生成します.
- APフレームワークは,マルチリージョン再帰ニューラルネットワーク (MR-RNN) モデルからモジュラリティを継承しています.
- 迅速かつスケーラブルなトレーニングのためのRNNモジュール収束特性を活用し,生物学的に不合理なフィードバックを排除します.
主要な成果:
- APフレームワークは,ベンチマークタスクに関して,BPで訓練されたネットワークに匹敵する精度を達成します.
- 訓練において強度を示し,長期にわたってパフォーマンスを維持します.
- 複数の認知作業のための柔軟なリソース割り当てをサポートし,神経科学の観察と整合します.
結論:
- APフレームワークは,BPに生物学的に妥当な代替案を提供し,人工学習と生物学的学習の原則を橋渡ししています.
- エネルギー効率の良い,脳にインスパイアされたインテリジェント・システムへの道を開く.
- 実験的な神経科学の研究を導くためのメカニズム理論を提供する.
キーワード:
神経科学は神経科学である.関連する概念動画
Propagation of Uncertainty from Random Error
2.0K
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
2.0K
Propagation of Action Potentials
9.7K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
9.7K
Propagation of Uncertainty from Systematic Error
1.5K
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
1.5K
Neural Circuits
2.9K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.9K
Multi-input and Multi-variable systems
431
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
431
Associative Learning
1.5K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.5K

