ストキャスティックリリースの可塑性による報酬最適化学習
Yuhao Sun1,2, Wantong Liao1,2, Jinhao Li1,3
1Laboratory of Brain and Intelligence, Tsinghua University, Beijing, China.
Frontiers in neural circuits
|September 2, 2025
まとめ
報酬最適化ストキャスティックリリースの可塑性 (RSRP) を導入します 神経ネットワークの新しい学習ルールです RSRPは,AIや神経科学の確立された方法に匹敵する,強固で効果的な報酬主導の学習を実現します.
科学分野:
- 計算神経科学
- 人工知能
- 機械学習
背景:
- 神経系における適応的学習を可能にするシナプス可塑性は 報酬主導の学習の生物学的に妥当なモデルです
- 鍵となる課題は,エラーの反転の強度と効果に匹敵する可塑性ルールの開発です.
研究 の 目的:
- 新しい学習フレームワークである報酬最適化ストキャスティックリリースの可塑性 (RSRP) を導入します.
- 報酬シグナルを最大化する可塑性ルールを自然グラデント推定を用いて導きます.
- 強化学習と数字分類のタスクにおけるRSRPの性能と安定性を評価する.
主な方法:
- RSRPフレームワーク内のパラメータ化された分布としてシナプス解離をモデル化します.
- RSRPの学習ルールを導出するために自然グラデントの推定を使用します.
- RSRPを生物学的に妥当なニューラルネットワークで検証し,近接政策最適化 (PPO) とエラーバックプロパガンダと比較する.
主要な成果:
- RSRPは,PPOと同等の強化学習で競争力のあるパフォーマンスと安定性を示しています.
- RSRPは,数字分類のタスクにおけるエラーのバックプロパガンダに匹敵する精度を達成します.
- 報酬の正規化は,RSRPを安定させるための重要なメカニズムとして特定されています.
結論:
- RSRPは,強固で効果的なシナプス可塑性学習ルールを提供します.
- この発見は,人工知能と実験神経科学の両方に,特に不連続強化学習シナリオに影響を及ぼします.
関連する概念動画
Neuroplasticity
752
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
752
Long-term Potentiation
2.9K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.9K
Plasticity
2.5K
Plasticity is the property where an object loses its elasticity and undergoes irreversible deformation, even after the deformation forces are eliminated. If a material deforms irreversibly without increasing stress or load, then this is called ideal plasticity. For example, when a force is applied to an aluminum rod, it changes its shape, but it does not return to its original shape once the force is removed. Plastic deformation or ductility is thus a permanent deformation or change in the...
2.5K
Purposive Learning
204
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
204
Long-term Depression
2.6K
Long-term depression, or LTD, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTD is the process of synaptic weakening that occurs over time between pre and postsynaptic neuronal connections. The synaptic weakening of LTD works in opposition to synaptic strengthening by long-term potentiation (LTP) and together are the main mechanisms that underlie learning and memory.
Calcium Ion Concentration Mechanism
If over...
Calcium Ion Concentration Mechanism
If over...
2.6K


