Reward-optimizing learning using stochastic release plasticity
Yuhao Sun1,2, Wantong Liao1,2, Jinhao Li1,3
1Laboratory of Brain and Intelligence, Tsinghua University, Beijing, China.
Abstract:
Synaptic plasticity underlies adaptive learning in neural systems, offering a biologically plausible framework for reward-driven learning. However, a question remains: how can plasticity rules achieve robustness and effectiveness comparable to error backpropagation? In this study, we introduce Reward-Optimized Stochastic Release Plasticity (RSRP), a learning framework where synaptic release is modeled as a parameterized distribution. Utilizing natural gradient estimation, we derive a synaptic plasticity learning rule that effectively adapts to maximize reward signals. Our approach achieves competitive performance and demonstrates stability in reinforcement learning, comparable to Proximal Policy Optimization (PPO), while attaining accuracy comparable with error backpropagation in digit classification. Additionally, we identify reward regularization as a key stabilizing mechanism and validate our method in biologically plausible networks. Our findings suggest that RSRP offers a robust and effective plasticity learning rule, especially in a discontinuous reinforcement learning paradigm, with potential implications for both artificial intelligence and experimental neuroscience.
Related Concept Videos
Neuroplasticity
Long-term Potentiation
Hebbian LTP
LTP can occur when...
Plasticity
Purposive Learning
Long-term Depression
Calcium Ion Concentration Mechanism
If over...


