内在可塑性编码改进了增强学习的增强行为体网络
Xingyue Liang1, Qiaoyun Wu1, Wenzhang Liu1
1School of Artificial Intelligence, Anhui University, Hefei, 230601, Anhui, China; Engineering Research Center of Autonomous Unmanned System Technology, Ministry of Education, Hefei, 230601, Anhui, China; Anhui Provincial Engineering Research Center for Unmanned Systems and Intelligent Technology, Hefei, 230601, Anhui, China.
概括
本研究引入了一个改进的增强行为者网络 (IP-SAN) 强化学习 (RL). 这种新的方法增强了生物现实性,并在持续控制任务中优于现有的方法.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 深度强化学习 (DRL) 使用深度神经网络 (DNN) 取得重大进展.
- 尖端神经网络 (SNN) 通过二进制信号和可塑性模仿生物大脑效率.
- 有效的信息编码对于SNN的计算机制至关重要.
研究的目的:
- 为加强学习 (RL) 开发一个改进的尖端参与者网络 (IP-SAN).
- 为了增强空间时空状态表示和RL代理生物模拟准确性.
- 在持续控制任务中实现更有效的决策.
主要方法:
- 在网络层面集成适应性人口编码.
- 纳入神经元层面的动态尖端神经元编码.
- 开发SNN的内在可塑性编码机制.
主要成果:
- 与最先进的方法相比,拟议的IP-SAN表现出优越的性能.
- 该模型在五个连续控制任务中取得了显著的改进.
- 观察到增强的时空状态表示和生物模拟准确性.
结论:
- IP-SAN 提供了一种有前途的方法,用于在 RL 中有效的决策.
- 内在可塑性和高级编码策略的整合提高了SNN的性能.
- 这项工作有助于更具生物可信性和有效的AI代理.
相关概念视频
Neuroplasticity
289
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
289
Long-term Potentiation
2.7K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.7K
The Role of Ion Channels in Neuronal Computation
3.1K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.1K
Instinctive Drift
186
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
186
Action Potential
7.8K
Neurons communicate by firing action potentials—the electrochemical signal that is propagated along the axon. The signal results in the release of neurotransmitters at axon terminals, thereby transmitting information to the nervous system. An action potential is a specific "all-or-none" change in membrane potential that results in a rapid spike in voltage.
Membrane potential in neurons
Neurons typically have a resting membrane potential of about -70 millivolts (mV). When they...
Membrane potential in neurons
Neurons typically have a resting membrane potential of about -70 millivolts (mV). When they...
7.8K
Neural Circuits
1.0K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.0K


