多分区神经元和人口编码为深度分布强化学习提供动力尖端神经网络
Yinqian Sun1, Feifei Zhao1, Zhuoya Zhao1
1Brain-inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China.
概括
这项研究引入了一个由大脑启发的尖端神经网络 (SNN) 算法,使用多分区神经元 (MCN) 模型来增强深度强化学习. 这种新的方法提高了AI任务的性能,并降低了AI任务的能源消耗.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 尖端神经网络 (SNN) 模仿大脑处理,以提高能源效率和生物现实性.
- 现有的SNN模型往往简化了神经元,限制了计算和学习能力.
- 漏洞整合和发射 (LIF) 模型是常见的,但忽视了神经元结构.
研究的目的:
- 使用SNNs开发一种由大脑启发的深度强化学习算法.
- 在SNN中整合一个生物现实的多分区神经元 (MCN) 模型.
- 通过结合结构神经元属性来增强SNN中的计算能力和学习.
主要方法:
- 提出了一个基于SNN的深度分布强化学习算法.
- 整合了一种生物启发的多分区神经元 (MCN) 模型,模拟树突和体内分区.
- 引入了一种隐性分数嵌入方法,使用尖端神经元的种群编码.
主要成果:
- 拟议的模型,MCS-FQF,在阿塔利游戏上表现优于香草FQF (基于ANN) 和Spiking-FQF (ANN到SNN转换).
- 废弃性研究证实了MCN模型和人口峰值代表性的好处.
- 新型SNN方法显示了性能提升和功耗降低.
结论:
- 多隔间神经元模型显著提高了SNN的计算能力和学习能力.
- 使用隐式分数表示的种群编码提高了SNN的性能和效率.
- 这种由大脑启发的SNN方法为先进的人工智能和神经形态计算提供了一个有希望的方向.
相关概念视频
01:25Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
01:19The Role of Ion Channels in Neuronal Computation
3.1K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.1K
01:28Neuronal Communication
788
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
788
01:30Neuron Structure
12.7K
Neurons are the main type of cell in the nervous system that generate and transmit electrochemical signals. They primarily communicate with each other using neurotransmitters at specific junctions called synapses. Neurons come in many shapes that often relate to their function, but most share three main structures: an axon and dendrites that extend out from a cell body.
Structure and Function of Neurons
The neuronal cell body—the soma— houses the nucleus and organelles vital to...
Structure and Function of Neurons
The neuronal cell body—the soma— houses the nucleus and organelles vital to...
12.7K