相关实验视频

Updated: Jun 27, 2025

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

大脑拓改进了尖端神经网络,以实现连续控制的高效强化学习

Yongjian Wang^1,2, Yansong Wang^3,4, Xinhe Zhang¹

¹Institute of Automation, Chinese Academy of Sciences, Beijing, China.

Frontiers in neuroscience

|May 2, 2024

概括

这项研究介绍了一个经大脑拓改进的尖端神经网络 (BT-SNN),用于高效的强化学习. 灵感来源于老鼠大脑拓的BT-SNN在复杂的任务中优于传统网络.

科学领域:

神经科学是一个神经科学.
人工智能的人工智能
计算生物学计算生物学

背景情况:

生物大脑拓反映了数百万年的进化,为高效,强大和灵活的人工智能提供蓝图.
尖端神经网络 (SNN) 对类似大脑的智能有希望,但往往缺乏优化的拓.

研究的目的:

开发一个脑拓改进的尖端神经网络 (BT-SNN),用于增强强化学习 (RL).
为了利用生物大脑连接体特征,使人工智能更高效和有效.

主要方法:

从Allen小鼠大脑连接组中生成和选择生物拓,使用Tanimoto等级集群.
基于生物约束的过拓,如节点功能比例和网络稀疏性.
集成选择的拓与混合溶解器改进的泄漏集成和火神经元.
采用适应性随机搜索,一种进化算法,用于突触修饰而不是反向传播.

主要成果:

与随机拓的SNN相比,BT-SNN在四个类似动物生存的RL任务中取得了更高的分数.
BT-SNN的性能超过了经典的人工神经网络 (ANN),如长期短期记忆和多层感知子.
提出的拓优化和进化学习规则对RL有效.

结论:

将生物大脑拓纳入SNN显著提高了强化学习能力.
进化学习规则为生物灵感网络中的突触可塑性提供了反向传播的可行替代方案.
这项研究强调了生物灵感人工智能的潜力,用于开发更高效,更强大的智能系统.

关键词:

大脑拓学大脑拓学一个层次的集群.神经形态计算是一种神经形态计算.强化学习是一种强化学习.尖的神经网络的神经网络.

更多相关视频

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments

Published on: November 12, 2019

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Published on: June 24, 2015

相关概念视频

Neuroplasticity

Neuroplasticity

Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.

Neural Circuits

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...

Long-term Potentiation

Long-term Potentiation

Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.