人工神经网络的脑启发的布线经济学
Xin-Jie Zhang1,2, Jack Murdoch Moore1,2, Ting-Ting Gao1,2
1School of Physical Science and Engineering, Tongji University, Shanghai 200092, P. R. China.
PNAS nexus
|January 17, 2025
概括
通过电线成本控制优化人工神经网络 (ANN),提高了性能和结构模块化. 这种方法模仿了生物大脑的布线,改进了ANN.
科学领域:
- 神经科学和人工智能 人工智能
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 大脑网络的布线平衡了信息传输,几何和代谢成本.
- 电线经济和几何学对人工神经网络 (ANN) 的影响尚不清楚.
- 真实的大脑网络表现出特定的拓特性,如模块化和聚类.
研究的目的:
- 研究布线成本控制对稀疏人工神经网络 (ANN) 的结构演变和性能的影响.
- 探索是否优化线路效率与任务性能一起,可以导致ANN中特定任务的结构模块.
- 将成本优化的ANN的布线模式和拓性质与在生物神经网络中观察到的进行比较.
主要方法:
- 开发了一种电线成本控制的培训框架,用于固定节点位置的稀疏ANN.
- 在ANN的结构演变过程中,同时优化了布线效率和任务性能.
- 分析了由此产生的ANN架构的性能,拓性质和连接距离分布.
主要成果:
- 电线成本控制显著改善了ANN在各种任务,架构和培训方法中的性能.
- 最佳的布线成本范围促进了特定任务的结构模块和增强的预测性能.
- 经过布线成本训练的ANN表现出类似于真实生物 (例如,Ciona intestinalis,Caenorhabditis elegans) 的连接距离分布.
- 在成本优化的ANN中,高任务性能与模块化和集群化等拓性质相关,反映了生物大脑网络.
结论:
- 电线成本控制是改善ANN性能和开发生物学上可信的网络结构的可行策略.
- 该框架通过展示线路约束如何塑造网络拓和功能,提供了对生物神经网络组织原理的洞察.
- 该研究强调了网络拓,任务专业化和人工和生物系统中的生物物理约束之间的关系.
相关概念视频
01:25Neural Circuits
1.0K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.0K
01:28Neuronal Communication
771
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
771
01:28Electrical Synapses
8.2K
Electrical synapses found in all nervous systems play important and unique roles. In these synapses, the presynaptic and postsynaptic membranes are very close together (3.5 nm) and are actually physically connected by channel proteins forming gap junctions.
Gap junctions allow the current to pass directly from one cell to the next. In contrast, in the chemical synapse, the neurotransmitters carry the information through the synaptic cleft from one neuron to the next. They consist of two...
Gap junctions allow the current to pass directly from one cell to the next. In contrast, in the chemical synapse, the neurotransmitters carry the information through the synaptic cleft from one neuron to the next. They consist of two...
8.2K
01:19The Role of Ion Channels in Neuronal Computation
3.1K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.1K