使用局部反复的动机和降低风险的架构优化构建反复的尖端神经网络
Wenrui Zhang1, Hejia Geng1, Peng Li1
1Department of Electrical and Computer Engineering, University of California, Santa Barbara, Santa Barbara, CA, United States.
Frontiers in neuroscience
|July 5, 2024
概括
本研究介绍了一种可扩展的架构和优化方法,用于经常性尖端神经网络 (RSNNs),通过自动化设计显著提高基准数据集的性能.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 循环连接对于神经电路的功能和稳定性至关重要.
- 现有的反复尖端神经网络 (RSNN) 缺乏系统的架构优化.
- 优化RSNN架构对于记忆和学习至关重要,但仍然是一个挑战.
研究的目的:
- 为大型RSNN开发一个可扩展的架构.
- 引入一种用于优化RSNN拓的自动化方法.
- 通过系统设计来提高RSNN的性能和稳定性.
主要方法:
- 为可扩展性提出了一个稀疏连接的反复动机层 (SC-ML) 架构.
- 引入了用于拓优化的混合风险减轻架构搜索 (HRMAS).
- 整合了一种生物灵感的内在可塑性机制,用于网络自我适应.
主要成果:
- 在基准数据集上实现了高精度:TI46-Alpha (96.44%),N-TIDIGITS (94.66%),DVS-Gesture (90.28%) 和N-MNIST (98.72%).
- 与手动设计的RSNN相比,已经证明了显著的性能提升.
- 成功启用了RSNN的系统架构优化.
结论:
- 新的SC-ML架构和HRMAS方法使得RSNN可扩展和优化.
- 自动架构优化与内在的可塑性提高RSNN的性能和稳定性.
- 本文介绍了第一个针对RSNN的系统架构优化.
更多相关视频
10:32Design, Surface Treatment, Cellular Plating, and Culturing of Modular Neuronal Networks Composed of Functionally Inter-connected Circuits
Published on: April 15, 2015
8.5K
05:19Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments
Published on: November 12, 2019
7.0K
相关概念视频
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
Neuroplasticity
322
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
322
