在循环神经网络中通过神经调节来实现结构化的灵活性
Julia C Costacurta1,2, Shaunak Bhandarkar3, David M Zoltowski1,4
1Wu Tsai Neurosciences Institute, Stanford, CA, USA.
bioRxiv : the preprint server for biology
|August 2, 2024
概括
这项研究引入了一个神经调节的循环神经网络 (NM-RNN) 模型,该模型可以动态调整突触重量. NM-RNN在训练和概括方面表现出更高的准确性,为生物智能提供了洞察力.
科学领域:
- 理论神经科学 理论神经科学
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
背景情况:
- 了解生物智能需要复杂的计算模型.
- 循环神经网络 (RNN) 模拟大脑计算,但通常假定固定的突触重量.
- 神经调节器在生物系统中动态改变突触重量.
研究的目的:
- 探索突触增益缩放的计算含义,一种神经调节的形式.
- 引入一个包含动态突触缩放的神经调节RNN (NM-RNN) 模型.
- 研究神经调制如何影响网络训练,概括和计算机制.
主要方法:
- 开发了一种神经调节RNN (NM-RNN) 模型,其中一个子网络输出信号以缩放反复重量.
- 使用任务优化的低级RNN来实现模型.
- 在规范任务上进行实证实验,并进行理论分析.
主要成果:
- 与标准的低级RNN相比,NM-RNN模型在训练和概括方面取得了更高的准确性.
- 已经证明神经调节增益缩放能够启用类似于人工RNN中的门机制.
- 分析揭示了任务计算如何分布在训练有素的NM-RNN的低级动态中.
结论:
- 突触增益缩放提供了结构化的灵活性,提高了RNN的性能.
- 神经调节提供了一个在神经网络中实现灵活门的机制.
- NM-RNN模型为理解神经调节在生物和人工智能中的作用提供了一个框架.
相关概念视频
Neuroplasticity
320
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
320
Neural Circuits
1.1K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.1K
Neural Regulation
39.2K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
39.2K


