在循环神经网络中通过神经调节来实现结构化的灵活性
Julia C Costacurta1, David Zoltowski1, Shaunak Bhandarkar1
1Stanford University.
Advances in neural information processing systems
|November 7, 2025
概括
这项研究引入了一个神经调节的循环神经网络 (NM-RNN),可以动态调整突触重量,提高生物智能模型的准确性. 这种灵活的方法可以提高神经网络任务的培训和概括性.
科学领域:
- 理论和系统神经科学 理论和系统神经科学
- 计算神经科学是一种计算神经科学.
- 人工智能建模的人工智能建模
背景情况:
- 了解生物智能依赖于计算模型.
- 任务优化的循环神经网络 (RNN) 广泛使用,但具有固定的突触权重.
- 生物神经网络具有由化学物质调节的动态突触重量.
研究的目的:
- 探索突触增益缩放的计算影响,一种神经调节的形式.
- 引入一个带有动态重量调整的神经调节RNN (NM-RNN) 模型.
- 研究神经调节如何影响RNN性能和机制.
主要方法:
- 开发了一个神经调节RNN (NM-RNN) 模型,使用任务优化的低级RNN.
- 实现了一个神经调节子网络,以动态缩放反复重量.
- 在规范任务和理论分析上进行经验实验.
主要成果:
- 与标准的低级RNN相比,NM-RNN模型在训练和概括方面表现出更高的准确性.
- 已经证明神经调节增益缩放能够在网络内启用关门机制.
- 分析揭示了任务计算如何分布在训练有素的NM-RNN的低级动态中.
结论:
- 动态突触增益缩放提供了结构化的灵活性,提高了RNN的性能.
- 神经调制提供了一个在神经网络中实现灵活计算控制的机制.
- NM-RNN模型提供了一种更具生物学可信性和计算有效性的智能建模方法.
相关概念视频
Neuroplasticity
1.5K
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
1.5K
Neural Regulation
43.1K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
43.1K
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Neural Control of Respiration
4.5K
The neural regulation of respiration is a meticulously coordinated process primarily controlled by the respiratory centers located within the brainstem. These centers, composed of specialized neurons, transmit nerve impulses that control the contraction and relaxation of our respiratory muscles.
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
4.5K


