通过在重复性神经网络中通过相互信息最小化出现功能差异化的结构
Yuki Tomoda1, Ichiro Tsuda2, Yutaka Yamaguti3
1Graduate School of Engineering, Fukuoka Institute of Technology, 3-30-1 Wajiro-Higashi, Higashi-ku, Fukuoka, 811-0295 Japan.
Cognitive neurodynamics
|November 17, 2025
概括
这项研究引入了一种新的方法,使用相互信息最小化来诱导人工神经网络中的功能差异化,证明专门的大脑功能在结构变化之前出现.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 信息理论 信息理论
背景情况:
- 大脑功能依赖于专门的区域,这是人工神经网络模拟的过程.
- 了解功能差异化是复杂系统分析的关键.
研究的目的:
- 开发一种用于诱导循环神经网络中的功能差异化的新方法.
- 在网络开发过程中调查功能和结构模块化之间的关系.
主要方法:
- 利用相互信息的神经估计来最大限度地减少神经子组之间的信息.
- 将该方法应用于工作记忆和混乱信号分离任务.
- 分析了网络性能,相关性模式和突触重量矩阵.
主要成果:
- 相互信息最小化导致了高任务性能和明确的功能模块化.
- 功能差异化早于结构模块化出现.
- 结果表明,功能专业化驱动结构重组.
结论:
- 信息理论原则可能会支配专门功能和模块化结构的出现.
- 在神经网络的发展过程中,功能差异化先于结构变化.
- 拟议的方法提供了对人工和生物大脑发育的见解.
相关概念视频
Neural Circuits
2.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
2.6K
Neural Regulation
43.1K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
43.1K
Functional Brain Systems: Reticular Formation
4.2K
The reticular formation is a complex network of gray and white matter located within the brainstem extending from the medulla to the midbrain.
Within the reticular formation, there are several distinct nuclei that can be classified into three broad categories. The Raphe nuclei are located along the midline of the brainstem. They are primarily known for their role in synthesizing and releasing serotonin, a neurotransmitter involved in regulating mood, appetite, sleep, and circadian rhythms. The...
Within the reticular formation, there are several distinct nuclei that can be classified into three broad categories. The Raphe nuclei are located along the midline of the brainstem. They are primarily known for their role in synthesizing and releasing serotonin, a neurotransmitter involved in regulating mood, appetite, sleep, and circadian rhythms. The...
4.2K

