灵活的任务抽象在线性网络中出现,具有快速和有限的单位
Kai Sandbrink1, Jan P Bauer2, Alexandra M Proca3
1Exp. Psychology, Oxford Brain Mind Institute, EPFL.
ArXiv
|January 29, 2025
概括
神经网络可以通过共同优化权重和门来学习像动物一样的认知灵活性. 这使他们能够通过在学习任务抽象之间切换而适应不断变化的环境,而不会忘记过去的信息.
科学领域:
- 计算神经科学是一种计算神经科学.
- 机器学习 机器学习
- 认知科学是一种认知科学.
背景情况:
- 动物通过将经验分成任务和使用内部任务抽象来适应动态环境.
- 神经网络与数据分布的转变作斗争,通常需要缓慢的参数变化,导致遗忘.
- 在生物和人工系统中,灵活的任务抽象背后的神经机制仍然不清楚.
研究的目的:
- 通过对权重和门的联合优化,研究神经系统中如何出现灵活的任务抽象.
- 在生物学上可信的约束下分析一个封闭神经网络的学习动态和新兴特性.
主要方法:
- 对线性网关网络的分析,对网关有神经元类约束 (更快的时间尺度,非负面性,受限活动).
- 通过梯度下降通过重量和门的联合优化.
- 将学习动态的分析性缩减为有效的自身空间.
主要成果:
- 重量自我组织成任务专业化模块,而门则形成了切换这些模块 (任务抽象) 的表示.
- 确定了一个良性循环:快速适应的门保护了知识,使重量专业化成为可能,这反过来又加速了门的更新.
- 随着课程块大小和培训,任务切换加速,与认知神经科学发现一致.
- 发现的任务抽象支持通过构成性进行概括.
- 结果扩展到非线性网络.
结论:
- 在突触和神经门上的联合梯度下降为动物的认知灵活性提供了理论框架.
- 这种架构允许对不断变化的环境做出适应性反应,而不会造成灾难性的遗忘.
- 该模型展示了神经系统如何学习和灵活利用任务抽象.
更多相关视频
08:00DNA Nanotubes as a Versatile Tool to Study Semiflexible Polymers
Published on: October 25, 2017
6.8K
09:01A Method for Investigating Age-related Differences in the Functional Connectivity of Cognitive Control Networks Associated with Dimensional Change Card Sort Performance
Published on: May 7, 2014
10.1K
相关概念视频
01:24Sequence Networks of Rotating Machines
91
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
91
01:21Linear Approximation in Time Domain
60
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
60
01:17Linear Circuits
380
A linear circuit is characterized by its output having a direct proportionality to its input, adhering to the linearity property, which encompasses the principles of homogeneity (scaling) and additivity. Homogeneity dictates that when the input, also referred to as the excitation, is multiplied by a constant factor, the output, known as the response, is correspondingly scaled by the same constant factor. For instance, if the current is multiplied by a constant 'k,' the voltage likewise...
380
01:21Distributed Loads: Problem Solving
621
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
621
01:28Cable Subjected to Concentrated Loads
790
Flexible cables are commonly used in various applications for support and load transmission. Consider a cable fixed at two points and subjected to multiple vertically concentrated loads. Determine the shape of the cable and the tension in each portion of the cable, given the horizontal distances between the loads and supports.
790
01:24Fast Decoupled and DC Powerflow
164
The fast decoupled power flow method addresses contingencies in power system operations, such as generator outages or transmission line failures. This method provides quick power flow solutions, essential for real-time system adjustments. Fast decoupled power flow algorithms simplify the Jacobian matrix by neglecting certain elements, leading to two sets of decoupled equations:
164