Shaping Dynamics With Multiple Populations in Low-Rank Recurrent Networks
Manuel Beiran1, Alexis Dubreuil2, Adrian Valente3
1Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France manuel.beiran@ens.fr.
Neural Computation
|September 8, 2021
Summary
Neural network dynamics can be modeled as low-dimensional systems. Network connectivity shapes these dynamics, with rank determining dimensionality and population structure influencing behavior.
Area of Science:
- Computational neuroscience
- Dynamical systems theory
Background:
- Emerging paradigm views neural computation through collective neural activity dynamics.
- Understanding how network connectivity shapes these emergent dynamical systems is crucial.
Purpose of the Study:
- To investigate the relationship between network connectivity and emergent dynamical systems.
- To introduce and analyze a novel class of recurrent neural network models.
Main Methods:
- Utilized Gaussian-mixture, low-rank recurrent networks.
- Treated network connectivity rank and population number as independent hyperparameters.
- Analyzed the resulting collective dynamics.
Main Results:
- Demonstrated that collective dynamics form a dynamical system where rank dictates dimensionality.
- Showed that population structure shapes the emergent dynamics.
- Established that a rank R network can approximate any R-dimensional dynamical system if the number of populations is sufficient.
Conclusions:
- Network connectivity, specifically rank and population structure, fundamentally determines emergent neural dynamics.
- Low-rank recurrent networks provide a framework for understanding neural computations as dynamical systems.
- The dimensionality of neural activity is governed by network rank, while population structure refines dynamic behavior.
Related Concept Videos
Multi-input and Multi-variable systems
203
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
203
Sequence Networks of Rotating Machines
177
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
177
Role of Shaping in Operant Conditioning
561
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
561
Analysis of Population Pharmacokinetic Data
455
Analysis of population pharmacokinetic data involves studying the behavior of drugs within diverse populations to understand their pharmacokinetic parameters. Traditional pharmacokinetic methods typically involve collecting samples from a few individuals and estimating these parameters. While these methods are commonly used, they have limitations in capturing the variability in drug response among individuals or heterogeneous populations. Population pharmacokinetics is employed to address these...
455
Neural Circuits
1.9K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.9K
What are Populations and Communities?
35.4K
Overview
35.4K


