Coherent chaos in a recurrent neural network with structured connectivity
Itamar Daniel Landau1, Haim Sompolinsky1,2
1Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel.
Plos Computational Biology
|December 14, 2018
Summary
We developed a new model for recurrent neural networks that generates spatially correlated chaos, mimicking brain activity. This model introduces structured connectivity to achieve coherent fluctuations, unlike previous models.
Area of Science:
- Computational Neuroscience
- Network Dynamics
- Artificial Intelligence
Background:
- Recurrent neural networks (RNNs) with random connectivity exhibit chaotic fluctuations, useful for modeling cortical activity temporal variability.
- However, these networks lack spatial correlation and coherent fluctuations observed in the neocortex across scales.
- Existing models fail to capture the spatially structured, coherent dynamics characteristic of biological neural systems.
Purpose of the Study:
- To introduce a novel RNN model capable of generating coherent, spatially correlated chaotic dynamics.
- To investigate the role of structured connectivity in achieving biologically plausible neural network dynamics.
- To explore different dynamical regimes and their dependence on network parameters and connectivity structure.
Main Methods:
- Introduced a structured connectivity component alongside random connections, creating unidirectional coupling between orthogonal modes.
- Employed a perturbative approach to solve dynamic mean-field equations in the weak structured connectivity regime.
- Analyzed network behavior under a row balance constraint for random connectivity, exploring self-tuned coherent chaos.
Main Results:
- Weak structured connectivity leads to coherent fluctuations passively driven by local chaotic activity.
- Stronger structured connectivity, especially with row balance, induces self-tuned coherent chaos with intermittent, slow, and highly coherent dynamics.
- Network dynamics exhibit dependence on connectivity matrix realization (e.g., complex vs. real leading eigenvalue) and scale with network size.
Conclusions:
- The proposed model successfully generates spatially correlated chaos in RNNs, addressing limitations of purely random networks.
- Structured connectivity is crucial for embedding coherent fluctuations and achieving biologically relevant network dynamics.
- The model provides a framework for understanding how structured connectivity shapes complex neural dynamics, including oscillatory and broken-symmetry chaos.
Related Concept Videos
Protein Networks
4.5K
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
4.5K
Network Covalent Solids
16.2K
Network covalent solids contain a three-dimensional network of covalently bonded atoms as found in the crystal structures of nonmetals like diamond, graphite, silicon, and some covalent compounds, such as silicon dioxide (sand) and silicon carbide (carborundum, the abrasive on sandpaper). Many minerals have networks of covalent bonds.
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
16.2K
Dietary Connections
61.8K
In biological systems, most metabolic pathways are interconnected. The cellular respiration processes that convert glucose to ATP—such as glycolysis, pyruvate oxidation, and the citric acid cycle—tie into those that break down other organic compounds. As a result, various foods—from apples to cheese to guacamole—end up as ATP. In addition to carbohydrates, food also contains proteins and lipids—such as cholesterol and fats. All of these organic compounds are used...
61.8K
Neural Regulation
43.4K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
43.4K
Introduction to Connective Tissues
14.9K
Connective tissues are one of the four main tissue types in humans that are extensively present in the body. They are characterized by cells embedded in an extracellular matrix (ECM) composed of a ground substance and three main types of protein fibers— collagen, elastic, and reticular fibers. The ground substance of connective tissues can range from a watery and jelly-like consistency to mineralized and hard. The wide variety of cells in the connective tissues include fibroblasts,...
14.9K
Classification of Connective Tissues
15.9K
The connective tissues have different properties and functions in the human body. They are broadly categorized into proper, supporting, or fluid connective tissues.
Connective Tissue Proper
Connective tissue proper is the most abundant class of connective tissues. As its name implies, it predominantly connects different tissues in the body. Depending on the cell types, ground substance, viscosity, and fiber types in the ECM, connective tissue proper is further categorized into loose and dense....
Connective Tissue Proper
Connective tissue proper is the most abundant class of connective tissues. As its name implies, it predominantly connects different tissues in the body. Depending on the cell types, ground substance, viscosity, and fiber types in the ECM, connective tissue proper is further categorized into loose and dense....
15.9K


