Operator-valued free probability applied to recurrent neural networks with heterogeneity in local and global circuit structures
Related Experiment Videos
Abstract:
Random connectivity is a common assumption in models of recurrent neural networks, yet biological circuits combine heterogeneous synaptic connections with organization into distinct anatomical regions and functional groups. How does this global structure interact with cellular and local circuit heterogeneity to shape the dimensionality of population activity? In our work, we use operator-valued free probability to derive the covariance spectrum and effective dimension of recurrent networks with heterogeneous gains and block-structured random connectivity. This framework handles the noncommuting matrix operations through which cellular and circuit heterogeneity jointly determine population variability. We show that the linear relationship between effective dimension and firing rate uniformity persists despite global connectivity structure. At fixed total connectivity variance and with identical firing rate distributions across areas, concentrating variance within one area decreases dimension, whereas concentrating it in directed connections between areas increases dimension. Together, these results establish a mechanistic connection between circuit organization and population dimensionality, and demonstrate how operator-valued free probability unifies cellular, local, and global sources of heterogeneity in recurrent networks.
Related Concept Videos
Neural Circuits
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Network Function of a Circuit
Propagation of Uncertainty from Random Error
Propagation of Action Potentials
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Random Variables
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Neural Regulation