Cooperative coding of continuous variables in networks with sparsity constraint

  • 0Institute for Genetics, University of Bonn, Bonn, Germany.

|

|

Summary

This summary is machine-generated.

Neurons in biological and artificial neural networks cooperate by sharing computations, optimizing synapse count and improving response speed. This cooperative coding scheme explains the brain

Area Of Science

  • Computational neuroscience
  • Neural network modeling
  • Systems neuroscience

Background

  • Neural networks exhibit overlapping neuronal responses to sensory inputs.
  • Cortical networks feature recurrent excitation among neurons with similar tuning.
  • The functional advantage of this connectivity pattern remains unclear.

Purpose Of The Study

  • To investigate the emergence and benefits of recurrent excitation in neural networks.
  • To elucidate the role of cooperative coding in neural architecture.
  • To understand the constraints driving neural network design.

Main Methods

  • Development of an analytically tractable neural network model.
  • Simulation of spiking neural networks.
  • Analysis of synaptic optimization and response dynamics.

Main Results

  • A cooperative coding scheme naturally explains the observed connectivity patterns.
  • Neurons share computations, enabling broad input response with fewer connections.
  • This scheme optimizes synapse count, with savings increasing with encoded variable dimensionality.
  • A trade-off exists between synaptic savings and response speed.

Conclusions

  • Cooperative coding provides a functional explanation for recurrent excitation in neural networks.
  • Synaptic efficiency is a key evolutionary constraint in biological neural networks.
  • Network architecture can be optimized for speed through specific timing of neural currents.

Related Concept Videos

Multi-input and Multi-variable systems 01:22

152

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...

Sequence Networks of Rotating Machines 01:24

148

A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...

Coefficient of Correlation 01:12

6.4K

The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable x and the dependent variable y.
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...

Network Function of a Circuit 01:25

392

Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.

Here, zeros are roots...

Residuals and Least-Squares Property 01:11

7.9K

The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...

Sampling Continuous Time Signal 01:11

357

In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...