Nonequilibrium Statistical Mechanics of Continuous Attractors

Weishun Zhong1, Zhiyue Lu2, David J Schwab3

  • 1James Franck Institute, University of Chicago, Chicago, IL 60637, and Department of Physics, MIT, Cambridge, MA 02139, U.S.A. wszhong@mit.edu.

Neural Computation
|April 29, 2020
PubMed
Summary

Neural networks with continuous attractors can rapidly update internal representations. This study reveals fundamental limits on updating speed and derives a memory capacity for place cell networks.

Related Concept Videos

Second Law of Thermodynamics02:49

Second Law of Thermodynamics

In the quest to identify a property that may reliably predict the spontaneity of a process, a promising candidate has been identified: entropy. Processes that involve an increase in entropy of the system (ΔS > 0) are very often spontaneous; however, examples to the contrary are plentiful. By expanding consideration of entropy changes to include the surroundings, a significant conclusion regarding the relation between this property and spontaneity may be reached. In thermodynamic models, the...
26.4K
Second Law of Thermodynamics00:53

Second Law of Thermodynamics

The Second Law of Thermodynamics states that entropy, or the amount of disorder in a system, increases each time energy is transferred or transformed. Each energy transfer results in a certain amount of energy that is lost—usually in the form of heat—that increases the disorder of the surroundings. This can also be demonstrated in a classic food web. Herbivores harvest chemical energy from plants and release heat and carbon dioxide into the environment. Carnivores harvest the...
66.9K
Entropy02:39

Entropy

Salt particles that have dissolved in water never spontaneously come back together in solution to reform solid particles. Moreover, a gas that has expanded in a vacuum remains dispersed and never spontaneously reassembles. The unidirectional nature of these phenomena is the result of a thermodynamic state function called entropy (S). Entropy is the measure of the extent to which the energy is dispersed throughout a system, or in other words, it is proportional to the degree of disorder of a...
34.6K
Entropy01:18

Entropy

The first law of thermodynamics is quantitatively formulated via an equation relating the internal energy of a system, the heat exchanged by it, and the work done on it. A quantitative formulation of the second law of thermodynamics leads to defining a state function, the entropy.
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
3.4K
Energy Diagrams - II01:10

Energy Diagrams - II

Energy diagrams are important to understand the dynamics of a system. The topology of an energy diagram helps illustrate the equilibrium points of the system.
The point in the energy diagram at which the system’s potential energy is the lowest is known as the local minima. The system tends to stay in this position indefinitely unless acted upon by a net force. The slope of the potential energy diagram at the local minima is zero, indicating that zero net force is acting on the system. The...
11.6K
Stability of Equilibrium Configuration01:23

Stability of Equilibrium Configuration

Understanding the stability of equilibrium configurations is a fundamental part of mechanical engineering. In any system, there are three distinct types of equilibrium: stable, neutral, and unstable.
A stable equilibrium occurs when a system tends to return to its original position when given a small displacement, and the potential energy is at its minimum. An example of a stable equilibrium is when a cantilever beam is fixed at one end and a weight is attached to the other end. If the weight...
707