Natural language syntax complies with the free-energy principle

Elliot Murphy1,2, Emma Holmes3,4, Karl Friston4

  • 1Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030 USA.

Synthese
|May 6, 2024
PubMed
Summary

This study connects natural language syntax to the free-energy principle (FEP) through active inference. It proposes Turing-Chomsky Compression (TCC) to explain efficient syntactic computation as a form of self-organization.

Related Concept Videos

Gibbs Free Energy02:39

Gibbs Free Energy

One of the challenges of using the second law of thermodynamics to determine if a process is spontaneous is that it requires measurements of the entropy change for the system and the entropy change for the surroundings. An alternative approach involving a new thermodynamic property defined in terms of system properties only was introduced in the late nineteenth century by American mathematician Josiah Willard Gibbs. This new property is called the Gibbs free energy (G) (or simply the free...
33.3K
Free Energy Changes for Nonstandard States03:25

Free Energy Changes for Nonstandard States

The free energy change for a process taking place with reactants and products present under nonstandard conditions (pressures other than 1 bar; concentrations other than 1 M) is related to the standard free energy change according to this equation:
 
where R is the gas constant (8.314 J/K·mol), T is the absolute temperature in kelvin, and Q is the reaction quotient. This equation may be used to predict the spontaneity of a process under any given set of conditions.
Reaction Quotient...
11.4K
Free Energy01:21

Free Energy

Free energy—abbreviated as G for the scientist Gibbs who discovered it—is a measurement of useful energy that can be extracted from a reaction to do work. It is the energy in a chemical reaction that is available after entropy is accounted for. Reactions that take in energy are considered endergonic and reactions that release energy are exergonic. Plants carry out endergonic reactions by taking in sunlight and carbon dioxide to produce glucose and oxygen. Animals, in turn, break...
48.0K
An Introduction to Free Energy01:05

An Introduction to Free Energy

How can we compare the energy that releases from one reaction to that of another reaction? We use a measurement of free energy to quantitate these energy transfers. Scientists call this free energy Gibbs free energy (abbreviated with the letter G) after Josiah Willard Gibbs, the scientist who developed the measurement. According to the second law of thermodynamics, all energy transfers involve losing some energy in an unusable form such as heat, resulting in entropy. Gibbs free energy...
8.4K
Gibbs Free Energy and Thermodynamic Favorability02:23

Gibbs Free Energy and Thermodynamic Favorability

The spontaneity of a process depends upon the temperature of the system. Phase transitions, for example, will proceed spontaneously in one direction or the other depending upon the temperature of the substance in question. Likewise, some chemical reactions can also exhibit temperature-dependent spontaneities. To illustrate this concept, the equation relating free energy change to the enthalpy and entropy changes for the process is considered:
6.8K
Free Energy and Equilibrium00:55

Free Energy and Equilibrium

The free energy change for a process may be viewed as a measure of its driving force. A negative value for ΔG represents a driving force for the process in the forward direction, while a positive value represents a driving force for the process in the reverse direction. When ΔG is zero, the forward and reverse driving forces are equal, and the process occurs in both directions at the same rate (the system is at equilibrium).
The reaction quotient, Q, is a convenient measure of the...
6.2K