Related Experiment Video
Updated: Jun 27, 2025

Functional Complementation Analysis FCA: A Laboratory Exercise Designed and Implemented to Supplement the Teaching of Biochemical Pathways
Published on: June 24, 2016
Natural language syntax complies with the free-energy principle
Elliot Murphy1,2, Emma Holmes3,4, Karl Friston4
1Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030 USA.
Abstract:
Natural language syntax yields an unbounded array of hierarchically structured expressions. We claim that these are used in the service of active inference in accord with the free-energy principle (FEP). While conceptual advances alongside modelling and simulation work have attempted to connect speech segmentation and linguistic communication with the FEP, we extend this program to the underlying computations responsible for generating syntactic objects. We argue that recently proposed principles of economy in language design-such as "minimal search" criteria from theoretical syntax-adhere to the FEP. This affords a greater degree of explanatory power to the FEP-with respect to higher language functions-and offers linguistics a grounding in first principles with respect to computability. While we mostly focus on building new principled conceptual relations between syntax and the FEP, we also show through a sample of preliminary examples how both tree-geometric depth and a Kolmogorov complexity estimate (recruiting a Lempel-Ziv compression algorithm) can be used to accurately predict legal operations on syntactic workspaces, directly in line with formulations of variational free energy minimization. This is used to motivate a general principle of language design that we term Turing-Chomsky Compression (TCC). We use TCC to align concerns of linguists with the normative account of self-organization furnished by the FEP, by marshalling evidence from theoretical linguistics and psycholinguistics to ground core principles of efficient syntactic computation within active inference.
More Related Videos
Related Concept Videos
Gibbs Free Energy
Free Energy Changes for Nonstandard States
where R is the gas constant (8.314 J/K·mol), T is the absolute temperature in kelvin, and Q is the reaction quotient. This equation may be used to predict the spontaneity of a process under any given set of conditions.
Reaction Quotient...
Free Energy
An Introduction to Free Energy
Gibbs Free Energy and Thermodynamic Favorability
Free Energy and Equilibrium
The reaction quotient, Q, is a convenient measure of the...

