Related Experiment Video
Updated: Apr 27, 2026

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
Transfer entropy and transient limits of computation.
Mikhail Prokopenko1, Joseph T Lizier2
11] CSIRO Computational Informatics, PO Box 76, Epping, NSW 1710, Australia [2] Department of Computing, Macquarie University, E6A Level 3, Eastern Rd, Macquarie Park, NSW 2113, Australia [3] School of Physics, University of Sydney, Physics Rd, Camperdown NSW 2050, Australia.
Increasing transfer entropy (predictability) requires heat flow matching Landauer's limit. This study generalizes this thermodynamic limit to bidirectional information dynamics, connecting information theory and computation.
Area of Science:
- Thermodynamics
- Information Theory
- Computational Theory
Background:
- Transfer entropy quantifies directed statistical coherence in spatiotemporal processes.
- Its relationship to fundamental computational limits like Landauer's limit was previously unknown.
Purpose of the Study:
- To investigate the connection between transfer entropy and thermodynamic limits of computation.
- To generalize Landauer's limit for non-equilibrium, bidirectional information dynamics.
Main Methods:
- Theoretical analysis of information-theoretic measures and thermodynamic principles.
- Generalization of Landauer's principle to information prediction.
Main Results:
- Increasing transfer entropy by one bit necessitates heat flow at or above Landauer's limit.
- Landauer's limit is extended to cover prediction in non-equilibrium processes.
- Connections established with negentropy, Bremermann's limit, and Bekenstein bound.
Conclusions:
- New computational limits are defined using fundamental physical quantities.
- Transfer entropy is established as a key measure linking information theory, thermodynamics, and computation.
More Related Videos
05:39Scalable Quantum Integrated Circuits on Superconducting Two-Dimensional Electron Gas Platform
Published on: August 2, 2019
09:23Quantification of Information Encoded by Gene Expression Levels During Lifespan Modulation Under Broad-range Dietary Restriction in C. elegans
Published on: August 16, 2017
Related Concept Videos
The Entropy as a State Function
Entropy
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
Entropy
Entropy Change in Reversible Processes
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
The Squeeze Theorem
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...