Related Experiment Video
Updated: Nov 19, 2025

An Analog Macroscopic Technique for Studying Molecular Hydrodynamic Processes in Dense Gases and Liquids
Published on: December 4, 2017
Reinforcement Learning Approach to Nonequilibrium Quantum Thermodynamics.
Pierpaolo Sgroi1,2, G Massimo Palma1,3, Mauro Paternostro2
1Dipartimento di Fisica e Chimica-Emilio Segré, Università degli Studi di Palermo, via Archirafi 36, I-90123 Palermo, Italy.
This study introduces a reinforcement learning method to minimize entropy production in quantum systems. The approach is experimentally simple and effective for controlling nonequilibrium quantum thermodynamics.
Area of Science:
- Quantum Thermodynamics
- Statistical Mechanics
- Control Theory
Background:
- Controlling quantum systems far from equilibrium is challenging.
- Entropy production quantifies thermodynamic irreversibility.
- Minimizing entropy production is key for efficient quantum processes.
Purpose of the Study:
- To develop an experimentally accessible method for reducing entropy production in closed quantum systems.
- To control nonequilibrium quantum thermodynamics using reinforcement learning.
Main Methods:
- Utilized a reinforcement learning approach with a policy gradient technique.
- Employed an external control Hamiltonian to guide system evolution.
- The method is independent of specific irreversibility measures and system dynamics knowledge.
Main Results:
- Successfully reduced entropy production in single- and two-particle quantum systems.
- Demonstrated an experimentally nondemanding approach to controlling quantum thermodynamics.
- The method does not require tracking the quantum state during evolution.
Conclusions:
- Reinforcement learning offers a powerful and practical tool for controlling quantum thermodynamics.
- The proposed method provides a robust strategy for minimizing irreversibility in driven quantum systems.
Related Concept Videos
First Law Of Thermodynamics: Problem-Solving
The following strategies can be used to solve any problem involving the first law of thermodynamics.
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...
Second Law of Thermodynamics
Second Law of Thermodynamics
Thermodynamic Systems
Consider an example of tea boiling in a kettle. The...
Zeroth Law of Thermodynamics

