Reinforcement learning approach to shortcuts between thermodynamic states with minimum entropy production

Rongxing Xu1

  • 1Department of Physics, Keio University, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama 223-8522, Japan Mathematical Science Team, RIKEN Center for Advanced Inelligence Project (AIP), 1-4-1 Nihonbashi, Chuo-Ku, Tokyo 103-0027, Japan.

Physical Review. E
|June 16, 2022
PubMed

Related Concept Videos

Entropy01:18

Entropy

The first law of thermodynamics is quantitatively formulated via an equation relating the internal energy of a system, the heat exchanged by it, and the work done on it. A quantitative formulation of the second law of thermodynamics leads to defining a state function, the entropy.
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
2.8K
Entropy Change in Reversible Processes01:10

Entropy Change in Reversible Processes

In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
2.7K
Path Between Thermodynamics States01:21

Path Between Thermodynamics States

Consider the two thermodynamic processes involving an ideal gas that are represented by paths AC and ABC in Figure 1:
3.3K
The Carnot Cycle and the Second Law of Thermodynamics01:20

The Carnot Cycle and the Second Law of Thermodynamics

The Carnot engine works between two heat reservoirs of fixed temperatures. The Carnot cycle begs the following question: Is it possible to devise a heat engine that is more efficient than a Carnot engine between two fixed temperatures? The answer lies in designing a Carnot refrigerator.
Since the individual steps in a Carnot cycle can be reversed, the entire cycle is, thus, reversible. If a Carnot cycle is reversed, it becomes a Carnot refrigerator. It extracts heat Qc from a cold reservoir at...
2.8K
Gibbs Free Energy02:39

Gibbs Free Energy

One of the challenges of using the second law of thermodynamics to determine if a process is spontaneous is that it requires measurements of the entropy change for the system and the entropy change for the surroundings. An alternative approach involving a new thermodynamic property defined in terms of system properties only was introduced in the late nineteenth century by American mathematician Josiah Willard Gibbs. This new property is called the Gibbs free energy (G) (or simply the free...
34.0K
The Carnot Cycle01:30

The Carnot Cycle

Converting work to heat is an irreversible process, and the purpose of a heat engine is to reverse the effect partially. Heat engines aim to increase the efficiency of the reversal, that is, maximize the work retrieved from heat. If the efficiency of a heat engine were 100%, it would imply reversing the process completely without introducing any other effect. Thus, it would violate the second law of thermodynamics.
What could be the theoretical limit to the efficiency of a heat engine? The...
3.1K