Related Experiment Video
Updated: Jan 6, 2026

Evolution of Staircase Structures in Diffusive Convection
Published on: September 5, 2018
Deep reinforcement learning control unlocks enhanced heat transfer in turbulent convection
1Max Planck Institute for Solar System Research, Göttingen 37077, Germany.
None:
Turbulent convection governs heat transport in both natural and industrial settings, yet optimizing it under extreme conditions remains a significant challenge. Traditional control strategies, such as predefined temperature modulation, struggle to achieve substantial enhancement. Here, we introduce a deep reinforcement learning (DRL) framework that autonomously discovers optimal control policies to maximize heat transfer in turbulent Rayleigh-Bénard convection. By dynamically adjusting wall temperature fluctuations, the DRL agent achieves a heat transfer enhancement of up to 38.5%, exceeding the 20 to 25% limit of conventional methods. The learned strategy reveals a nonlinear state-action relationship, inducing a fully modulated boundary layer regime. Furthermore, we distill the DRL insights into a simplified bang-bang control model, which retains comparable performance (up to 40.0% enhancement) and, crucially, generalizes to unseen, higher Rayleigh number cases without additional training. Our results demonstrate the power of machine learning in turbulence control and reveal a framework with potential for intelligent heat transfer optimization in real-world applications.
More Related Videos
10:03Uncoupling Coriolis Force and Rotating Buoyancy Effects on Full-Field Heat Transfer Properties of a Rotating Channel
Published on: October 5, 2018
10:29Experimental Methodology for Estimation of Local Heat Fluxes and Burning Rates in Steady Laminar Boundary Layer Diffusion Flames
Published on: June 1, 2016
Related Concept Videos
Mechanisms of Heat Transfer II
Reynolds Transport Theorem
Mechanisms of Heat Transfer I
Mechanisms of Heat Transfer
Conduction, accounting for approximately 3% of body heat loss at rest, is the process of exchanging heat between molecules of two materials in direct contact. This can result in both heat loss and gain. For instance, when the body is submerged in water, which conducts heat 20 times more effectively than air, it can either lose or gain significant...
Mechanism of heat transfer
Control Volume and System Representations
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...