Stabilizing Rayleigh–Bénard convection with reinforcement learning trained on a reduced-order model

Qiwei Chen and C. Ricardo Constante-Amores · 2025

Read Stabilizing Rayleigh–Bénard convection with reinforcement learning trained on a reduced-order model by Qiwei Chen and C. Ricardo Constante-Amores (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-26705.txt.

Description

Qiwei Chen and C Ricardo Constante-Amores tame a classic turbulent flow with a learning controller. Rayleigh-Bénard convection is what happens when a fluid is heated from below: warm plumes rise, cool fluid sinks, and heat transport turns turbulent. At high Rayleigh numbers, which measure how hard the flow is driven, direct simulations are too costly for control design.

Chen and Constante-Amores first compress the flow into a low-dimensional model, using standard mode extraction plus autoencoders, then learn its evolution with neural differential equations. A reinforcement learning policy trained on that cheap model was deployed in full simulations. It cut the Nusselt number, a measure of heat transport, by sixteen to twenty-three percent. The policy thickens the thermal boundary layer and damps the bursts that seed convection.

Catalog record

CREATORQiwei Chen and C. Ricardo Constante-Amores
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-26705

Browse the full library · About the Tower of Babel