Deep Reinforcement Learning-Based Intelligent Water Level Control: From Simulation to Embedded Implementation

Kevin Cusihuallpa-Huamanttupa, Erwin J. Sacoto-Cabrera, Roger Jesus Coaquira-Castillo, L. Walter Utrilla Mego, Julio Cesar Herrera-Levano, Yesenia Concha-Ramos, Edison Moreno-Cardenas · 2025

Read Deep Reinforcement Learning-Based Intelligent Water Level Control: From Simulation to Embedded Implementation by Kevin Cusihuallpa-Huamanttupa, Erwin J. Sacoto-Cabrera, Roger Jesus Coaquira-Castillo, L. Walter Utrilla Mego, Julio Cesar Herrera-Levano, Yesenia Concha-Ramos, Edison Moreno-Cardenas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12788365.txt.

Description

Kevin Cusihuallpa-Huamanttupa and co-authors put a learning-based controller in charge of a water tank's level, and then shrink it onto cheap hardware. They first trained a deep reinforcement learning method, DDPG, in a MATLAB simulation, where paired networks learned a control policy that copes with shifting, nonlinear behavior. The trained policy then moved onto an Arduino Uno board for live tests.

On the real rig, the controller held the level within 0.05 centimeters of target at steady state, with a sixteen percent overshoot. It beat a standard PID controller by about a fifth on tracking accuracy. It also adapted when the setup was disturbed. The authors say the design fits low-cost connected water systems, from smart farms to spread-out sensor networks, and claim its novelty lies in running deep learning control on such a small device.

Catalog record

CREATORKevin Cusihuallpa-Huamanttupa, Erwin J. Sacoto-Cabrera, Roger Jesus Coaquira-Castillo, L. Walter Utrilla Mego, Julio Cesar Herrera-Levano, Yesenia Concha-Ramos, Edison Moreno-Cardenas
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12788365

Browse the full library · About the Tower of Babel