Guardian-regularized Safe Offline Reinforcement Learning for Smart Weaning of Mechanical Circulatory Devices These authors contributed equally

Aysin Tumay, Sophia Sun, Sonia Fereidooni, Aaron Dumas, Elise Jortberg, Rose Yu · 2025

Read Guardian-regularized Safe Offline Reinforcement Learning for Smart Weaning of Mechanical Circulatory Devices These authors contributed equally by Aysin Tumay, Sophia Sun, Sonia Fereidooni, Aaron Dumas, Elise Jortberg, Rose Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06111.txt.

Description

Aysin Tumay and co-authors teach an algorithm to wean heart-failure patients off mechanical blood pumps safely, using only past records. These pumps unload the left ventricle in cardiogenic shock, but weaning practice varies by care team and lacks data-driven rules. Learning from live patient interaction is not allowed, so the training must be offline.

Their framework pairs a new offline learning algorithm with a transformer-based digital twin of the circulation. The algorithm suppresses out-of-distribution actions and shapes rewards with clinical knowledge. The twin evaluates policies on rich physiological and clinical metrics. Theory backs the algorithm under mild assumptions. On real and synthetic data it beat standard offline baselines on reward and on clinical scores by wide margins.

Catalog record

CREATORAysin Tumay, Sophia Sun, Sonia Fereidooni, Aaron Dumas, Elise Jortberg, Rose Yu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06111

Browse the full library · About the Tower of Babel