Guardian-regularized Safe Offline Reinforcement Learning for Smart Weaning of Mechanical Circulatory Devices These authors contributed equally
Aysin Tumay, Sophia Sun, Sonia Fereidooni, Aaron Dumas, Elise Jortberg, Rose Yu · 2025
Read Guardian-regularized Safe Offline Reinforcement Learning for Smart Weaning of Mechanical Circulatory Devices These authors contributed equally by Aysin Tumay, Sophia Sun, Sonia Fereidooni, Aaron Dumas, Elise Jortberg, Rose Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06111.txt.
Description
Aysin Tumay and co-authors teach an algorithm to wean heart-failure patients off mechanical blood pumps safely, using only past records. These pumps unload the left ventricle in cardiogenic shock, but weaning practice varies by care team and lacks data-driven rules. Learning from live patient interaction is not allowed, so the training must be offline.
Their framework pairs a new offline learning algorithm with a transformer-based digital twin of the circulation. The algorithm suppresses out-of-distribution actions and shapes rewards with clinical knowledge. The twin evaluates policies on rich physiological and clinical metrics. Theory backs the algorithm under mild assumptions. On real and synthetic data it beat standard offline baselines on reward and on clinical scores by wide margins.
Catalog record
| CREATOR | Aysin Tumay, Sophia Sun, Sonia Fereidooni, Aaron Dumas, Elise Jortberg, Rose Yu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-06111