Personalised Insulin Adjustment with Reinforcement Learning: An In-Silico Validation for People with Diabetes on Intensive Insulin Treatment
MARIA PANAGIOTOU 1,2, Lorenzo Brigato 1, Vivien Streit 3, Amanda Hayoz 3, Stephan Proennecke 3, Stavros Athanasopoulos 4, Mikkel T. Olsen 5, Elizabeth J. den Brok 6, Cecilie H. Svensson 5, Konstantinos Makrilakis 4, Maria Xatzipsalti 7, Andriani Vazeou 7, Peter R. Mertens 8, Ulrik Pedersen-Bjergaard · 2025
Read Personalised Insulin Adjustment with Reinforcement Learning: An In-Silico Validation for People with Diabetes on Intensive Insulin Treatment by MARIA PANAGIOTOU 1,2, Lorenzo Brigato 1, Vivien Streit 3, Amanda Hayoz 3, Stephan Proennecke 3, Stavros Athanasopoulos 4, Mikkel T. Olsen 5, Elizabeth J. den Brok 6, Cecilie H. Svensson 5, Konstantinos Makrilakis 4, Maria Xatzipsalti 7, Andriani Vazeou 7, Peter R. Mertens 8, Ulrik Pedersen-Bjergaard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14477.txt.
Introduction
Maria Panagiotou and a large team of co-authors wrote a 2025 paper on a reinforcement learning advisor for insulin dosing. People on intensive insulin therapy must tune basal and meal doses day after day, and most still struggle to keep glucose in range. Their advisor, ABBA, learns a personal policy for each patient.
The team tested ABBA in simulation only, using an accepted virtual population of 101 adults with type 1 diabetes and 101 with type 2. Each virtual patient self monitored blood glucose and used multiple daily injections. ABBA's time in range was compared against a standard basal bolus advisor. The in silico design lets the team stress test personalization safely before any clinical trial. Strong simulated gains would justify moving toward real world studies.
Catalog record
| CREATOR | MARIA PANAGIOTOU 1,2, Lorenzo Brigato 1, Vivien Streit 3, Amanda Hayoz 3, Stephan Proennecke 3, Stavros Athanasopoulos 4, Mikkel T. Olsen 5, Elizabeth J. den Brok 6, Cecilie H. Svensson 5, Konstantinos Makrilakis 4, Maria Xatzipsalti 7, Andriani Vazeou 7, Peter R. Mertens 8, Ulrik Pedersen-Bjergaard |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14477
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Personalised Insulin Adjustment with Reinforcement Learning: An In-Silico Validation for People with Diabetes on Intensive Insulin Treatment MARIA PANAGIOTOU 1,2, Lorenzo Brigato 1, Vivien Streit 3, Amanda Hayoz 3, Stephan Proennecke 3, Stavros Athanasopoulos 4, Mikkel T. Olsen 5, Elizabeth J. den Brok 6, Cecilie H. Svensson 5, Konstantinos Makrilakis 4, Maria Xatzipsalti 7, Andriani Vazeou 7, Peter R. Mertens 8, Ulrik Pedersen-Bjergaard 5,9, Bastiaan E. de Galan 6,10,11, Stavroula Mougiakakou 1, on behalf of the MELISSA consortium Abstract Despite recent advances in insulin preparations and technology, adjusting insulin remains an ongoing challenge for the majority of people with type 1 diabetes (T1D) and longstanding type 2 diabetes (T2D). In this study, we propose the Adaptive Basal-Bolus Advisor (ABBA), a personalised insulin treatment recommendation approach based on reinforcement learning for individuals with T1D and T2D, performing self-monitoring blood glucose measurements and multiple daily insulin injection therapy. We developed and evaluated the ability of ABBA to achieve better time-in-range (TIR) for individuals with T1D and T2D, compared to a standard basal-bolus advisor (BBA). The in-silico test was performed using an FDA-accepted population, including 101 simulated adults with T1D and 101 with T2D. An in-silico evaluation shows that ABBA significantly improved TIR and significantly reduced both times below- and above-range, compared to BBA. ABBA’s performance continued to improve over two months, whereas BBA exhibited only modest changes. This personalised method for adjusting insulin has the potential to further optimise glycaemic control and support people with T1D and T2D in their daily self-management. Our results warrant ABBA to be trialed for the first time in humans. \definecolor bostonuniversityredrgb0.7, 0.0, 0.0 \definecolor commentsRGB0,0,150 \definecolor graycmyk0,0,0,.8 † † history: Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000. † † doi: 10.1109/ACCESS.2024.0429000 † † address: ARTORG Center, University of Bern, Bern, Switzerland † † address: Graduate School for Cellular and Biomedical Sciences, University of Bern, Switzerland † † address: Debiotech SA, Lausanne, Switzerland † † address: Diabetes Center, National and Kapodistrian University of Athens, Athens, Greece † † address: Department of Endocrinology and Nephrology, Nordsjællands Hospital, Hillerød, Denmark † † address: CARIM School for Cardiovascular Diseases, Maastricht University, Maastricht, The Netherlands † † address: P & A Kyriakou’ Children’s Hospital, Athens, Greece † † address: Department of Kidney and Hypertension Diseases, Diabetology and Endocrinology, Otto-Von-Guericke-Univeristat Magdeburg, Magdeburg, Germany † † address: Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark † † address: Department of Internal Medicine, Maastricht University Medical Centre+, Maastricht, The Netherlands † † address: Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands † † titlenote: This work has been funded by the European Commission and the Swiss Confederation-State Secretariat for Education, Research and Innovation (SERI) within the project 101057730 Mobile Artificial Intelligence Solution for Diabetes Adaptive Care (MELISSA) † † corresponding: Corresponding author: Stavroula Mougiakakou (e-mail: [email protected]). I Introduction Management of type 1 diabetes (T1D) or type 2 diabetes (T2D) in the insulin-deficient state with therapeutic insulin aims to mimic normal physiology. For people with diabetes on multiple daily injection (MDI) insulin therapy, this requires the combination of a long-acting insulin (analogue) to cover the continuous (i.e. basal) release of insulin in fasting states with short-acting insulin (i.e. bolus/prandial insulin) to mimic the release of insulin in response to meals and elevated glucose levels. Self-monitoring of blood glucose (SMBG) as well as estimating carbohydrate (CHO) content of meals are, among other parameters, pivotal in fine-tuning the doses (both basal and prandial) of insulin. Recent technological advances, including continuous glucose monitoring (CGM), insulin pumps, and (hybrid) closed-loop insulin delivery systems, can potentially alleviate the burden of daily diabetes management. Hybrid closed-loop systems, such as Tandem Control-IQ [ 4 ] , CamAPS FX [ 27 ] , Omnipod 5 [ 2 ] , Medtronic MiniMed™ 780G [ 35 ] , have demonstrated significant improvements in various aspects of glycaemic control, including time-in-range, reduction of hypoglycaemia, and HbA1c reduction for adults, children, and young people with type 1 diabetes [ 20 , 12 , 32 ] . Importantly, hybrid closed-loop systems effectively manage both intra- and inter-individual variability through feedback control mechanisms that adjust insulin delivery in response to glucose fluctuations, parametrisation options like customisable basal profiles, carbohydrate ratios, insulin sensitivity factors, and target glucose levels. For example, the Medtronic MiniMed™ 780G allows personalised glucose targets and delivers automatic basal insulin and correction boluses every 5 minutes, providing greater customisation in insulin therapy and accommodating daily glucose variability without user intervention [ 35 ] . The Tandem Control-IQ predicts glucose levels 30 minutes ahead and adjusts insulin delivery accordingly, with dedicated sleep and exercise modes [ 4 ] . Additionally, the Omnipod 5 system uses a total daily insulin (TDI) delivery strategy for insulin automation, offering adjustable glucose targets for different times of the day. It also includes an automated Mode with a static basal rate that does not adjust based on CGM values and an activity Mode, which can be set for 1 to 24 hours with a glucose target of 150 mg/dL and reduced insulin delivery [ 2 ] . CamAPS FX employs an adaptive model predictive control algorithm to adjust insulin infusion every 8–12 minutes, optimising dosing based on glucose trends. The algorithm, initialised using participant weight and TDI dose, gradually adapts based on glucose patterns and insulin action duration to enhance compatibility with faster-acting insulins [ 27 ] . Building on these advancements in hybrid closed-loop systems, recent research has explored the potential of reinforcement learning (RL), a subset of artificial intelligence (AI), to further enhance personalised insulin delivery for people with T1D. RL-based approaches have been proposed within both fully closed-loop [ 15 , 13 , 23 ] and hybrid closed-loop systems [ 16 , 41 , 42 , 36 ] . Pioneering work by Daskalaki et al. [ 8 ] proposed an actor-critic (AC) method initialised with information transferred from insulin to glucose signals. Sun et al. [ 36 ] extended and further validated this algorithm, while with the same algorithmic approach, the authors introduced the use of SMBG measurements and MDI therapy instead of CGM data and pump therapy [ 37 ] . More recently, studies have increasingly integrated CGMs into advanced algorithms for managing T1D. For instance, a modular deep RL algorithm based on the proximal policy optimisation algorithm was designed to fully automate glucose control, utilising CGMs [ 15 ] . Similarly, Zhu et al. [ 41 ] developed a deep-Q learning agent (DQN) to predict basal insulin values and a deep deterministic policy gradient AC model for insulin bolus control, both supported by CGMs [ 42 ] . Another study by Jafar et al. [ 16 ] proposed a Q-learning approach to adaptively optimise CHO ratios and basal rates, leveraging CGMs for continuous feedback. Fox et al. [ 13 ] employed the soft AC algorithm to develop glucose control policies for closed-loop blood glucose control, with CGMs. Furthermore, recent work combined evolutionary, DQN, AC, and uncertainty estimation algorithms to adjust insulin sensitivity and carbohydrate-to-insulin ratios for meal boluses and reference basal rates in pump therapy and insulin pen usage, all facilitated by the continuous data from CGMs [ 23 ] . In