Optimal Control for Remote Patient Monitoring with Multidimensional Health States

Siddharth Chandak, Isha Thapa, Nicholas Bambos, David Scheinker, {chandaks, ishadt, bambos, dscheink}@stanford.edu · 2025

Read Optimal Control for Remote Patient Monitoring with Multidimensional Health States by Siddharth Chandak, Isha Thapa, Nicholas Bambos, David Scheinker, {chandaks, ishadt, bambos, dscheink}@stanford.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02292.txt.

Introduction

Siddharth Chandak and co-authors worked out in 2025 how home monitoring systems should decide which patients get intensive watching, when health is tracked across several measures at once. Choosing monitoring levels trades patient benefit against scarce resources and quality of life. Earlier theory flattened health into a single number. Their model keeps health multidimensional and solves for the best policy with dynamic programming.

The optimal rule has an elegant shape: a switching surface in health space. Cross it, and the patient moves to intensive monitoring. The team shows how the surface bends with different diseases and parameters. Clinicians can use that structure for triage decisions and capacity planning. The framework is tunable to many conditions, widening its usefulness across remote care programs.

Catalog record

CREATORSiddharth Chandak, Isha Thapa, Nicholas Bambos, David Scheinker, {chandaks, ishadt, bambos, dscheink}@stanford.edu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-02292

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimal Control for Remote Patient Monitoring with Multidimensional Health States Siddharth Chandak, Isha Thapa, Nicholas Bambos, David Scheinker, {chandaks, ishadt, bambos, dscheink}@stanford.edu Abstract Selecting the right monitoring level in Remote Patient Monitoring (RPM) systems for e-healthcare is crucial for balancing patient outcomes, various resources, and patient’s quality of life. A prior work has used one-dimensional health representations, but patient health is inherently multidimensional and typically consists of many measurable physiological factors. In this paper, we introduce a multidimensional health state model within the RPM framework and use dynamic programming to study optimal monitoring strategies. Our analysis reveals that the optimal control is characterized by switching curves (for two-dimensional health states) or switching hyper-surfaces (in general): patients switch to intensive monitoring when health measurements cross a specific multidimensional surface. We further study how the optimal switching curve varies for different medical conditions and model parameters. This finding of the optimal control structure provides actionable insights for clinicians and aids in resource planning. The tunable modeling framework enhances the applicability and effectiveness of RPM services across various medical conditions. I Introduction Remote Patient Monitoring (RPM) is becoming an increasingly integral part of modern healthcare, enabling continuous observation of patients within their daily environments and enhancing both the quality of life and the level of delivered healthcare [ 1 , 2 , 3 ] . Advances in wearable medical devices such as continuous glucose monitors (CGMs) [ 4 ] and smartwatches which monitor vital signs [ 5 , 6 ] among others have allowed for collection and transmission of health data for real-time analysis and timely medical interventions. A significant challenge in RPM is determining the optimal intensity of monitoring. While intensive monitoring can lead to earlier detection and a prompt response, it can also cause patient stress and treatment fatigue due to its invasive nature [ 7 ] , drain device battery faster [ 6 ] , and increase other costs. On the other hand, less intensive monitoring might not be sufficient for timely interventions. In a recent work [ 8 ] , we studied this trade-off using a one-dimensional health state model and showed that threshold policies, where patients switch to intensive monitoring when their health falls below a certain threshold, are optimal. However, in reality, a patient’s health state is inherently multidimensional, where the dimensions represent different health measurements that clinicians use to make decisions [ 3 , 9 , 10 , 11 ] . Given the practical limitations of one-dimensional health states, in this paper, we extend our initial work [ 8 ] by introducing a multidimensional representation of health states within the RPM framework. We develop a dynamic programming approach to determine optimal monitoring strategies in this more complex setting. Our analysis reveals that controls characterized by switching curves (in two dimensions) or hyper-surface (in general) are optimal when considering multidimensional health states. That is, there exist switching curves/hyper-surfaces within the health space such that patients transition to intensive monitoring when their health indicators fall below this switching surface and return to ordinary monitoring when they improve. This finding provides clinicians with actionable guidelines for adjusting monitoring intensity based on a multidimensional view of patient health. The implications of the model and its analysis are significant for both patient care and resource management. By incorporating tunable parameters such as health improvement probabilities, monitoring options, and invasiveness costs, the framework can be adapted to specific medical conditions and tailored to individual patient needs. Furthermore, although not explicitly modeled, our approach allows for estimating the resources required to effectively manage patient populations, given the known time commitments associated with different levels of care. The rest of the paper is organized as follows. In Section II, we present the multidimensional RPM service model and describe the evolution of the patient’s health state under different monitoring strategies. Section III discusses examples of critical health states and their impact on the optimal policy. Section IV provides numerical investigations of the optimal monitoring control, and Section V concludes the paper with potential extensions. II The Remote Patient Monitoring Model Consider a patient whose health condition is modeled as an n -dimensional health state \bm{h}=(h^{(1)},\ldots,h^{(n)})\in\mathcal{H}\coloneqq\{0,1,\ldots,H\}^{n} . At each time t\in\{0,1,\ldots\} , the patient’s health state is given by \bm{h}_{t}\in\mathcal{H} . The remote patient monitoring (RPM) service places the patient in a monitoring state m_{t}\in\mathcal{M}=\{o,i\} in each time period t where o denotes ordinary monitoring and i intensive monitoring. Thus, one can view the joint monitoring and patient state s_{t}\coloneqq(m_{t},\bm{h}_{t})\in\mathcal{M}\times\mathcal{H}\eqqcolon\mathcal{S} as the service state at time t . The n dimensions of the patient’s health state correspond to different health measurements monitored by the e-health service. For example, a program for Type 1 Diabetes management may have patients wear CGMs and examine multiple measurements. These measurements could include time in range (percentage of time glucose levels remained between 70 and 180mg/dl) and time with clinically significant hypoglycemia (percentage of time glucose levels were below 54mg/dl) [ 9 ] . A higher patient health state corresponds to the patient having better health 1 1 1 In our model, continuous health measurements are discretized into clinically relevant categories. Additionally, in cases where increase in standard health measurement corresponds to worsening health, we use the inverse measurement instead. For example, the standard measurement is time with clinically significant hypoglycemia, but for our model we would use time without clinically significant hypoglycemia. . Here ‘higher’ is defined component-wise, i.e., for two health states \bm{h} and \bm{h}^{\prime} , with h^{(j)}=h^{\prime(j)} for all j\neq k and h^{(k)}>h^{\prime(k)} , the patient is said to have better health in state \bm{h} than in state \bm{h}^{\prime} . In particular, there exist critical health states in the sense that, when the patient drifts into those ‘worse’ states, they go beyond the scope of the current e-health service; and other emergency and/or more severe medical interventions are required, which are outside the scope of this service. For example, a person with diabetes experiencing a severe hypoglycemic episode may have to go to the emergency department or hospital [ 12 ] . When the patient enters a critical health state under any monitoring state i or o , the service evolution stops, as other medical measures/interventions are initiated. We denote the set of these critical health states by \mathcal{H}_{C} . A simple example of these critical sets could just be the origin or a hypercube around origin. We discuss more such critical sets, with their medical relevance, in the next section. The origin (0,\ldots,0) is always a part of \mathcal{H}_{C} . An advantage of our model is that the costs can be interpreted from multiple perspectives. In this section, we define the various costs based on the the patient’s quality of life. Under ordinary monitoring, the patient incurs a constant cost C_{o}\geq 0 at any state (o,h) with \bm{h}\in\mathcal{H} . Similarly, under intensive monitoring, the patient incurs a constant cost C_{i}\geq 0 at any state (i,h) with \bm{h}\in\mathcal{H} . These costs reflect the invasiveness of the monitoring process to the patient’s everyday lifestyle and quality of life. Of special interest are the critical health states, where a cost of C_{c} is incurred, and the model ceases to apply. II-A Markov Evolution We model the system as a controlled

Read the complete text