Estimation and Evaluation of the Resource-Constrained Optimal Dynamic Treatment Rule: An Application to HIV Care Retention

Lina M. Montoya, Elvin Geng, Harriet F. Adhiambo, Maya Petersen · 2025

Read Estimation and Evaluation of the Resource-Constrained Optimal Dynamic Treatment Rule: An Application to HIV Care Retention by Lina M. Montoya, Elvin Geng, Harriet F. Adhiambo, Maya Petersen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14763.txt.

Introduction

Lina Montoya and co-authors explain a method for sharing a helpful treatment when only some people can get it. The method builds a rule that weighs gain and cost under a set limit on how many people are treated. It grows out of an earlier algorithm by Luedtke and van der Laan. The team gives new ways to show the rule, its value, and its cost, plus plain advice on how to run it.

They apply the method to a trial on keeping people in HIV care. The trial tested cash payments tied to care visits. Giving the payments to a small share, such as ten percent, beat standard care for all. The gain came mostly from easing the limit, not from sharp gaps in who gains most.

Catalog record

CREATORLina M. Montoya, Elvin Geng, Harriet F. Adhiambo, Maya Petersen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14763

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Estimation and Evaluation of the Resource-Constrained Optimal Dynamic Treatment Rule: An Application to HIV Care Retention Lina M. Montoya, Elvin Geng, Harriet F. Adhiambo, Maya Petersen Abstract The optimal strategy for deploying a treatment in a population may recommend giving all in the population that treatment. Such a strategy may not be feasible, especially in resource-limited settings. One approach for determining how to allocate a treatment in such settings is the resource-constrained optimal dynamic treatment rule (RC ODTR) SuperLearner algorithm, developed by Luedtke and van der Laan. In this paper, we describe this algorithm, offer various novel approaches for presenting the RC ODTR and its value in terms of benefit and cost, and provide practical guidance on implementing the algorithm (including software). In particular, we apply this method to the Adaptive Strategies for Preventing and Treating Lapses of Retention in HIV care (NCT02338739) trial to determine how to best allocate conditional cash transfers (CCTs) for increasing HIV care adherence given varying constraints on the proportion of people who can receive CCTs in the population, providing one of the few applied illustrations of this method and novel substantive findings. We find that there are clinical and monetary benefits to deploying CCTs to a small percent (e.g., 10%) of the population compared to administering the care standard for all; however, results suggest that these incremental benefits are only due to the loosening of constraints, rather than a presence of treatment effect heterogeneity strong enough to drive a more efficient and effective constrained allocation approach. 1 Introduction The goal of precision health is to shift scientific questions from “does a treatment work, on average?” to “for whom does a treatment work?”, to ultimately learn the most efficient and effective ways of administering treatments. Approaches for answering the latter question aim to identify differential treatment responses, and thus learn how to administer treatment only to those persons who are likely to benefit from it. Traditional empirical methods for identifying such persons include, for example, subgroup analyses for understanding treatment effect heterogeneity within (ideally) a priori specified subgroups. More recently, approaches, including those leveraging machine learning, have been proposed to estimate optimal dynamic treatment rules ( Murphy, 2003 ) (i.e. policies) – algorithms that input an individual’s covariate information and output the treatment decision for that individual that has the best expected outcome (see, e.g., Kosorok and Laber (2019) , for a review of estimation approaches for these algorithms). Such approaches are particularly useful in settings in which a treatment that is beneficial on average may nonetheless be harmful to some subset of the population, or when multiple treatment options are available and persons differ in the option to which they are most likely to respond. It may be the case, however, that resources are limited such that a treatment cannot be given to more than a certain proportion of the population. In such a scenario, improved understanding of treatment effect heterogeneity is crucial for effective resource allocation, even in the simple scenario of a single candidate treatment that is beneficial on average overall and conditional on all measured covariates. Consider the following real-world example: among adults living with HIV in sub-Saharan Africa, it was found that, on average, conditional cash transfers (CCTs) helped persons living with HIV (PWH) stay engaged in HIV care, relative to the standard-of-care ( Geng et al., 2023 ) . Here, it may be that CCTs do not harm anyone; everyone has an expected positive effect of CCTs, conditional on measured covariates. In this scenario, the optimal dynamic rule would say: “give CCT treatment to everyone,” regardless of covariate history. However, it may not be financially feasible to give CCTs to all persons in this population to maintain their HIV care. In other words, in this situation, resources constrain the proportion of people who can receive CCTs over a period of time. Under this constraint, a treatment will have the greatest benefit if it is allocated to those persons most likely to benefit. Informally, our precision health question shifts further, from “for whom does a treatment work?” to “for whom does a treatment work the most ?” Several methodological approaches exist for selectively administering treatment, subject to resource constraints (e.g., Caniglia et al. (2021) ; Sarvet et al. (2024) ; Xu et al. (2024) ). One approach aims to estimate the so-called resource-constrained optimal dynamic treatment rule (RC ODTR), proposed by Luedtke and van der Laan (2016a) . The RC ODTR is the optimal dynamic treatment rule that respects the constraint that only a proportion of the population is able to receive the treatment. An unconstrained optimal rule could be defined as a function of the conditional average treatment effect (CATE): if a person’s CATE is greater than 0 (i.e., positive treatment effect), treat that person; else, do not treat that person. The RC ODTR changes the original optimal rule’s threshold to one that is greater than 0, thereby treating only those who have a treatment effect higher than some cutoff determined by the constraint on the proportion of people who can receive treatment. Further, under this algorithm, if two or more people are “tied” for resources, the rule becomes stochastic (i.e., those people are given a probability of treatment, as opposed to a deterministic, binary treatment decision). This can occur if, for example, the optimal dynamic treatment rule is a function of only discrete covariates. Although the RC ODTR algorithm has been described in theoretical detail (e.g., Luedtke and van der Laan (2016a) ) and presented as part of a larger clinical trial analysis (e.g., Kessler et al. (2022) ), to our knowledge, there are no articles in the literature describing and illustrating this method in the context of an applied example. Filling this gap may be useful for analysts who would like to apply the RC ODTR algorithm to their data. Thus, in this article, we present an applied example of the RC ODTR on data generated from the Adaptive Strategies for Preventing and Treating Lapses of Retention in HIV Care (ADAPT-R; NCT02338739) trial. Specifically, we apply the RC ODTR on ADAPT-R data to understand which individuals are most likely to benefit from CCTs under a constraint on the proportion of people who can receive CCTs in the population, and quantify the clinical loss incurred by use of a constrained vs. unconstrained rule. We also build on prior work by illustrating how the impact of a varying resource constraint level can be summarized using a causal estimand defined with a marginal structural model (MSM), and use results from this to determine the utility of using an RC ODTR to determine, among a population of persons all expected to benefit from a treatment, who should receive a resource-constrained intervention, compared to implementing the resource constraint at random. Finally, we show how to construct an incremental cost-effectiveness ratio (ICER) illustrating the cost effectiveness of implementing such rules, as a function of different resource constraint levels. In presenting these results, we hope to show practical ways of using and evaluating the RC ODTR to understand how to selectively administer treatments to only those persons most likely to benefit from them, and any costs to doing so. These analyses are additionally accompanied

Read the complete text