Can we detect treatment effect waning from time-to-event data?

Eni Musta, Joris Mooij Korteweg-de Vries Institute for Mathematics, University of Amsterdam · 2025

Read Can we detect treatment effect waning from time-to-event data? by Eni Musta, Joris Mooij Korteweg-de Vries Institute for Mathematics, University of Amsterdam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19096.txt.

Introduction

Eni Musta and Joris Mooij examine a subtle question in medical statistics: how can researchers tell if a treatment effect fades over time? The issue shapes booster vaccine advice and long-term cost studies. Simple comparisons of hazard curves in trials can mislead, because the groups still at risk change in uneven ways.

The authors review safer options, including survival curves and newer causal hazard ratios built on principal stratification or controlled direct effects. Those ratios need strong assumptions, though bounds can still be derived. A key warning follows: a causal hazard ratio moving toward one does not by itself prove that protection is fading.

Catalog record

CREATOREni Musta, Joris Mooij Korteweg-de Vries Institute for Mathematics, University of Amsterdam
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-19096

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can we detect treatment effect waning from time-to-event data? Eni Musta, Joris Mooij Korteweg-de Vries Institute for Mathematics, University of Amsterdam Abstract Understanding how the causal effect of a treatment evolves over time, including the potential for waning, is important for informed decisions on treatment discontinuation or repetition. For example, waning vaccine protection influences booster dose recommendations, while cost-effectiveness analyses require accounting for long-term efficacy of treatments. However, there is no consensus on the methodology to assess and account for treatment effect waning. Even in randomized controlled trials, the common naïve comparison of hazard functions can lead to misleading causal conclusions due to inherent selection bias. Although comparing survival curves is sometimes recommended as a safer measure of causal effect, it only represents a cumulative effect over time and does not address treatment effect waning. We also explore recent formulations of causal hazard ratios, based on the principal stratification approach or the controlled direct effect. These causal hazard ratios cannot be identified without strong modeling assumptions, but bounds can be derived accounting for unobserved heterogeneity and one could try to use them to detect treatment effect waning. However, we illustrate that an increase in causal hazard ratios towards one does not necessarily mean that the protective effect of the treatment is fading. Furthermore, the same survival functions may correspond to both scenarios with and without waning, which shows that treatment effect waning cannot be identified from standard time-to-event data without strong untestable modeling assumptions. ∎ MSC 62G99 62N99 62P10 1 Introduction Waning of treatment effect refers to the gradual decline in the efficacy or benefit of a treatment over time. This phenomenon is observed in various medical and public health interventions, such as vaccines, where initial protection against disease may diminish months or years after administration, necessitating booster doses. Waning can also occur for pharmacological or other types of treatments due to biological, behavioral, or environmental factors. For instance, increased drug tolerance can contribute to reduced effectiveness over time. Understanding treatment effect waning is critical for optimizing intervention strategies, including the timing of re-treatment or discontinuation, and for accurately estimating long-term treatment benefits in cost-effectiveness analyses. However, characterizing, quantifying and interpreting waning is complex and challenging since risk profiles change over time and a diminishing treatment effect could also result from other mechanisms, such as changes in exposure patterns. These complexities underscore the need for a better understanding of what we can or cannot conclude based on the observed data. In the context of vaccine efficacy (VE), waning immunity has received a lot of attention recently ( Piechotta and Harder 2022 ; Menegale et al. 2023 ; Imai et al. 2023 ; Goldberg et al. 2021 ; Zhuang et al. 2022 ; Clark et al. 2019 ; Giannouchos et al. 2024 ) , as understanding the rate of waning can inform the design of appropriate targets and timing for future vaccination programs. Most of the time, waning is assessed by comparing the interval-specific incidence rate of infection between vaccinated and placebo groups in randomized controlled trials (RCTs). Particularly, an increasing hazard ratio is commonly used as an indication of waning of vaccine efficacy, see for example Durham et al. 1998 ; Haber et al. 2021 ; Nikas et al. 2023 . However, such conventional estimand is misleading because the hazard ratio does not have a causal interpretation due to the inherent selection bias ( Hernán 2010 ; Martinussen et al. 2020 ; Stensrud et al. 2019 ) . As a result, VE may appear to decline over time due to the depletion of individuals most susceptible to infection and would not necessarily mean a waning of immunity. On the other hand, a comparison of survival curves, i.e. the cumulative vaccine efficacy, does not address waning of immunity and can also be misleading as illustrated in Figure 2 . Recently, Janvin and Stensrud 2024 introduced the challenge effect, which is a comparison of incidence rates under a hypothetical intervention on both the vaccination status and the exposure to the infections agent. They derive bounds on the challenge effect from standard RCT data and propose to use such bounds to quantify waning. More in general, the reduction of the efficacy of a treatment over time is particularly significant in health technology assessments (HTAs), where long-term effectiveness is crucial for evaluating the cost-effectiveness of medical interventions. Evaluation of cost-effectiveness requires extrapolation of the survival functions beyond the study period and such extrapolation can be done in different ways. This generates debates about whether there is treatment effect waning, as neglecting it can lead to overestimation of cost-effectiveness of treatments. To address this, guidelines of the National Institute for Health and Care Excellence (NICE) require that companies should provide sensitivity and scenario analyses, including the potential for treatment effect waning, in their economic analysis. There are however no guidelines on how to implement such assumption. Reviews of NICE technology appraisals ( Trigg et al. 2024 ; Armoiry et al. 2022 ; Taylor et al. 2024 ; Kamgar et al. 2022 ) revealed diverse methods for incorporating treatment effect waning assumptions and also heterogeneity in justifications of considering or disregarding the possibility of waning. In this paper, we discuss the possibility to detect and quantify treatment effect waning from time-to-event data. We provide an overview of existing approaches and emphasize once again that the commonly used hazard ratio is not an appropriate metric. In order to assess waning of treatment effect, one would need to choose an estimand which is a causal comparison between treatment and control group at a given time point, and then guarantee that change of such estimand over time reflects waning or strengthening of treatment effect. Hence, the two groups being compared need to be similar both at a fixed time and across different time points. For comparison of the two groups at fixed time points, we consider recently defined causal versions of the hazard ratio based on principal stratification or the controlled direct effect approach. However, we illustrate that an increase in causal hazard ratios towards one does not necessarily mean that the protective effect of the treatment is fading. Furthermore, the same survival functions may correspond to both scenarios with and without waning, which shows that treatment effect waning cannot be identified from standard time-to-event data without strong untestable modeling assumptions. As a consequence, we suggest that the most appropriate way to account for waning in cost-effectiveness analysis is to consider partial identifiability bounds, as a quantification of uncertainty. The paper is organized as follows. In Section 2 we describe the setting in consideration and introduce the required notation. A more detailed literature review on the topic of waning of vaccine efficacy, including the challenge effect proposed by Janvin and Stensrud 2024 is provided in Section 3 . Then, in Section 4 , we discuss two different formulations of causal hazard ratios and show that the challenge effect corresponds to the controlled direct effect in the scenario where, without intervention on exposure, everyone would be exposed to the infectious agent. In Section 5 we illustrate through an example that the causal hazard ratios can provide misleading information on waning of treatment effect, which cannot be identified without strong modeling

Read the complete text