A Randomization-Based Method for Evaluating Time-Varying Treatment Effects

Sangjin Lee, Department of Statistics, Seoul National University, Republic of Korea · 2024

Read A Randomization-Based Method for Evaluating Time-Varying Treatment Effects by Sangjin Lee, Department of Statistics, Seoul National University, Republic of Korea (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-09697.txt.

Introduction

Sangjin Lee and Kwonsang Lee build new tests for how a treatment's effect on paired, cut-off results shifts over time. Their paper is from two thousand twenty-four.

Past tests for such data can spot a broad effect across a whole follow-up span. They say little on when an effect starts or how it grows or fades. The new tests give each person a score tied to life at a set time, built from stand-in views of full data. They can probe both set times and the long run. The team adds checks for hidden bias in studies where chance was not used to assign the treatment, and shows the method on a Korean aging study.

Catalog record

CREATORSangjin Lee, Department of Statistics, Seoul National University, Republic of Korea
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-09697

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Randomization-Based Method for Evaluating Time-Varying Treatment Effects Thanks: Corresponding author: Kwonsang Lee ([email protected]) Sangjin Lee, Department of Statistics, Seoul National University, Republic of Korea Abstract Tests for paired censored outcomes have been extensively studied, with some justified in the context of randomization-based inference. These tests are primarily designed to detect an overall treatment effect across the entire follow-up period, providing limited insight into when the effect manifests and how it changes over time. In this article, we introduce new randomization-based tests for paired censored outcomes that enable both time-specific and long-term analysis of a treatment effect. The tests utilize time-specific scores, quantifying each individual’s impact on sample survival at a fixed time, obtained via pseudo-observations . Moreover, we develop corresponding sensitivity analysis methods to address potential unmeasured confounding in observational studies where randomization often lacks support. To illustrate how our methods can provide a fuller analysis of a time-varying treatment effect, we apply them to a matched cohort study using data from the Korean Longitudinal Study of Aging (KLoSA), focusing on the effect of social engagement on survival. Keywords: Censored-outcome; Matched-pair; Observational study; Pseudo-observation; Randomization-based inference; Sensitivity analysis; Time-varying effect 1 Introduction 1.1 Motivating Example Kim et al., (2016) analyzed the Korean Longitudinal Study of Aging (KLoSA) cohort of individuals aged 45 years or older in 2006 to assess the effect of social engagement on survival. Using a Cox proportional hazards model, they found that individuals with lower levels of social engagement had a higher risk of mortality, with an estimated hazard ratio of 1.84 for those in the lowest level of engagement compared to those in the highest. While their approach relied on social behavioral trajectories between 2006 and 2012, we aim to assess the effect of social engagement at baseline in 2006 on subsequent survival in the cohort. In particular, our primary interest lies in identifying the actual duration of this effect, if any, beyond merely determining whether it existed. It should be acknowledged that the baseline measure of social engagement may not capture long-term behavioral patterns, nor can we ascertain that social behaviors were sustained over time. Yet, the one-time measure provides a consistent reference point for adjusting baseline confounders ( Lee et al.,, 2018 ; Zhang et al.,, 2024 ) and thereby enables what Hernán and Robins, (2020) describe as an observational analog of intention-to-treat (ITT) analysis. We follow Kim et al., (2016) in defining a binary treatment based on total social engagement scores (0-17), though we use only those from 2006. In addition, we define the outcome as time to death or right-censoring within the extended follow-up period through 2022. Using the standard practice of matching to remove bias from measured confounding ( Rosenbaum,, 2002 ; Imbens and Rubin,, 2015 ) , we paired 1,474 treated individuals who were highly engaged (total score > 6) with 1,474 control individuals who were disengaged (total score \leq 3). Details on the matching variables and the resulting balance are provided in Appendix B . Figure 1 shows the Kaplan–Meier survival curves for highly engaged individuals and their matched disengaged controls in the 1,474 matched pairs. From the figure, the survival difference between the treated and control groups appears to be most pronounced between follow-up years 4 and 10 with the gap generally narrowing toward the end of follow-up. This may suggest that social engagement at baseline prolonged survival for a decade but had little or no effect on 13- or 14-year survival. However, this inspection alone does not provide valid evidence that a beneficial effect truly existed, nor does it clarify how the effect varied over time. To investigate this further, we will examine the matched pairs using our proposed method in Section 5 . It is also important to bear in mind that concerns about unmeasured confounding remain in our motivating example. Because the KLoSA data are observational, there is no guarantee that two individuals in a matched pair had equal chances of being highly socially engaged in 2006, even though all measured confounders were adjusted for by matching. To address this, we will also investigate how unmeasured confounding might affect our inferences through sensitivity analyses. Figure 1 : Comparison of the Kaplan–Meier survival curves for highly engaged individuals and their matched disengaged controls in the 1,474 matched pairs from the KLoSA cohort 1.2 Our Contribution Tests for paired censored outcomes have been extensively studied by O’Brien and Fleming, (1987) , Dabrowska, (1989) , Akritas, (1992) , Dallas and Rao, (2000) , Murray, (2001) , among others, with some justified in the context of randomization-based inference. For example, the paired Prentice-Wilcoxon test of ( O’Brien and Fleming,, 1987 ) has been shown to be valid for testing Fisher’s sharp null hypothesis of no treatment effect at all ( Rosenbaum,, 2002 ) . Although focused on unpaired data, Li and Small, (2023) provided a new justification of the classical log-rank test from a randomization-based perspective, suggesting broader applicability of randomization-based reasoning to time-to-event analysis. Regardless of the inferential framework under which they are developed, existing tests for paired censored outcomes generally share several limitations. While they may be effective in determining whether a treatment has an overall effect during follow-up, they often provide limited insight into how the effect manifests over time. This lack of time-specific information is particularly problematic in settings where the treatment effect is expected to vary—either gradually or abruptly—throughout the study period. In many scientific contexts, especially in clinical or behavioral research, treatment effects are seldom static; rather, they may intensify, diminish, or even reverse over time. When such patterns remain unclear, so does our understanding of how the treatment works over time, precluding the identification of its onset or duration. In addition, the statistical power of existing tests can vary considerably depending on the timing and shape of the underlying treatment effect ( Woolson and O’Gorman,, 1992 ; Sun and Sherman,, 1996 ; Dallas and Rao,, 2000 ; Lee and Wang,, 2003 ) , rendering the results sensitive to how the effect unfolds over time. For example, a test may perform well when the effect is strong and constant throughout follow-up, but suffer dramatically when the effect is delayed, short-lived, or non-monotonic. This sensitivity introduces a layer of uncertainty into the analysis: the same method that works well in one scenario may fail in another, simply because the underlying pattern of the effect has changed. In an effort to address these limitations, complementary approaches have been proposed by focusing on comparing survival probabilities at a fixed time point ( Klein et al.,, 2007 ; Su et al.,, 2011 ) . However, these fixed-time methods lack a principled approach to formally identify the onset and duration of a treatment effect. Taken together, these observations highlight the need for a method that not only provides time-specific insight into a treatment effect but also maintains a valid inference and robust statistical power across a range of effect trajectories. In this article, we introduce new randomization-based tests for paired censored outcomes that enable both time-specific and long-term analysis of treatment effects. A key idea of our approach is to use time-specific scores that quantify each individual’s contribution to sample survival at a fixed time point. These

Read the complete text