Modeling Covariate Transition for Efficient Estimation of Longitudinal Treatment Effects in Randomized Experiments
Naoki Chihara, Tatsushi Oka, Yasuko Matsubara, Yasushi Sakurai, Shota Yasui · 2026
Read Modeling Covariate Transition for Efficient Estimation of Longitudinal Treatment Effects in Randomized Experiments by Naoki Chihara, Tatsushi Oka, Yasuko Matsubara, Yasushi Sakurai, Shota Yasui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31443.txt.
Introduction
Chihara and team offer a regression-adjustment framework for longitudinal treatment effects in randomized tests. Standard adjustments cut variance with pre-treatment covariates, but they usually yield only average effects. That hides when effects appear and how long they last. The team models intermediate outcomes and shifting post-treatment covariates over time through transition kernels. They prove the estimator is asymptotically normal and hits the efficiency bound. Simulations plus an A/B test from a Japanese streaming platform show its practical edge.
Catalog record
| CREATOR | Naoki Chihara, Tatsushi Oka, Yasuko Matsubara, Yasushi Sakurai, Shota Yasui |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 135729 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.31443
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modeling Covariate Transition for Efficient Estimation of Longitudinal Treatment Effects in Randomized Experiments Naoki Chihara, Tatsushi Oka, Yasuko Matsubara, Yasushi Sakurai, Shota Yasui Abstract We present a regression-adjustment framework designed for the estimation of longitudinal treatment effects in randomized experiments under static regimes. While regression-adjustment methods are useful for variance reduction in randomized experiments by using pre-treatment covariates, they usually focus only on average effects, from which we cannot obtain valuable insights into when the effects appear and how long they continue. To address this issue, we consider intermediate outcomes and evolving post-treatment covariates over time, and we represent such dynamic trajectories using transition kernels. Furthermore, we establish the asymptotic normality and the semiparametric efficiency bound for our estimator, enabling more powerful statistical inference. Simulation studies and empirical analysis using A/B test data from a streaming platform in Japan show the practical advantages of our method. † † affiliationnotice: † Work done during research internship at CyberAgent AI Lab. 1 Introduction Randomized experiments ( 23 ) have been the gold standard for inferring causal effects and are widely employed across various domains, including medicine ( 71 ) and economics ( 22 ; 4 ) . However, the statistical power is limited, and large sample sizes are needed to obtain reliable results, as reported in online experiments ( 44 ) . To address this challenge, regression adjustment has been widely used to reduce the variance of treatment effect estimators by utilizing auxiliary covariates collected in randomized experiments ( 47 ; 19 ; 35 ; 8 ; 58 ) . Although regression adjustment under randomized experiments is widely employed for variance reduction in treatment effect estimation, standard methods typically utilize only pre-treatment covariates to estimate the average treatment effect (ATE). As a result, these methods overlook important insights into the temporal evolution of effects induced by early treatments. This limitation leads to a significant missed opportunity, especially in modern applications, where randomized experiments are often conducted over extended periods under static regimes. For example, the ATE does not capture the essential temporal dynamics of the response, such as whether the treatment yields an immediate impact, exhibits a delayed effect, or maintains persistence over time. Capturing these temporal dynamics requires incorporating information from intermediate outcomes and evolving post-treatment covariates. However, naively conditioning on such post-treatment variables allows for variance reduction but introduces post-treatment bias, distorting the target estimand even in randomized settings ( 27 ; 52 ) . For instance, in streaming services, user preferences dynamically evolve in response to recommendation algorithms. Adjusting for these evolving preferences as covariates blocks the causal pathway, thereby failing to capture the time-evolving impact of treatments on long-term engagement. In this paper, we propose a regression adjustment method for the estimation of longitudinal treatment effects under randomized experiments. A key advantage of our framework is its ability to incorporate dynamic transitions in covariates induced by treatments into the estimation procedure. To account for temporal dynamics, we exploit transition kernels to represent how past treatments shape future histories and propagate outcome predictions forward along this kernel. This forward integration aggregates information contained in post-treatment covariates while preserving the marginal target estimand, thereby avoiding the post-treatment bias inherent in naive conditioning. As a by-product, this explicit modeling allows us to directly incorporate domain knowledge regarding system dynamics, such as seasonality or known exogenous shocks, into the transition mechanism. In addition, the proposed method builds upon the Neyman-orthogonal moment conditions ( 14 ; 15 ) , which provide robustness against first-order estimation errors in high-dimensional or complex nuisance components. These nuisance functions are estimated using flexible machine learning methods, making our method model-agnostic. Incorporating cross-fitting further strengthens robustness against estimation errors. With this design, we derive the asymptotic distribution of the proposed estimator and establish its semiparametric efficiency bound under mild regularity conditions. These results enable statistical inference, including standard error estimation and the construction of confidence intervals. Contributions. The main contributions of this paper are:(i) we present the dynamic regression-adjustment method using transition kernels and forward integration under randomized experiments; (ii) we establish asymptotic normality and provide valid inference under cross-fitted machine learning nuisance estimation, generalizing beyond traditional settings in causal inference; (iii) we derive the semiparametric efficiency bound for our estimator and show that it attains this bound; (iv) simulation studies and empirical analyses demonstrated the practical advantages of our approach. Outline. The rest of our paper is organized in a conventional format. After the introduction, we review related works in Section 2 and provide our problem definition in Section 3 . Next, we introduce the dynamic regression-adjusted estimator and its estimation procedure in Section 4 and the asymptotic properties of our results in Section 5 . We then provide our experimental results and discussion in Section 6 , followed by a conclusion in Section 7 . All of the proofs for our theoretical results are provided in Appendix C . 2 Related Work Longitudinal treatment effects. Early seminal works in epidemiology and biostatistics established principled frameworks for estimating longitudinal treatment effects ( 64 ; 62 ; 65 ) . Recently, many researchers in the machine learning community have been studying sequential decision making in adaptive experimental designs, such as multi-armed bandits ( 40 ) . The adaptive nature of these approaches poses significant challenges for statistical inference, and it has been reported that they may introduce bias and make it harder to estimate causal effects ( 74 ; 32 ) . In this context, policy evaluation in contextual bandits and reinforcement learning ( 21 ; 36 ; 37 ; 32 ) , as well as dynamic treatment regimes ( 53 ; 66 ; 79 ; 43 ; 9 ) , primarily aims to estimate the value of adaptive decision rules. Deep learning approaches have also been proposed for counterfactual prediction from temporal trajectories ( 46 ; 6 ; 45 ; 51 ; 25 ) , while our focus is on estimators with formal statistical inference and efficiency analysis under randomized experiments. From a different perspective, surrogate index methods ( 60 ; 3 ) infer long-term treatment effects from short-term experimental results under strong surrogacy assumptions. Despite their respective strengths, the majority of these existing methods focus on estimating a single cumulative outcome, thereby obscuring the rich temporal dynamics of how treatment effects evolve at each specific time point. While the practical importance of tracking how treatment effects evolve over time has been widely recognized in large-scale online experiments ( 33 ) , formal efficiency theory for the full trajectory of marginal treatment effects in static randomized experiments remains limited. Regression adjustment. Randomized experiments have been widely used for the unbiased identification of the parameter of interest, but they often suffer from relatively low statistical power, as reported in online experiments ( 44 ) . To tackle this challenge, regression adjustment using auxiliary covariates to improve precision in treatment effect estimation has been extensively studied ( 24 ; 18 ; 78 ; 68 ; 26 ; 75 ; 69 ; 47 ; 19 ; 28 ) . Recent work extends covariate adjustment to high-dimensional settings and modern machine learning, enabling variance reduction with many auxiliary variables ( 77 ; 8 ; 59 ; 31 ; 42 ; 50