CAETC: Causal Autoencoding and Treatment Conditioning for Counterfactual Estimation over Time
Nghia D. Nguyen, Pablo Robles-Granda, Lav R. Varshney · 2026
Read CAETC: Causal Autoencoding and Treatment Conditioning for Counterfactual Estimation over Time by Nghia D. Nguyen, Pablo Robles-Granda, Lav R. Varshney (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11565.txt.
Introduction
Nguyen, Robles-Granda, and Varshney introduce CAETC, a method for estimating counterfactual outcomes over time. The hard part is bias: past treatments shape both later treatments and outcomes. CAETC uses an autoencoding design to learn a code for each history. The code can be partly inverted and does not depend on which treatment was given. A treatment-specific step on the code then yields the outcome estimate. The design fits LSTM and temporal convolution network models alike. On synthetic, semi-synthetic, and real data, it beats prior methods.
Catalog record
| CREATOR | Nghia D. Nguyen, Pablo Robles-Granda, Lav R. Varshney |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73728 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11565
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CAETC: Causal Autoencoding and Treatment Conditioning for Counterfactual Estimation over Time Nghia D. Nguyen, Pablo Robles-Granda, Lav R. Varshney Abstract Counterfactual estimation over time is important in various applications, such as personalized medicine. However, time-dependent confounding bias in observational data still poses a significant challenge in achieving accurate and efficient estimation. We introduce causal autoencoding and treatment conditioning (CAETC), a novel method for this problem. Built on adversarial representation learning, our method leverages an autoencoding architecture to learn a partially invertible and treatment-invariant representation, where the outcome prediction task is cast as applying a treatment-specific conditioning on the representation. Our design is independent of the underlying sequence model and can be applied to existing architectures such as long short-term memories (LSTMs) or temporal convolution networks (TCNs). We conduct extensive experiments on synthetic, semi-synthetic, and real-world data to demonstrate that CAETC yields significant improvement in counterfactual estimation over existing methods. 1 Introduction Personalized medicine requires knowledge about individualized responses to potential treatments for effective treatment planning ( Kent et al. 2018 ; Feuerriegel et al. 2024 ) . While randomized controlled trials (RCTs) are the gold standard for treatment effect estimation, RCTs in practice are often costly and difficult to implement. Digitization enables more healthcare data to be recorded, especially via electronic health records (EHRs). Combining large data volumes with appropriate modeling can enable accurate estimation of counterfactual outcomes and treatment effects, forming the basis for individualized decision making in health care ( Bareinboim & Pearl 2016 ) and other domains. Modern counterfactual estimation methods integrate frameworks from causal inference and deep learning for counterfactual estimation over time ( Lim et al. 2018 ; Bica et al. 2019 ; Melnychuk et al. 2022 ; Bouchattaoui et al. 2024 ; Wang et al. 2024 ) . However, counterfactual estimation over time is difficult due to time-dependent confounding bias, where covariates that affect treatment choices evolve dynamically and are themselves influenced by prior treatments ( Robins et al. 2000 ) . This results in systematic differences in the distribution of confounders between treatment regimes, violating key identification assumptions and complicating the estimation of unbiased causal effects. Conventional time-series models lack the capacity to adjust for this bias, relying on advanced methods to disentangle confounders from treatment assignment. Learning to balance or disentangle time-dependent confounders is crucial for unbiased counterfactual estimation over time. Modern methods leverage sequence architectures like recurrent neural networks, transformers, or state-space models, with de-confounding mechanisms, like inverse probability of treatment weighting or adversarial balancing, to mitigate time-varying confounding bias, enabling better long-term treatment effect prediction in complex, sequential decision-making settings ( Lim et al. 2018 ; Bica et al. 2019 ; Melnychuk et al. 2022 ; Bouchattaoui et al. 2024 ; Wang et al. 2024 ) . For instance, recurrent marginal structure network (RMSN) ( Lim et al. 2018 ) uses an LSTM architecture with inverse probability of treatment weighting (IPTW). Alternatively, counterfactual recurrent network (CRN) ( Bica et al. 2019 ) uses LSTM architecture with a gradient reversal layer, whereas causal transformer (CT) ( Melnychuk et al. 2022 ) has a transformer architecture with domain confusion loss to learn explicit treatment-invariant representation. Despite these remarkable advances, several key limitations persist. First, existing methods (CRN, CT) suffer from the loss of covariate information due to adversarial training ( Huang et al. 2024 ) . Achieving treatment invariance with an expressive, invertible representation that encodes sufficient information on history for identification of causal effects remains a challenge. Consequently, models risk learning shortcuts that limit their ability to recover individual-level causal responses or suffer from loss of heterogeneity ( Melnychuk et al. 2023 ) . More recent methods, such as causal contrastive predictive coding (CCPC) ( Bouchattaoui et al. 2024 ) , tackle the problem implicitly by using the InfoMax principle to encourage representation invertibility. Conversely, Mamba-CDSP ( Wang et al. 2024 ) uses an architecture-specific loss to decorrelate history with planned treatment to circumvent adversarial training. Second, existing methods put little emphasis on modeling the interaction between the planned treatment and the balanced representation to decode future outcomes. While the representation balancing stage yields a theoretically valid representation, the interaction between the representation and planned treatment directly affects the future outcome prediction (see Fig. 2 A). By making this interaction explicit, we intuitively and simultaneously encourage representation invertibility and predict future outcomes without excessive architecture changes or complex training procedures. Inspired by these recent methods and their constraints, we present an architecture-agnostic method called causal autoencoding and treatment conditioning (CAETC) for counterfactual estimation over time. Our methodological contributions are the following: • We design a model-agnostic method for counterfactual estimation over time that encourages a partially invertible representation via autoencoding and predicts future outcomes via treatment conditioning. We further encourage the conditioning layer to learn a treatment-specific transformation to improve counterfactual estimation performance. We apply the proposed design on long-short term memory (LSTM) and temporal convolution network (TCN). • We propose an entropy maximization adversarial game that yields theoretically balanced representation across all treatment regimes. The adversarial game is equivalent to minimizing a generalized Jensen-Shannon divergence between treatment-conditional representation distributions. We further demonstrate that under certain assumptions and distributional conditions, the outcome estimation error is bounded by the aforementioned Jensen-Shannon divergence term. • We empirically validate CAETC on synthetic, semi-synthetic, and real-world datasets to demonstrate that our method achieves strong improvement over existing counterfactual estimation baselines. 2 Related Works Counterfactual estimation has received great attention in both static and temporal settings. Here, we describe prior methods in the temporal domain. 2.1 Counterfactual estimation over time Methods that control for time-dependent confounding were originally developed in epidemiology for longitudinal studies, such as the structural nested model (SNM) ( Robins 1994 ) and marginal structural model (MSM) ( Robins et al. 2000 ) . However, these methods have traditionally been implemented using simple parametric estimators with limited capacity to deal with complex, high-dimensional data. RMSN improves over MSM by incorporating LSTM to handle nonlinearities in the data. However, RMSN still relies on IPTW and suffers from the same problems, such as high variance. Alternatively, G-Net ( Li et al. 2021 ) adapts g-computation ( Robins 1986 ; Robins 1987 ) to sequence model. A class of recent methods, such as CRN and CT ( Bica et al. 2019 ; Melnychuk et al. 2022 ) , uses domain adversarial training to learn a treatment-invariant representation, removing the systematic differences between treatment regimes. Further progress has been made toward different approaches to handle time-dependent confounding, such as adapting ODE discovery to treatment effect estimation ( Kacprzyk et al. 2023 ) . 2.2 Learning treatment-invariant representation Recent approaches adopt adversarial treatment-invariant representation learning ( Bica et al. 2019 ; Melnychuk et al. 2022 ; Bouchattaoui et al. 2024 ) as a foundational building block to balance between treatment groups. More specifically, CRN ( Bica et al. 2019 ) uses a gradient reversal layer (GRL) ( Ganin et al. 2016 ) between an LSTM representation network and a treatment balancing head. The treatment balancing head is optimized to predict the treatment domain from the representation, whereas the GRL encourages a treatment-invariant representation, forming an adversarial game. Similarly, CT ( Melnychuk et al. 2022 ) replaces the LSTM