Frugal, Flexible, Faithful: Causal Data Simulation via Frengression

Linying Yang, Robin J. Evans, Xinwei Shen · 2025

Read Frugal, Flexible, Faithful: Causal Data Simulation via Frengression by Linying Yang, Robin J. Evans, Xinwei Shen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01018.txt.

Introduction

Linying Yang and co-authors introduced frengression in 2025, a deep generative method for simulating causal data around the effect a researcher cares about. Machine learning has sharpened causal inference, but testing methods needs fake data that behave like real trials. Their approach models covariates, treatments, and outcomes together while keeping the causal margin exact. It can also draw samples directly from what-if distributions a user sets.

The team prove consistency and safe extrapolation for the method. Tests on real clinical trial data show it can estimate effects and mimic complex, time-varying data with care. They hope the framework sparks more generative work on causal margins. It addresses benchmark builders who need faithful stand-ins for patient data.

Catalog record

CREATORLinying Yang, Robin J. Evans, Xinwei Shen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01018

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Frugal, Flexible, Faithful: Causal Data Simulation via Frengression Linying Yang, Robin J. Evans, Xinwei Shen Abstract Machine learning has revitalized causal inference by combining flexible models and principled estimators, yet robust benchmarking and evaluation remain challenging with real-world data. In this work, we introduce frengression, a deep generative realization of the frugal parameterization that models the joint distribution of covariates, treatments and outcomes around the causal margin of interest. Frengression provides accurate estimation and flexible, faithful simulation of multivariate, time-varying data; it also enables direct sampling from user-specified interventional distributions. Model consistency and extrapolation guarantees are established, with validation on real-world clinical trial data demonstrating frengression’s practical utility. We envision this framework sparking new research into generative approaches for causal margin modelling. 1 Introduction The use of machine learning tools has given causal inference a new lease of life, enabling complex models to be used with principled causal estimators and guarantees about statistically important quantities ( Wager and Athey 2018 ; Chernozhukov et al. 2018 ; Hahn et al. 2020 ) . To build trustworthy causal models, however, we also need to understand when these methods may be more or less reliable, or perhaps fail completely. This implies that causal inference needs a set of good benchmarking tools. Unfortunately, real‑world datasets are not ideal for this task, because they cannot give us access to the ground truth other than in a few very special circumstances. In particular, they rarely provide the counterfactual outcomes we care about, and the distribution we want to evaluate often differs from the one that produced the observations. Well‑designed simulations can address this discrepancy ( Neal et al. 2020 ; Parikh et al. 2022 ) ; they allow us to choose a ground truth, stress‑test new methods, compare their generalizability and stability, and expose failure modes before deployment. In trial design, simulations also guide sample size calculations, making patient recruitment more efficient. Valid benchmarks have therefore become central to method development in the AI era. Faithful simulation is no longer optional; it is a core step in building trustworthy causal models ( Friedrich and Friede 2024 ; Pezoulas et al. 2024 ; Gamella et al. 2025 ) . Generating data that obeys a marginal interventional distribution, rather than merely reproducing conditional relationships, is not an easy task ( Havercroft and Didelez 2012 ) . Evans and Didelez 2024 ’s frugal parameterization provides a solution to this challenge by centring on the causal margin and adjusting the surrounding variables accordingly. This framework allows us to sample data from the target distribution, incorporate time‑varying covariates coherently, and ensures that subsequent inference targets the specified causal quantity ( Lin et al. 2025 ) . Consider covariates Z\in\mathbb{R}^{d_{z}} , treatment X\in\mathbb{R}^{d_{x}} , and outcome Y\in\mathbb{R}^{d_{y}} , along with their corresponding supports \mathcal{Z} , \mathcal{X} , \mathcal{Y} . The frugal parameterization decomposes the joint distribution \mathbb{P} of (Z,X,Y) into three components: ‘the past’ \mathbb{P}_{{\hskip-0.5ptZ\hskip-1.0ptX}} , which is the joint distribution of treatment and covariates that occur causally prior to the outcome Y ; the causal distribution of interest \mathbb{P}^{\ast}_{Y|X} ; and a (conditional) dependency parameter denoted by \phi^{\ast}_{ZY|X} . In line with Evans and Didelez 2024 , we mark quantities from the interventional (causal) distribution with an asterisk (*) and leave observational quantities unmarked. This parameterization allows data simulation with the marginal causal quantity specified. We note that, just as with the original frugal parameterization, the treatment can include some elements of the covariates, leading to a causal estimand that is conditional on those variables. The ability to simulate realistic data and to estimate causal parameters accurately are two sides of the same coin. Only by fitting the observational distribution well via flexible, robust estimators can we generate high-fidelity simulations that reproduce confounding structures, time-varying effects, and real-world heterogeneity. Those simulations, in turn, furnish ground-truth scenarios for stress-testing methods. In the original frugal parameterization, all the models were parametric and low-dimensional. While elegant and interpretable, its reliance on predefined functional forms can limit flexibility when fitting on real-data. In this paper, we introduce frengression , a new approach for frugal parametrization using deep generative models. Building on the distributional regression foundations of engression ( Shen and Meinshausen 2024 ) , frengression requires minimal tuning, extrapolates beyond the observed support, and delivers superior performance in both data simulation and causal estimation. 1.1 Contribution Frengression combines directly targeting the estimation of marginal causal quantities of interest, with the capacity to generate complex benchmark datasets, and so that the marginal causal distributions can be user-specified. This unified framework guarantees a precisely defined marginal effect while closely reflecting real-world conditions. Consistent with the frugal parameterization, frengression consists of variation independent components to isolate and control specific causal properties, such as the strength of confounding. We highlight some key properties of frengression: • Generative model for causal margin. Frengression is a flexible deep generative model for distributional regression that represents the entire outcome distribution while explicitly specifying the marginal interventional distribution of interest. Directly targeting the marginal quantity of interest allows for better estimation and more precise control. • Broad applicability. Our framework supports both estimation and simulation for a variety of (complex) settings, including distributional treatment effects, continuous treatments, longitudinal settings, and survival data. • Flexibility and robustness. Frengression factorizes the joint distribution according to a frugal, variation independent parameterization, enabling each component to be modelled with any suitable method (not limited to neural networks). The model fitting does not require extensive hyperparameter tuning, enhancing overall stability. • Theoretical guarantees. We provide a consistency guarantee for models trained with the finite-sample energy score, along with extrapolation guarantees under continuous treatments. 1.2 Related Work We review existing approaches to generative modelling for causal estimation and simulation and how they motivate our frengression framework. We summarize this comparison between frengression and other methods in Table 1 . Method Binary Treatment Continuous Treatment Longitudinal Data Distributional Treatment Effects Extrapolation Modelling Causal Margin TARNet CFRNet Dragonnet CEVAE ✓ \times \times \times \times \times CausalEGM CausalBGM ✓ ✓ \times \times \times \times RealCause Credence ✓ \times \times \times \times \times DeepACE ✓ \times only static treatment regime \times \times \times Deep LTMLE ✓ \times ✓ \times \times \times Frugal Flow ✓ ✓ \times \times \times ✓ Frengression ✓ ✓ ✓ ✓ ✓ ✓ Table 1: Comparison of methods. 1.2.1 (Deep) generative models for the causal margin Deep learning models have shown remarkable flexibility for causal estimation in high-dimensional, complex settings. For instance, TARNet and CFRNet learn shared representations that balance treated and control groups ( Shalit et al. 2017 ) , and Dragonnet incorporates the propensity score estimation directly into the outcome network ( Shi et al. 2019 ) . However, since they enforce covariate balance across treatment arms to mitigate confounding, these architectures are limited to binary treatments and static covariates; in particular, they cannot handle longitudinal data. Generative models offer a natural framework for modelling causal relationships. Indeed, structural equation models ( Pearl 2009 ) can be viewed in this way: the most straightforward method is to build generative models directly for the structural equations of each variable. In the nonparametric instrumental variable (IV) setting, Holovchak et al. 2025 applied this idea by proposing a distributional IV method

Read the complete text