Causality-Encoded Diffusion Models for Interventional Sampling and Edge Inference

Li Chen, Xiaotong ShenWei Pan · 2026

Read Causality-Encoded Diffusion Models for Interventional Sampling and Edge Inference by Li Chen, Xiaotong ShenWei Pan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21843.txt.

Introduction

Chen, Shen, and Pan propose causality-encoded diffusion models that respect a known directed acyclic graph. Standard diffusion models estimate complex distributions well but encode no causal structure. Diffusion models that follow the graph factoring yield a sampler that recovers what is observed and supports sampling after interventions, by fixing treated variables during reverse diffusion. An edge test based on resampling follows, with speed set by the largest local dimension and long-run control of false positives. A flow cytometry example shows practical use.

Catalog record

CREATORLi Chen, Xiaotong ShenWei Pan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63371
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21843

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causality-Encoded Diffusion Models for Interventional Sampling and Edge Inference Li Chen, Xiaotong ShenWei Pan Abstract Standard diffusion models are flexible estimators of complex distributions, but they do not encode causal structures and therefore do not by themselves support causal analysis. We propose a causality-encoded diffusion framework that incorporates a known directed acyclic graph by training conditional diffusion models consistent with the graph factorisation. The resulting sampler approximately recovers the observational distribution and enables interventional sampling by fixing intervened variables while propagating effects through the graph during reverse diffusion. Building on this interventional simulator, we develop a resampling-based test for directed edges that generates null replicates under a candidate graph. We establish convergence guarantees for observational and interventional distribution estimation, with rates governed by the maximum local dimension rather than the ambient dimension, and prove asymptotic control of type I error for the edge test. Simulations show improved interventional distribution recovery relative to baselines, with near-nominal size and favourable power in inference. An application to flow cytometry data demonstrates practical utility of the proposed method in assessing disputed signalling linkages. Keywords: causal generative modelling, diffusion models, directed acyclic graphs, edge inference, interventional sampling 1 Introduction Diffusion models [ 40 , 14 , 41 ] have emerged as a powerful class of generative models, achieving state-of-the-art performance across a wide range of applications, including imaging [ 14 ] and scientific-data synthesis [ 37 ] . From a statistical perspective, they can be viewed as flexible nonparametric estimators of a (conditional) distribution via score estimation and reverse-time stochastic differential equations (SDEs) [ 1 , 23 ] . Despite this expressive power, standard diffusion models are typically causality-agnostic : they learn a joint law without encoding the directional asymmetries required for causal interpretation. As a consequence, they do not, on their own, provide principled answers to interventional queries or support broader causal analyses, which are central to structural causal models (SCMs) [ 31 ] . When a causal ordering (or a directed acyclic graph) is available, it is natural to construct generative procedures that sample variables sequentially according to the causal factorisation. Such iterative, ordering-respecting approaches have been proposed using a variety of generative models, including generative adversarial networks [ 22 ] , variational autoencoders [ 19 ] , normalising flows [ 30 ] , and diffusion-based constructions such as DDIM [ 7 ] . However, a rigorous statistical understanding of the advantages of exploiting such causal structure and the inferential use of the resulting generator remain less developed. In parallel, a recent line of work has sought to alleviate the curse of dimensionality in diffusion models. For instance, 17 , 25 , 32 provide convergence guarantees suggesting that sampling complexity may scale with an intrinsic, rather than ambient, dimension under suitable conditions. These results primarily address sampling complexity, whilst accurate score estimation can remain a bottleneck. Complementarily, 10 , 44 study score approximation and distribution recovery under manifold structure, deriving rates that reflect the underlying geometry, though their manifold assumptions may be restrictive in practice. 46 instead considers dimension reduction through transfer learning, assuming a shared low-dimensional latent representation between target and auxiliary data. However, identifying auxiliary sources that enable positive transfer can be challenging. Our work offers a different perspective: when a causal structure is available, we show theoretically that distribution recovery for an iterative, DAG-respecting generative procedure is governed by a maximum local dimension (a node together with its parents), rather than by the ambient dimension. This yields a principled route to dimension reduction that is structural rather than geometric. A separate but related challenge concerns statistical inference for directed edges in DAG models. Recent work has developed methods that attach explicit measures of uncertainty to individual edges, including debiased estimators and confidence intervals for edge weights [ 18 ] , constrained likelihood ratio tests [ 24 , 8 ] , and neural-network-based hypothesis testing [ 38 ] . These approaches often rely on Gaussian linear or additive-noise assumptions, and extending them to general nonlinear and non-additive settings is non-trivial. Another broad literature studies conditional independence testing (CIT); see, for example, 6 , 5 , 45 . Leveraging diffusion models as powerful conditional generative tools, we use resampling-based CIT as a core building block for edge testing. Combined with a new multivariate conditional dependence coefficient tailored to our null-generation mechanism, our inference procedure imposes minimal restrictions on the underlying DAG model, substantially broadening the scope of existing DAG inference methods. The contributions of this paper are threefold: (a) Methodology. We introduce Causality-Encoded Diffusion Models (CEDM), a score-based generative framework that respects causal structure, together with samplers for both observational and \mathrm{do} -interventional distributions. Building on this \mathrm{do} -sampling capability, we develop CEDM-based inference (CEDMI), a resampling-based procedure that fits a CEDM under the relevant null graph and uses the resulting generator to test targeted directed edges. (b) Statistical guarantees. We establish convergence guarantees for observational and interventional sampling error in total variation distance, with rates governed by the maximum local dimension rather than the ambient dimension. We also prove asymptotic type I error control for CEDMI. (c) Empirical validation. Through extensive simulation studies, we show that CEDM improves conditional expectation estimation relative to the compared baselines, and that CEDMI combines well-controlled size with favourable power relative to the competing methods. A flow cytometry application further illustrates how the method can be used to assess disputed edges within a scientifically motivated working graph. The remainder of the paper is organised as follows. Section 2 introduces CEDM and its training objective. Section 3 develops \mathrm{do} -distribution sampling and the CEDMI edge test. Section 4 presents theoretical guarantees for observational and interventional sampling, as well as inference validity. Section 5 reports numerical studies on simulated graphs and a flow cytometry signalling network. Finally, Section 6 concludes the article and discusses future directions. Additional simulations and technical proofs are provided in the Supplementary Materials [ 9 ] . 2 Causality-encoded diffusion models Let \bm{X}=(\bm{X}_{1}^{\top},\ldots,\bm{X}_{p}^{\top})^{\top} be a collection of random vectors, where each node j\in\mathcal{V}:=\{1,\ldots,p\} corresponds to a d_{j} -dimensional random vector \bm{X}_{j}\in\mathbb{R}^{d_{j}} , and the total dimension is d=\sum_{j=1}^{p}d_{j} . We assume that \bm{X} is generated by structural causal models [ 31 ] of the form \bm{X}_{j}=\bm{g}_{j}\bigl(\bm{X}_{\mathrm{pa}(j)},\bm{U}_{j}\bigr),\quad j\in\mathcal{V}, (1) where \mathrm{pa}(j)\subseteq\mathcal{V}\setminus\{j\} denotes the parent set of node j in a given directed acyclic graph (DAG), and \bm{X}_{\mathrm{pa}(j)}:=(\bm{X}_{k})_{k\in\mathrm{pa}(j)} collects the corresponding parent variables (concatenated into a single vector when convenient). The functions \bm{g}_{j} characterise the parent–child mechanisms, and the noise vectors \{\bm{U}_{j}\}_{j=1}^{p} are assumed to be mutually independent. 2.1 Causality-encoded diffusion process We next couple the structural causal model ( 1 ) with a diffusion-based generative mechanism. Diffusion models synthesise data by learning to reverse a stochastic process that progressively perturbs the data distribution with Gaussian noise [ 40 , 14 , 41 ] . We first recall the forward diffusion and its reverse-time formulation, and then describe how to encode the causal structure ( 1 ) into the reverse dynamics. General diffusion process. Let p_{0} denote the data distribution of \bm{X}\in\mathbb{R}^{d} at time t=0 . The forward diffusion process gradually adds Gaussian noise via \mathrm{d}\bm{X}(t)=-\frac{1}{2}\,\bm{X}(t)\,\mathrm{d}t+\mathrm{d}\bm{W}(t),\qquad\bm{X}(0)\sim p_{0}, (2) where \bm{W}(t) is a standard Wiener process in \mathbb{R}^{d} . Let p_{t} denote the law of \bm{X}(t) .

Read the complete text