Learning Joint Interventional Effects from Single-Variable Interventions in Additive Models

Armin Kekić, Sergio Hernan Garrido Mejia, Bernhard Schölkopf · 2025

Read Learning Joint Interventional Effects from Single-Variable Interventions in Additive Models by Armin Kekić, Sergio Hernan Garrido Mejia, Bernhard Schölkopf (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04945.txt.

Introduction

Armin Kekic, Sergio Garrido Mejia, and Bernhard Scholkopf asked in 2025 whether joint effects can be learned from single-variable data. The case is changing several variables at once, while data cover only one change at a time. Joint intervention data are hard to get in many fields, yet joint effects are what decision makers need.

For a class of nonlinear additive outcome models, they prove that joint effects can in fact be identified. The proof uses observational data plus single-variable interventions. Their estimator splits each effect into confounded and unconfounded parts. On synthetic data, it matched models trained on true joint data and beat a purely observational estimator, which supports the approach for real use.

Catalog record

CREATORArmin Kekić, Sergio Hernan Garrido Mejia, Bernhard Schölkopf
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04945

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Joint Interventional Effects from Single-Variable Interventions in Additive Models Armin Kekić, Sergio Hernan Garrido Mejia, Bernhard Schölkopf Abstract Estimating causal effects of joint interventions on multiple variables is crucial in many domains, but obtaining data from such simultaneous interventions can be challenging. Our study explores how to learn joint interventional effects using only observational data and single-variable interventions. We present an identifiability result for this problem, showing that for a class of nonlinear additive outcome mechanisms, joint effects can be inferred without access to joint interventional data. We propose a practical estimator that decomposes the causal effect into confounded and unconfounded contributions for each intervention variable. Experiments on synthetic data demonstrate that our method achieves performance comparable to models trained directly on joint interventional data, outperforming a purely observational estimator. 1 Introduction Understanding the effects of interventions is fundamental across many domains, from designing public health policies to optimizing business operations and administering medical treatments. Particularly challenging and important are joint interventional effects, where simultaneous interventions on multiple action variables influence a target outcome. Such scenarios are common in fields like epidemiology ( Kekić et al. 2023a ) , e-commerce ( Kunz et al. 2023 ; Schultz et al. 2023 ) , and medicine ( Prosperi et al. 2020 ) . Consider a company trying to optimize their marketing strategy across multiple channels like social media, email campaigns, and display advertising. While the ultimate goal is to understand how these channels work together to drive sales, running experiments for every possible combination of marketing interventions would be prohibitively expensive and time-consuming, as the number of required test conditions grows exponentially with each additional channel. This raises a crucial question: Can we learn about joint effects from simpler experiments? We investigate whether joint interventional effects can be estimated using only observational data and experiments where we intervene on one variable at a time. This is an instance of the Intervention Generalization Problem ( Bravo-Hermsdorff et al. 2023 ) : predicting treatment effects in previously unseen interventional settings. Causal models encode additional structural relationships between variables that allow us to generalize to settings in which non-causal machine learning approaches assuming independent, identically distributed (i.i.d.) data fail. However, this problem is not solvable in its most general form. To achieve Intervention Generalization, we need to restrict the causal model class ( Saengkyongam & Silva 2020 ) . The key question becomes: What model class restrictions enable this generalization while preserving broad applicability? Y A_{1} A_{2} \cdots A_{K} C_{1} C_{2} \cdots C_{K} \mathrm{P}^{\mathcal{M}} observational Y A_{1} A_{2} \cdots A_{K} C_{1} C_{2} \cdots C_{K} \mathrm{P}^{\mathcal{M}(\mathrm{do}(A_{1}))} Y A_{1} A_{2} \cdots A_{K} C_{1} C_{2} \cdots C_{K} \mathrm{P}^{\mathcal{M}(\mathrm{do}(A_{K}))} \cdots single interventions Y A_{1} A_{2} \cdots A_{K} C_{1} C_{2} \cdots C_{K} \mathrm{P}^{\mathcal{M}(\mathrm{do}(A_{1},\mathinner{\ldotp\kern-2.01596pt\ldotp\kern-2.01596pt\ldotp},A_{K}))} joint interventions training prediction Figure 1: The Intervention Generalization Problem. The figure shows the different interventional regimes. Our goal is to estimate the joint interventional effect of the action variables \{A_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},A_{K}\} on Y , that is, \mathbb{E}[Y\mid\mathrm{do}(a_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},a_{K})] (right). However, during training we only have access to observational (left) and single-interventional data (middle). There are unobserved confounders \{C_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},C_{K}\} between the actions and the outcome variable Y . A box around a variable indicates that it was intervened on. In this study, we focus on causal models where each action contributes to the outcome variable in a nonlinear way and is subject to confounding. We show that when these complex individual effects combine additively to produce the outcome, the joint interventional effect is identifiable from observational and single-intervention data. This additivity assumption is well-motivated across several domains—for instance, in pharmacology where many drug combinations exhibit approximately additive effects in the absence of specific interaction mechanisms ( Pearson et al. 2023 ) , and in marketing analytics where additive models are widely used to understand how multiple advertising channels influence consumer behavior ( Jin et al. 2017 ; Chan & Perry 2017 ) . Our main contributions are: 1. An identifiability result showing that joint interventional effects can be recovered from single-variable interventions and observational data in causal models with a nonlinear additive outcome mechanism 2. A practical estimator that decomposes the causal effect into confounded and unconfounded contributions for each intervention variable 3. Empirical validation demonstrating that our method achieves performance comparable to models trained directly on joint interventional data 2 Problem Statement 2.1 Background and Notation We use boldface for vector-valued or sets of random variables. We denote random variables with capital letters and realizations thereof in lowercase. Definition 1 (SCM ( Pearl 2009 ; Peters et al. 2017 ) ) . An N -dimensional structural causal model is a triplet \mathcal{M}=(\mathcal{G},\mathbb{S},P_{\mathbf{U}}) consisting of: • a joint distribution \mathrm{P}_{\mathbf{U}} over the jointly independent “exogenous” variables \mathbf{U}=\{U_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},U_{N}\} , • a directed acyclic graph \mathcal{G} with N vertices, • a set \mathbb{S}=\{X_{j}\coloneqq f_{j}(\textbf{Pa}_{j},U_{j}),j=1,\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},N\} of structural assignments, where each f_{j} is a scalar-valued function and \textbf{Pa}_{j} are the variables indexed by the set of parents of node j in \mathcal{G} , such that for every \mathbf{u} , the system \{x_{j}\coloneqq f_{j}(\textbf{pa}_{j},u_{j})\} has a unique solution. The SCM thus entails a joint distribution over the “endogenous” random variables \mathbf{X}=\{X_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},X_{N}\} . Interventions in SCMs. Interventions on endogenous variables in SCMs are represented by the \mathrm{do}(\cdot) -operator and modify how variables are assigned their values. A perfect stochastic intervention \mathrm{do}(X_{i}) removes all incoming edges to the intervened variable and replaces its structural assignment with a draw from an intervention distribution over X_{i} . That is, we replace the structural assignment X_{k}\coloneqq f_{k}(\textbf{Pa}_{k},U_{k}) by X_{k}\coloneqq\tilde{U}_{k} , where \tilde{U}_{k} is a univariate distribution independent of the parents \textbf{Pa}_{k} . We use lowercase letters to denote specific realizations of these interventions, writing \mathrm{do}(x_{i}) to indicate that X_{i} was set to the particular value x_{i} . Such interventions transform the original model \mathcal{M} into an interventional model \mathcal{M}(\mathrm{do}(X_{i})) that induces a modified distribution over the endogenous variables, which we denote with a superscript \mathrm{P}^{\mathcal{M}(\mathrm{do}(X_{i}))} . When no superscript is present, the distribution comes from the unintervened (observational) model \mathcal{M} . In conditioning sets, we write \{x_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},\mathrm{do}(x_{i}),\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},x_{n}\} to indicate that X_{i} was intervened on while other variables have observational realizations. 2.2 Setting Let \mathbf{A}=\{A_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},A_{K}\} be a set of treatment or action variables, \mathbf{C}=\{C_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},C_{K}\} be a set of unobserved confounders , and Y be an outcome variable. The actions are direct causes of the outcome, and we allow for an arbitrary acyclic causal structure among the actions. For notational simplicity, we assume the actions are in topological order and write the causal structure as a fully connected DAG. 1 1 1 This means that each action variable A_{k} can potentially depend on all preceding actions \{A_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},A_{k-1}\} and confounders \{C_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},C_{k-1}\} . We can write the structural assignments as follows: \displaystyle Y \displaystyle\coloneqq f(A_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},A_{K},C_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},C_{K},U) (1) \displaystyle A_{k} \displaystyle\coloneqq g_{k}(A_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},A_{k-1},C_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},C_{k-1},V_{k}) (2) \displaystyle C_{k} \displaystyle\coloneqq W_{k} (3) for \displaystyle\ k\in\{1,\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},K\} where \{U,V_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},V_{K},W_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},W_{K}\} are mutually independent exogenous noise variables. We are given a dataset of observational i.i.d. samples \mathrm{D}_{\mathrm{obs}}\sim\mathrm{P}^{\mathcal{M}}_{(Y,\mathbf{A})} (4) and K datasets of i.i.d. samples for single-variable interventions on each action variable \{\mathrm{D}^{k}_{\mathrm{int}}\sim\mathrm{P}^{\mathcal{M}(\mathrm{do}(A_{k}))}_{(Y,\mathbf{A})}\}_{k=1}^{K}\,. (5) Here, each interventional dataset \mathrm{D}^{k}_{\mathrm{int}} consists of samples generated under perfect stochastic interventions on A_{k} . Our objective is to estimate the joint interventional effect \mathbb{E}\left[Y\mid\mathrm{do}(a_{1},\mathinner{\ldotp\kern-1.99997pt\ldotp\kern-1.99997pt\ldotp},a_{K})\right]\,. (6) Identifiability. For a given class of causal models, we say that a

Read the complete text