Prediction-Intervention Games and Invariant Sets

Linus Kühne, Felix Schur, Jonas Peters · 2026

Read Prediction-Intervention Games and Invariant Sets by Linus Kühne, Felix Schur, Jonas Peters (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16828.txt.

Introduction

Kühne, Schur and Peters study prediction-intervention games, a Stackelberg setup where a leader predicts from data and a second player acts on inputs to max their goal. Finding a best plan is hard. To limit loss, the leader may predict from causal parents or a stable input subset. The authors prove that stable-blanket models, a stable subset, match causal-parent models for two second-player goal classes. They bound post-intervention risk by worst-case risk and give worst-case best rules, tested on mock data.

Catalog record

CREATORLinus Kühne, Felix Schur, Jonas Peters
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE114132
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16828

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Prediction-Intervention Games and Invariant Sets Linus Kühne, Felix Schur, Jonas Peters Abstract We consider the following two-player game: using observational data, the leader chooses a prediction function for a response variable Y Y from given covariates. The follower then reacts with an intervention on some covariates in the underlying structural causal model to maximize their own objective. The leader knows the intervention targets, but may have limited knowledge of the follower’s objective. We call this setup a prediction-intervention game, a special case of a Stackelberg game. Finding an optimal strategy for the leader is generally difficult. To avoid severe performance loss, the leader may base their prediction on the causal parents of Y Y , or more generally on an invariant subset of covariates. We prove, for two common classes of follower objectives, that predictors based on the stable blanket, a specific invariant subset, are always better or as good as those based on the causal parents. We further upper bound the leader’s post-intervention risk by a worst-case risk over allowed interventions and strengthen existing distribution generalization results to analyze this bound: we give sufficient conditions under which stable-blanket predictors are worst-case optimal, and show by examples that these conditions cannot in general be dropped. Finally, we discuss practical strategies for settings with known and unknown graph, and test them on simulated and real-world data. 1 Introduction We consider a two-player Stackelberg game for predicting a real-valued or binary response Y\in\mathcal{Y} from covariates X\in\mathcal{X} : based on a training distribution (or data), a leader commits to a prediction function f , and a follower (an individual subject to the prediction) observes or queries f and intervenes on some covariates to optimize their own, possibly non-adversarial, objective. The test distribution thus emerges only after the prediction function has been deployed, and can depend on that function. In particular, training and test distributions need not coincide. Example. Consider an insurer who prices policies with a function f predicting the probability that an individual will submit a claim. Suppose that f uses two covariates that are correlated with Y , but only one is causal: the car’s number of safety features and the car’s color. An individual i with access to f (such as through querying a website for a quote) may change their covariates from X_{i} to \tilde{X}_{i} (yielding \tilde{Y}_{i} ) to minimize f(\tilde{X}_{i}) and obtain a smaller premium. Installing safety features changes both the predicted and true probability of filing a claim: f(\tilde{X}_{i})\neq f({X_{i}}) and \mathbb{P}(\tilde{Y}_{i}=1)\neq\mathbb{P}(Y_{i}=1) . Choosing a car with a different color may instead yield f(\tilde{X}_{i})\neq f({X_{i}}) without changing the probability of filing a claim: \mathbb{P}(\tilde{Y}_{i}=1)=\mathbb{P}(Y_{i}=1) . A similar phenomenon occurs in usage-based car insurance, where Lee et al. 2025 show that temporarily monitoring drivers to price policies changes their behavior during that period, worsening prediction performance. Prediction-intervention games. We formalize the problem as a causal version of a Stackelberg game ( von Stackelberg 1934 ) , which we call a prediction-intervention game. The leader provides a prediction function f , and the follower reacts by choosing an intervention e^{*}(f) in a structural causal model (SCM) that maximizes their objective: e^{*}(f)\in\argmax_{e}V^{\mathrm{foll}}_{e}(f) . We model the allowed intervention targets as the children of an intervention node in the causal graph. Knowing the causal structure helps the leader design a prediction function that is robust under the follower’s interventions, that is, find \argmin_{f}R^{\mathrm{lead}}_{e^{*}(f)}(f) . In practice, the leader estimates R^{\mathrm{lead}}_{e} from data and may have only partial knowledge about the follower’s objective and possible interventions. Related work. Our work relates to strategic classification ( Hardt et al. 2016 ; Brückner and Scheffer 2011 ) , its causal extensions ( Miller et al. 2020 ; Shavit et al. 2020 ) , formulations with asymmetric leader/follower objectives ( Ehrenberg et al. 2025 ) , and performative prediction ( Perdomo et al. 2020 ) . Horowitz and Rosenfeld 2023 study binary strategic classification where covariates are split into causal and noncausal predictive ones. Their follower’s best response is a hard do-intervention on all observed covariates. Unlike existing work, we allow for more general follower interventions that target pre-specified nodes, may add edges to the causal graph, and we allow for flexible leader and follower objectives. Further, we focus on predictors based on different invariant subsets of covariates, connecting prediction-intervention games to causal distribution generalization ( Peters et al. 2016 ; Rojas-Carulla et al. 2018 ; Christiansen et al. 2022 ) ; in particular, we analyze predictions based on the stable blanket ( Pfister et al. 2021 ) . We provide and analyze a tight bound that builds a connection to worst-case distribution generalization ( Kuhn et al. 2025 ; Sagawa et al. 2020 ; Freni et al. 2025 ) , and extend and strengthen existing results for our setting. To our knowledge, the combination of more general SCM-constrained follower interventions, flexible leader/follower objectives, and worst-case analysis of predictors based on stable blankets is novel. Appendix A gives further details on the relation to existing work. Contributions. (i) We formally introduce prediction-intervention games and show how the intervention view connects to modeling a group of self-optimizing individuals ( Section 2 ). (ii) For two common classes of follower objectives, we argue that predicting based on causal parents is reasonable but generally suboptimal for the leader: using the stable blanket is often better and never worse ( Section 3 ). (iii) The worst-case risk over the possible interventions upper-bounds the leader’s post-intervention risk and does not require knowledge of the follower’s objective. This connects to distribution generalization and worst-case prediction. We strengthen existing results to give sufficient conditions under which predictors based on the stable blanket are worst-case optimal, and prove that in general these conditions cannot be dropped ( Section 4 ). (iv) We propose learning methods that the leader can use when they do not know the causal graph ( Section 5 ). (v) We test our methodology on simulated and real data ( Section 6 ). The source code to reproduce all experiments is available under github.com/LinusKuehne/prediction-intervention-games . 2 Prediction-intervention games The game. We assume that the leader’s task is to perform prediction; in this paper, we consider both regression and binary classification. Let Y\in\mathcal{Y} be a binary or continuous response with covariates X=(X_{1},\ldots,X_{d})\in\mathcal{X} . We use \mathcal{Y}\coloneqq\{0,1\} and \mathcal{A}\coloneqq[0,1] for classification, and \mathcal{Y}\coloneqq\mathbb{R} and \mathcal{A}\coloneqq\mathbb{R} for regression. The training data are generated by a structural causal model ( Pearl 2009 ; Bongers et al. 2021 , SCM;) \mathbb{C}_{0} over (X,Y,E) with induced distribution \mathbb{P}^{0} and DAG \mathcal{G}_{0} , in which E is a source node indexing environments. Each e\in\mathcal{E}_{0}\coloneqq\mathrm{supp}_{\mathbb{C}_{0}}(E) corresponds to a distribution \mathbb{P}^{0}_{e}\coloneq\mathbb{P}^{0}(\cdot\,|\,E=e) over (X,Y) . The leader has access to one or more training distributions \mathbb{P}^{0}_{e} (or i.i.d. samples thereof) for e\in\mathcal{E}_{\mathrm{tr}}\subseteq\mathcal{E}_{0} , and chooses a prediction function f\colon\mathcal{X}\to\mathcal{A} . We assume that \mathcal{G}_{0} is known unless stated otherwise. After observing f , the follower reacts by strategically choosing an environment e\in\mathcal{E} that maximizes a utility V^{\mathrm{foll}}_{e}(f) . Here, \mathcal{E} is a set of environments indexing distributions \mathbb{P}_{e} over (X,Y) that can occur after deployment of f ; these environments correspond to intervention distributions and we even allow for \mathcal{E}\supsetneq\mathcal{E}_{0} (below, we provide more details on the follower’s interventions). After

Read the complete text