The Decoupled Risk Landscape in Performative Prediction
Javier Sanguino Bautiste, Thomas Kehrenberg, Jose A. Lozano, Novi Quadrianto · 2025
Read The Decoupled Risk Landscape in Performative Prediction by Javier Sanguino Bautiste, Thomas Kehrenberg, Jose A. Lozano, Novi Quadrianto (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-09044.txt.
Introduction
Javier Sanguino Bautiste and co-authors expose a risk in 2025 when AI models shape the data they later learn from. A bank's loan model, for instance, changes how people apply, which changes future data. Past theory assumed the model an institution uses is the same one the public sees and reacts to.
The authors model the split case, where the shown model differs from the hidden one in real use. They prove the institution can gain lower risk this way than under the honest setup. They even give a method that reliably finds such gains, and a measure for the deception users bear. Adding a self-set cost for that deception did not protect users, so the authors call for outside rules.
Catalog record
| CREATOR | Javier Sanguino Bautiste, Thomas Kehrenberg, Jose A. Lozano, Novi Quadrianto |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-09044
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Decoupled Risk Landscape in Performative Prediction Javier Sanguino Bautiste, Thomas Kehrenberg, Jose A. Lozano, Novi Quadrianto Abstract Performative Prediction addresses scenarios where deploying a model induces a distribution shift in the input data, such as individuals modifying their features and reapplying for a bank loan after rejection. Literature has had a theoretical perspective giving mathematical guarantees for convergence (either to the stable or optimal point). We believe that visualization of the loss landscape can complement this theoretical advances with practical insights. Therefore, (1) we introduce a simple decoupled risk visualization method inspired in the two-step process that performative prediction is. Our approach visualizes the risk landscape with respect to two parameter vectors: model parameters and data parameters. We use this method to propose new properties of the interest points, to examine how existing algorithms traverse the risk landscape and perform under more realistic conditions, including strategic classification with non-linear models. (2) Building on this decoupled risk visualization, we introduce a novel setting – extended Performative Prediction – which captures scenarios where the distribution reacts to a model different from the decision-making one, reflecting the reality that agents often lack full access to the deployed model. 1 Introduction Over the past decade, Machine Learning (ML) has been applied in numerous real-world scenarios that directly influence individuals’ behaviors. Consider, for instance, a model used to approve bank loans. When applicants are rejected, they often modify their data,such as improving credit scores or altering income,before reapplying to increase their perceived chances of approval. Performative Prediction (PP) [ 1 ] studies this interaction between ML models and their environment by considering distributional shifts that happen upon model deployment. Specifically, it assumes that the distributional shift is described by a distribution map \mathcal{D}(\theta) , that maps the model parameters \theta to the new distribution of the environment. Typically, PP is described as a two-step iterative process that requires retraining. First, a model is trained on the current distribution (resulting in model \theta ). Then, upon deployment, its predictions trigger a distribution shift (modeled by the distribution map \mathcal{D}(\theta) ), which results in a misalignment of the model with the new data, requiring a new training step. PP defines two solutions: (1) stability , a state where the predictive framework reaches equilibrium, and the distribution shifts no longer result in changes to the model after retraining and (2) optimality , where the framework achieves the best possible performance within this closed-loop interaction. Since its introduction, works on PP have followed a theoretical point of view, relying on strong assumptions to ensure mathematical guarantees for convergence to the stable or to the optimal point. Inspired by other fields like deep learning [ 2 , 3 , 4 ] , we believe that visualization can give practical information that complements the theoretical advances of the field. To this end, we introduce a simple visualization technique based on decoupling the predictive model, \theta_{M} , from the model that the distribution reacts to, \theta_{D} , which is used as input for the distribution map: \mathcal{D}(\theta_{D}) . We use this visualization to gain insights into questions like: what are the practical differences between an stable and optimal point? How do certain algorithm converge? Or what happens if assumptions are not met? Building on this visualization, we introduce a novel setting – Extended Performative Prediction (EPP) – that frees PP from the requirement that the distribution reacts to the same predictive model, i.e., we allow \theta_{M}\neq\theta_{D} , which is more realistic in practice. For example, a bank is unlikely to grant access to the users to the true model that they use to give loans. 1.1 Our Contributions The goal of this paper is to gain practical insights on Performative Prediction and to consider a more realistic setting. Specifically: • We present a simple visualization method based on the decoupled performative risk that allows to visualize the path taken by different optimization algorithms in PP and can be use to analyse the non-convex performative risk in realistic setups. • We propose new properties of the stable and optimal points with the insights provided by the visualization based and show how they can be used to practically. • We propose a new framework where the optimization is freed from the requirement that model parameters \theta_{M} are identical to those used in the distribution map \mathcal{D}(\theta_{D}) . This allows to consider more realistic settings. We also release a new library 1 1 1 Accessible at https://github.com/wearepal/performativeGYM that contains the visualization of several examples. It also implements past algorithms and is flexible enough to be used as a toolkit to support the development and comparison of algorithms. 1.2 Related work Targeting stability. In their seminal work, Perdomo et al. 2020 established two solutions concepts performative stability and performative optimality , and presented two algorithms for reaching performative stability under certain conditions, based on re-training: Repeated Gradient Descent (RGD) and Repeated Risk Minimization (RRM). Under further assumptions, the stable point is close to the optimal point . Subsequent research has focused on modifying the original assumptions [ 5 , 6 , 7 , 8 , 9 ] . However, Kabra and Patel 2024 studied the limitations of the assumptions by pointed out that if the assumptions are even slightly violated, convergence can become a problem. Targeting optimality. Other works have focused on optimizing for the performatively optimal point directly. The challenge is calculating the performative gradient . Izzo et al. 2021 solve it using the REINFORCE method [ 12 ] , that is limited to distribution maps with a known functional form. Miller et al. 2021 solve it assuming a specific \mathcal{D}(\theta) is a linear scale family. Cyffers et al. 2024 proposed using reparametrization trick [ 15 ] thanks to assuming a push-forward model. Changing assumptions. In parallel, past works on PP have changed the original assumptions to fit more realistic cases. One prominent line of research has been Stateful PP [ 6 ] , which considers the case where the distribution is affected by all previously deployed models. There have also been some efforts to consider approximations of the distribution map [ 16 , 17 ] . Additionally, Ghalme et al. 2021 consider that the users estimate the model in a strategic classification setting 2 Background on Performative Risk and Solution Points Let \mathcal{Z} denote a data space of interest. In the case of classification, we would have \mathcal{Z}=\mathcal{X}\times\mathcal{Y} where \mathcal{X} is the feature space and \mathcal{Y} is the label space. The goal is to train a model with model parameters \theta\in\Theta . The learning objective is to minimize a loss function \ell:\mathcal{Z}\times\Theta\to\mathbb{R} , which depends on the model parameters. The main characteristic of PP problems is, however, that there is no fixed data distribution over which to minimize the expected loss. Once deployed, a model \theta induces a shift in the distribution. This dependency is modeled by the distribution map : \mathcal{D}:\Theta\to\Delta(\mathcal{Z}) , where \Delta(\mathcal{Z}) denotes the set of distributions over \mathcal{Z} . One can evaluate the model’s performance under this distribution shift with the performative risk \mathit{PR}(\theta)=\mathbb{E}_{z\sim\mathcal{D}(\theta)}\big[\ell(z;\theta)\big]~, (1) which is the expected loss on the distribution that the model itself induces – which is not the distribution the model was trained on.