Regret-Based Federated Causal Discovery with Unknown Interventions
Federico Baldo, Charles K. Assaad · 2025
Read Regret-Based Federated Causal Discovery with Unknown Interventions by Federico Baldo, Charles K. Assaad (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23626.txt.
Introduction
Federico Baldo and Charles Assaad tackle causal discovery when the data live in separate hands. Hospitals and other institutions cannot pool their records, yet each wants the causal structure behind them. Federated causal discovery handles the privacy problem, but usually assumes every client shares the same causal model, an assumption real policies and protocols break through client-specific interventions.
Their algorithm, I-PERI, first recovers the causal graph class shared across clients, then exploits structural differences created by the unknown interventions to orient extra edges. The result is a tighter equivalence class than standard methods return, with its own graphical representation. The authors prove convergence and privacy guarantees for the method, and synthetic experiments support its effectiveness. The work is slated for ICML 2026.
Catalog record
| CREATOR | Federico Baldo, Charles K. Assaad |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-23626
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Regret-Based Federated Causal Discovery with Unknown Interventions Federico Baldo, Charles K. Assaad Abstract Most causal discovery methods recover a completed partially directed acyclic graph representing a Markov equivalence class from observational data. Recent work has extended these methods to federated settings to address data decentralization and privacy constraints, but often under idealized assumptions that all clients share the same causal model. Such assumptions are unrealistic in practice, as client-specific policies or protocols, for example, across hospitals, naturally induce heterogeneous and unknown interventions. In this work, we address federated causal discovery under unknown client-level interventions. We propose I-PERI, a novel federated algorithm that first recovers the CPDAG of the union of client graphs and then orients additional edges by exploiting structural differences induced by interventions across clients. This yields a tighter equivalence class, which we call the 𝚽 \mathbf{\Phi} -Markov Equivalence Class, represented by the 𝚽 \mathbf{\Phi} -CPDAG. We provide theoretical guarantees on the convergence of I-PERI, as well as on its privacy-preserving properties, and present empirical evaluations on synthetic data demonstrating the effectiveness of the proposed algorithm. 1 Introduction Discovering causal structures from observational and interventional data is a challenging task at the core of many scientific disciplines. Indeed, recovering causal relationships among variables is key to causal effect estimation, as it allows for the identification of confounding variables 13 ; 15 ; 7 . Many causal discovery algorithms ( 15 ; 4 ; 14 ; 1 ) aim to recover, from observational data, a completed partially directed acyclic graph (CPDAG) ( 3 ) , which represents the Markov equivalence class ( 17 ) of an underlying causal graph. These methods typically assume access to a centralized dataset. In many real-world scenarios, however, data are inherently decentralized and cannot be pooled due to practical or legal constraints. This has motivated growing interest in federated learning 9 , where data are distributed across multiple clients, for example, hospitals, institutions, or organizations, each of which holds its own local dataset.A central server coordinates the learning process by aggregating information communicated by the clients, without accessing their individual datasets. Beyond decentralization, federated approaches are particularly appealing in domains where data sharing is restricted by regulatory requirements, data ownership constraints, or privacy concerns. However, the challenge of designing privacy-preserving federated causal discovery algorithms has been largely overlooked in many existing works. Recent works ( 12 ; 11 ; 10 ) have addressed these challenges in an idealized setting, where all clients’ data are assumed to be generated from the same underlying causal model, with no interventions, and thus share an identical causal graph. This assumption is frequently unrealistic in real-world applications. For instance, in healthcare scenarios, different hospitals may adopt distinct treatment policies, diagnostic protocols, or patient inclusion criteria. These differences naturally induce client-specific interventions and lead to heterogeneous causal mechanisms. In this paper, we study the problem of federated causal discovery under unknown client-level interventions. We propose I-PERI, a novel federated causal discovery algorithm capable of handling unknown interventions at the client level while ensuring differential privacy. I-PERI is an extension of the recently proposed PERI algorithm 11 ; this method assumes that all clients share the same causal structure, and it is capable of discovering the CPDAG common to all clients from purely observational data in a differentially private fashion. I-PERI extends PERI to leverage interventional data by introducing a two-phase approach: first, it learns the CPDAG corresponding to the union of all client causal graphs by adapting PERI algorithm to interventional data; then, it refines the learned structure by orienting additional edges, exploiting structural differences induced by interventions across clients. More specifically, our contributions are threefold: • We introduce the \mathbf{\Phi} -Markov Equivalence Class of DAGs under a set of unknown interventions in a federated setting, which forms a tighter equivalence class than the standard Markov equivalence class, along with a representative graph for this class, the \mathbf{\Phi} -CPDAG. • We propose I-PERI, a novel algorithm for federated causal discovery that effectively combines observational and interventional data from multiple clients while ensuring differential privacy and without knowing the interventional targets. • We provide theoretical guarantees on the convergence of I-PERI, as well as on its privacy-preserving properties, and present empirical evaluations on synthetic data demonstrating the effectiveness of the proposed algorithm. The remainder of this paper is organized as follows. Section 2 introduces the necessary background and preliminaries. Section 3 presents the proposed framework and algorithm. Section 4 provides experimental results and empirical evaluations. Finally, Section 5 concludes the paper and discusses future directions. 2 Preliminaries & Problem Setup In this section, we introduce the notations and concepts used throughout the paper, outline the problem, and present key methodological insights. Causal Graphs. A causal directed acyclic graph (DAG) is a graphical representation of causal relationships between random variables. More formally, G=(\mathbb{V},\mathbb{E}) is a DAG where \mathbb{V}={V_{1},V_{2},\ldots,V_{d}} is the set of nodes representing random variables and \mathbb{E}\subseteq\mathbb{V}\times\mathbb{V} is the set of directed edges representing direct causal relationships between the variables. We denote with P_{\emptyset} the joint probability distribution over \mathbb{V} that factorizes according to the causal DAG G as follows: P_{\emptyset}(\mathbb{V})=\prod_{i}P_{\emptyset}(V_{i}|V_{pa^{G}_{V_{i}}}) where pa^{G}_{V_{i}} are the parents of V_{i} in G . We also denote the skeleton of the graph, Skel(G) , as the unoriented version of the DAG, i.e., the graph obtained by removing the directionality of the edges. A key notion in DAGs is d-separation, denoted \perp\!\!\!\!\perp_{G} , which encodes the conditional independencies implied by the graph. Causal discovery aims at learning the causal DAG G or rather a partially oriented version of the DAG from data sampled from the joint distribution P_{\emptyset} . In general, a causal DAG or its partially oriented version cannot be discovered from observational data without additional assumptions. In this work, we adopt two standard assumptions commonly used in discovery methods. The first is the causal sufficiency assumption, which posits that all common causes of the observed variables are themselves observed, i.e., there are no latent confounders. The second is the faithfulness assumption, which states that all and only the conditional independencies present in the distribution P_{\emptyset} are implied by d-separation. Federated causal discovery aims to learn a global graph at a central server, given a distributed setting. In this paper, we focus on federated algorithms that provide privacy-preserving guarantees by design, without relying on cryptographic techniques. For example, let us consider multiple hospitals conducting different clinical trials; in this context, we might want to learn a graph from the joint data while preserving patient privacy. We assume to have K clients, each holding a local dataset \mathbb{D}^{k} , for k\in{1,\ldots,K} . Each dataset involve the same set of variables \mathbb{V}={V_{1},\ldots,V_{d}} , and may contain different numbers of samples, n^{1},\ldots,n^{K} . In most existing works, clients’ data are assumed to be generated from the same underlying causal DAG G over \mathbb{V} , which is ideally the one we want to recover at the server level. This assumption is often unrealistic in practice. In our example, the different clinical trials might involve distinct treatment protocols, eligibility criteria, and intervention strategies. As a result, patient data are generated under hospital-specific interventions, leading to heterogeneous causal structures. Interventions. The causal DAG, alongside the joint distribution P , allow us