Clustering and Pruning in Causal Data Fusion

Otto Tabell [email protected] · 2025

Read Clustering and Pruning in Causal Data Fusion by Otto Tabell [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15215.txt.

Introduction

Otto Tabell, Santtu Tikka, and Juha Karvanen shrink causal models before fusing data from several sources, in a 2025 paper. Data fusion mixes observational and experimental evidence to identify cause-and-effect links that neither source pins down alone. The general tool, do-calculus, buckles as graphs grow.

Their preprocessing offers two cuts: prune variables that cannot matter, and cluster variables into combined units. The authors generalize earlier single-source results and give conditions for applying both cuts across many sources. They also show when identifiability in a shrunken graph settles the question for the full graph, and how to recover the identifying formula when the answer is yes. Examples from epidemiology and social science demonstrate the workflow.

Catalog record

CREATOROtto Tabell [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15215

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Clustering and Pruning in Causal Data Fusion Otto Tabell [email protected] Abstract Data fusion—the process of combining observational and experimental data—can enable the identification of causal effects that would otherwise remain non-identifiable. Although identification algorithms have been developed for specific scenarios, do-calculus remains the only general-purpose tool for causal data fusion, particularly when variables are present in some data sources but not others. However, approaches based on do-calculus may encounter computational challenges as the number of variables increases and the causal graph grows in complexity. Consequently, there exists a need to reduce the size of such models while preserving the essential features. For this purpose, we propose pruning (removing unnecessary variables) and clustering (combining variables) as preprocessing operations for causal data fusion. We generalize earlier results on a single data source and derive conditions for applying pruning and clustering in the case of multiple data sources. We give sufficient conditions for inferring the identifiability or non-identifiability of a causal effect in a larger graph based on a smaller graph and show how to obtain the corresponding identifying functional for identifiable causal effects. Examples from epidemiology and social science demonstrate the use of the results. Otto Tabell, Santtu Tikka and Juha Karvanen † † heading: 2025 1- 5/25 † † shortheadings: Clustering and Pruning in Causal Data Fusion / Tabell, Tikka and Karvanen keywords causal inference, graph theory, identifiability, identification invariance, multiple data sources 1 Introduction The modern data landscape integrates data from multiple sources such as experiments, surveys, registries, and operational systems. In causal data fusion, the goal is to combine these data sources to identify a causal effect that cannot be identified from a single input distribution ( datafusion ; shi2023data ; colnet2024causal ) . We call this the general causal effect identification problem. The potential application areas include, for instance, medicine ( dahabreh2023efficient ; li2020causal ) , ecology ( spake2022improving ) and econometrics ( hunermund2023causal ) . The theoretical understanding of the general causal effect identification problem is still partial. While do-calculus ( pearl1995 ) is complete for causal effect identification with a single observational data source ( shpitser2006 ; huang2006 ) , a similar result has not been derived in the context of multiple data sources of unrestricted form. Algorithms for special cases of causal data fusion have been reviewed by tikka2021dosearch . The more recent developments include the corrected g-identifiability algorithm with a positivity assumption ( kivva2022revisiting ) and an algorithm for data fusion under systematic selection ( lee2024systematic ) . All of these algorithms have important restrictions regarding their input distributions. For instance, g-identifiability ( lee2019gid ; kivva2022revisiting ) and g-transportability ( lee2020generalized ) are constrained by the assumption that entire distributions are available, meaning that the union of observed and intervened variables must always be the set of all endogenous variables in the model. As an example, this means that besides direct application of do-calculus, there does not currently exist an identification algorithm that could determine the identifiability of p(y\,|\,\mathrm{do}(x)) in the graph X\rightarrow Z\rightarrow Y from the input distributions p(x,z) and p(z,y) . For more general cases with no constraints on the input distributions, Do-search ( tikka2021dosearch ) has been suggested. Do-search is an algorithm that applies do-calculus and standard probability manipulations to determine the identifiability of a causal effect with given input distributions without constraints. However, as a consequence of the search-based nature of the algorithm, it becomes computationally expensive as the number of variables increases. The poor scalability of search-based identification algorithms also motivates the preprocessing efforts to reduce the size of the causal graph and thus decrease the number of variables. Importantly, if a causal graph is modified in any way, there is no guarantee that inferences made in the modified graph are transferable back to the original graph. Ideally, a method to reduce the size of causal graphs should not affect the identifiability of the causal effect of interest but such methods are scarce. In clustering, the aim is to represent a larger set of, typically related, vertices in a graph as a smaller set of vertices ( schaeffer2007clustering ; malliaros2013clustering ) . There are several examples of finding clusters and implementing clustering in causal graphs ( anand2023causal ; zeng2025causal ; niu2022learning ) . However, due to the coarse graphical representations of clusters, these approaches may lead to a loss of identifiability, i.e., a causal effect may be identifiable in the original graph but not in the clustered graph. To remedy this issue, tikka2023clustering suggested transit clusters which were proven preserve the identifiability under certain conditions. In addition, tikka2018pruning introduced pruning, which refers to the process of completely removing vertices that are irrelevant for identification. Such vertices can, for instance, include variables that are descendants of the response variable or vertices that are connected to the causal graph through only one edge. Illustrations of pruning and clustering are presented in Figure 1 . The existing identifiability results regarding pruning and clustering have been presented in the context of a single observational data source, and are thus not directly applicable to causal data fusion. Z_{5} Z_{6} Z_{4} Z_{3} Z_{2} Z_{1} X Y (a) Z_{4} Z_{3} Z_{2} Z_{1} X Y (b) Z_{4} T X Y Y C (c) Figure 1 : Illustrations of size-reduction techniques for causal graphs: 1(a) the original graph, 1(b) a pruned graph where Z_{5} and Z_{6} have been deemed irrelevant for the identification of p(y\,|\,\mathrm{do}(x)) and thus removed, 1(c) a clustered graph obtained from the pruned graph where T represents the set \{Z_{1},Z_{2},Z_{3}\} . In this paper, we derive sufficient conditions under which pruning and clustering can be applied within the general causal effect identification framework. We also show how identifying functionals obtained from a pruned or clustered graph can be used to derive identifying functionals for the original graph. Our results generalize the results by tikka2018pruning and tikka2023clustering to the case of multiple data sources. These generalizations are not straightforward because previous results on identification of causal effects regarding pruning and clustering rely on concepts that necessitate a clear distinction between observed and unobserved variables, such as c-components (districts), hedges, and the latent projection. These concepts are not well-defined when entire distributions are not available. By pruning and clustering, the computational load of algorithms used in the causal effect identification can be reduced, and the identifying functionals for the causal effects can be presented more concisely. Another perspective to clustering is top-down causal modeling where causal relations are first modeled between clusters of variables. This kind of approach is intuitive and commonly applied in practice ( tennant2021use , and references therein) . Top-down causal modeling has also been applied with multiple data sources ( valkonen2024price ; Youngmann2023Causal ; karvanen2020epi ) . The results derived in this paper can be used to determine when non-identifiability in a clustered graph implies non-identifiability in a graph without clusters, and when more detailed modeling of the internal structure of the clusters could be beneficial for the identification. The paper is organized as follows. In Section 2 , we define the notations and core definitions such as the structural causal model and the identifiability of causal effects. In Sections 3 and 4 , we present our main results on causal effect identifiability

Read the complete text