Partial Effective Information Decomposition for synergistic causality

Mingzhe Yang, Shuo Wang, Jiang Zhang · 2026

Read Partial Effective Information Decomposition for synergistic causality by Mingzhe Yang, Shuo Wang, Jiang Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03267.txt.

Introduction

Mingzhe Yang, Shuo Wang, and Jiang Zhang propose Partial Effective Information Decomposition, a framework for synergistic causation among many variables. Complex systems often act through joint effects no single source explains, and intervention-based tools for splitting those effects have been missing.

Their method decomposes the influence of several sources on a target under maximum-entropy interventions into unique and synergistic parts. In the three-variable case it fits the main axioms of partial information decomposition, and the setup supports causal graphs with hyperedges and downward causation. A test on air quality forecasting pulled readable station-level causal structure from a learned model.

Catalog record

CREATORMingzhe Yang, Shuo Wang, Jiang Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03267

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Partial Effective Information Decomposition for synergistic causality Mingzhe Yang, Shuo Wang, Jiang Zhang Abstract Causality is a central topic in scientific inquiry, yet for complex systems, the identification and analysis of synergistic causation remain a challenging and fundamental problem. In the context of causal relations among multivariate variables, a decomposition framework grounded in interventionist causation is still lacking. To address this gap, this paper proposes Partial Effective Information Decomposition (PEID), a framework that decomposes the influence of multiple source variables on a target variable under maximum-entropy interventions into unique and synergistic information, thereby providing a unified and computable characterization of synergistic causal relations. Theoretically, in the three-variable case, the proposed framework is compatible with the major axioms of Partial Information Decomposition (PID). Empirically, under maximum-entropy interventions, correlations among input variables are removed, causing redundancy to vanish and thereby enabling PEID to compute synergistic relations. Furthermore, based on this framework, it is possible to define causal graphs containing hyperedges as well as downward causation, thus offering a unified toolkit for analyzing cross-scale and multivariate causal mechanisms in complex systems. Finally, applying the framework to a machine-learning-based air quality forecasting task on KnowAir-V2, we demonstrate that PEID can extract interpretable inter-station causal structures from a learned dynamical model. These results suggest that PEID provides a general interventionist information-theoretic tool for analyzing multivariate and synergistic causal mechanisms in complex systems. K eywords Effective information, Partial effective information decomposition, Causal emergence, Synergistic causation, Multiscale causal graph, Downward causation Highlights • Partial effective information decomposition (PEID) decomposes effective information into unique and synergistic causal contributions under maximum-entropy interventions. • EI-based causal graphs encode pairwise effective information as directed edges and synergistic effective information as hyperedges. • Causal emergence is characterized as multiscale compression of causal structure, in which coarse-graining absorbs microscopic synergistic dependencies into macroscopic variables. • PEID extends to continuous nonlinear dynamics and enables interpretable causal analysis of machine-learning-based air quality forecasting models. 1 Introduction Understanding causal relations is an important means of characterizing the evolutionary mechanisms of complex systems, revealing the intrinsic dependency structures among variables, and advancing scientific discovery [ 11 , 31 , 27 , 21 , 48 ] . Across multiple fields, including statistics, physics, and complex systems science, causal analysis not only provides a theoretical framework for interpreting observational data, but also lays the foundation for predicting system behavior and making intervention decisions. However, for high-dimensional complex systems, the identification and quantification of causal relations still face significant challenges. One important reason is that once a system contains three or more variables, higher-order causal relations may arise [ 21 ] . In this paper, we use synergistic causality to denote a specific form of higher-order causality in which a set of source variables jointly affects a target in a way that cannot be reduced to the causal contribution of any individual source or lower-order subset. XOR-like mechanisms provide the canonical example: neither input is informative about the output by itself, whereas the input pair jointly determines the output. To address this issue, a large body of research based on information decomposition has been devoted to identifying the redundant, unique, and synergistic components in causal relations [ 45 , 22 , 4 , 13 , 9 ] . However, when the object of study is extended to variables of arbitrary dimension, such methods often encounter combinatorial explosion and rapidly increasing computational complexity. In addition, the notions of causality adopted in these studies are still mostly grounded in the Granger-causality framework [ 11 , 31 , 21 ] , rather than in an intervention-based definition of causation [ 27 ] . Granger causality characterizes a directed statistical dependence based on temporal precedence and predictive gain [ 11 , 31 ] .However, in the absence of additional structural assumptions, this definition is not directly equivalent to causation in the underlying generative mechanism of the system, and it cannot automatically exclude spurious associations induced by latent confounders or common causes [ 7 , 33 ] . Another important challenge is that complex systems often exhibit significant emergent phenomena: certain stable patterns or causal structures at the macro level often cannot be adequately characterized in a direct and parsimonious manner by local interactions at the micro level [ 14 , 28 , 10 ] . This implies that causal analysis of complex systems must not only focus on variable relations at a single scale, but also develop multiscale causal models capable of connecting different levels of description. Around this issue, a series of related research directions have emerged in recent years, including causal emergence theory [ 14 , 15 , 28 , 50 ] , causal abstraction [ 29 , 49 ] , and causal representation learning [ 30 ] , which provide new theoretical tools for multiscale causal modeling in complex systems from the perspectives of comparing causal efficacy across micro and macro levels, ensuring cross-level model consistency, and discovering high-level causal variables, respectively. To quantitatively characterize emergent phenomena, Hoel, Albantakis, and Tononi proposed the theory of causal emergence in 2013. Its core idea is to compare the dynamical causal efficacy of a system across different descriptive scales by means of a causal measure grounded in intervention semantics, and thereby determine whether the macro description is causally superior to the micro description [ 14 , 15 ] . In fact, as early as the related studies of Integrated Information Theory (IIT), Tononi and colleagues had already introduced the important concept of effective information (EI) to characterize the causal constraint relations among system states [ 36 , 37 , 2 ] . Specifically, EI typically considers applying a maximum-entropy intervention to the state of the system at time (t) , and computes the mutual information between the states at times (t) and (t+1) induced by that intervention, thereby measuring the overall causal efficacy manifested by the system dynamics during state evolution. If the EI of the macro dynamics is greater than the EI of the micro dynamics, we say that causal emergence occurs in the system [ 14 ] . However, the original theory of causal emergence is mainly concerned with comparing the overall causal efficacy of a system across different descriptive scales, that is, determining whether the macro description has a stronger overall causal effect than the micro description. In contrast, in the study of complex systems, we are often more concerned with two further questions: first, what specific causal structure exists among the variables within the system [ 1 ] , especially whether it contains irreducible higher-order couplings and synergistic causal relations; second, what relationship exists between these within-scale causal structures and causal relations across scales. A considerable body of research has sought to characterize the causal organization of complex systems at a fixed scale, using causal networks, information-decomposition frameworks, and more recently notions of higher-order causality that represent irreducible multivariate causal relations through hypergraph-like structures [ 16 , 44 , 19 , 38 , 39 , 8 , 34 ] . Related studies have further extended this perspective to cross-level phenomena such as downward causation [ 22 , 28 , 24 ] . However, as noted above, most of these methods are still primarily based on empirical distributions [ 16 ,

Read the complete text