Causal Operator Discovery in Partial Differential Equations via Counterfactual Physics-Informed Neural Networks
Ronald Katende · 2025
Read Causal Operator Discovery in Partial Differential Equations via Counterfactual Physics-Informed Neural Networks by Ronald Katende (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20181.txt.
Introduction
Finding the true terms of a physical law from data is harder than fitting a curve. A term can improve a fit yet do no real work in the system. Ronald Katende builds a test based on counterfactuals: delete or perturb a candidate term, then compare the paths that follow. His framework runs on physics-informed neural networks. Six theorems support it, covering screening, pruning, and when identification is impossible.
One result shows deletion effects depend on the equation's response map, not on leftover error size. Others handle aliasing between terms and limits set by the experiment's design. Tests use synthetic equations with known answers and public weather and ocean data. Katende reports the real-data runs as diagnostics, not recovered laws.
Catalog record
| CREATOR | Ronald Katende |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20181
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Causal Operator Discovery in Partial Differential Equations via Counterfactual Physics-Informed Neural Networks Ronald Katende Abstract We develop a principled framework for discovering causal structure in partial differential equations (PDEs) using physics-informed neural networks and counterfactual perturbations. Unlike classical residual minimization or sparse regression methods, our approach quantifies operator-level necessity through functional interventions on the governing dynamics. We introduce causal sensitivity indices and structural deviation metrics to assess the influence of candidate differential operators within neural surrogates. Theoretically, we prove exact recovery of the causal operator support under restricted isometry or mutual coherence conditions, with residual bounds guaranteeing identifiability. Empirically, we validate the framework on both synthetic and real-world datasets across climate dynamics, tumor diffusion, and ocean flows. Our method consistently recovers governing operators even under noise, redundancy, and data scarcity, outperforming standard PINNs and DeepONets in structural fidelity. This work positions causal PDE discovery as a tractable and interpretable inference task grounded in structural causal models and variational residual analysis. Keywords: Causal discovery, partial differential equations, physics-informed neural networks, counterfactual inference, operator identification, residual-based learning MSC[2020]: 35R30, 35Q93, 68T07, 62M45, 35A02, 65M32 1 Introduction Scientific models involving partial differential equations (PDEs) often rely on strong prior assumptions about the form of the governing equations. Classical solvers such as finite element methods [ 1 ] , spectral schemes [ 2 ] , and multigrid approaches [ 4 ] remain the gold standard when equations are fully specified, but they require explicit discretization and scale poorly with complexity [ 5 ] . More recent algorithmic frameworks, such as operator splitting [ 6 ] , matrix-free formulations [ 7 ] , and symbolic PDE compilers [ 8 ] , have increased numerical flexibility, but still presuppose that the operator \mathcal{N} is known. This assumption breaks down in many emerging applications. Climate systems, biological tissues, and turbulent oceanic flows often exhibit unknown or partially specified physics. In such cases, the central challenge is not merely to solve a PDE, but to discover its causal structure from noisy, indirect observations. Residual-fitting methods like physics-informed neural networks (PINNs) [ 9 ] address the solution approximation problem when \mathcal{N} is fixed. Neural operators [ 10 , 11 ] and DeepONets [ 12 ] generalize this to function-to-function mappings, enabling flexible surrogates for forward and inverse tasks [ 13 , 14 , 15 ] . However, these methods are limited in settings where the governing dynamics must themselves be inferred. Sparse regression techniques such as SINDy [ 16 ] and PDE-FIND [ 17 ] attempt to select active terms from a predefined library. Recent improvements combine these with neural representations [ 18 ] , ensemble methods [ 19 ] , and Koopman-based embeddings [ 20 ] . Yet these methods generally rely on residual minimization, which does not guarantee physical or causal relevance. High residual fit may reflect overfitting to correlated but non-generative features, especially in systems with sparse data, multiscale forcing, or latent variables [ 21 , 22 , 23 ] . We address this gap by proposing a framework for Causal PDE Discovery via Physics-Informed Counterfactuals . Instead of treating \mathcal{N} as a fixed prior, we treat it as a structural causal mechanism, in the spirit of structural causal models (SCMs) [ 24 , 25 ] . Our approach defines operator-level interventions and counterfactual PDEs, enabling explicit testing of whether a differential term is necessary for generating the observed dynamics. The resulting Causal PINNs framework extends traditional PINNs by jointly learning the solution field and identifying the structurally active operators. It combines residual-based learning with operator sparsification and counterfactual diagnostics, resulting in a fully differentiable and interpretable discovery pipeline. This aligns with current priorities in scientific machine learning, namely, physically grounded discovery, causal identifiability, and model interpretability [ 26 , 27 , 28 ] . In this work, we formalize the mathematical structure of causal operator discovery, introduce metrics such as the Causal Sensitivity Index (CSI) and counterfactual deviation, and prove recovery guarantees under classical identifiability conditions. We validate the approach on real-world systems including tumor growth, East African climate dynamics, and ocean surface currents, demonstrating that Causal PINNs recover correct PDE structure, outperform standard baselines, and maintain robustness under noisy, sparse, or partially confounded data. 2 Structural Causal Models for PDEs We formalize partial differential equations (PDEs) as structural causal models (SCMs) to enable principled reasoning about interventions in infinite-dimensional dynamical systems. In classical SCM theory [ 24 ] , a system is described by a tuple (\mathcal{S},\mathcal{U},\mathcal{F},P_{\mathcal{U}}) , where \mathcal{S} contains endogenous variables, \mathcal{U} exogenous sources, \mathcal{F} structural equations, and P_{\mathcal{U}} a distribution over \mathcal{U} . This formalism supports causal queries through interventions and counterfactuals. We generalize this framework to PDEs by interpreting the solution field and physical parameters as endogenous variables, and unresolved subgrid effects or latent mechanisms as exogenous variables [ 13 , 21 ] . Specifically, we define \mathcal{S}:=\{u,\gamma_{1},\ldots,\gamma_{k}\},\quad\mathcal{U}:=\{U_{1},\ldots,U_{k}\},\quad\mathcal{F}:=\left\{\mathcal{N}[u;\gamma]=0,\;\gamma_{j}=f_{j}(U_{j})\right\}_{j=1}^{k}. Here, u:\Omega\times[0,T]\to\mathbb{R} is the spatiotemporal state, each \gamma_{j} is a parameter (e.g., diffusivity, source strength), and U_{j} is an unobserved input or latent driver. The operator \mathcal{N} encodes the governing PDE, and its form defines the structural dependencies among components of \mathcal{S} . The maps f_{j} allow latent exogenous variation to manifest in \gamma_{j} , while the distribution P_{\mathcal{U}} introduces stochasticity. For example, consider the diffusion equation \mathcal{N}[u]=\partial_{t}u-\nu\Delta u-f. Both \nu and f are structural entities in this model. An interventionsuch as replacing f with a different source f^{\prime} , halving \nu , or adding a nonlinear term \nabla\cdot(u^{2}) , constitutes a structural modification that yields a new operator \mathcal{N}^{\mathrm{cf}} . We define the counterfactual system associated with an intervention as \mathcal{N}^{\mathrm{cf}}[u^{\mathrm{cf}};\gamma^{\mathrm{cf}}]=0, subject to modified initial or boundary conditions if required. The solution u^{\mathrm{cf}} represents the hypothetical outcome under the intervened law, and the difference u^{\mathrm{cf}}-u quantifies the structural effect of the change. Crucially, this shift captures causal influence, not just sensitivity, i.e., it measures how changes to the generative law propagate through the system. This framework elevates the role of PDEs from descriptive models to testable hypotheses. It permits counterfactual queries of the form, that is, what dynamics would emerge if a constitutive law were altered? Which terms in \mathcal{N} materially drive the solution behavior? How robust is a predicted trajectory under model perturbations? Our objective is to develop computational tools and theoretical guarantees for answering such questions. We leverage recent advances in physics-informed neural networks (PINNs) [ 9 ] , operator learning [ 10 , 12 ] , and causal inference in dynamical systems [ 25 ] . However, unlike prior methods that treat \mathcal{N} as a fixed inductive prior, we interpret it as a causal mechanism subject to intervention and falsifiability. The remainder of this work builds on this foundation to define formal notions of causal sensitivity, operator relevance, and identifiability in PDEs. This shift enables a new class of counterfactual physics-informed learning algorithms capable of uncovering not only predictive models but also the causal structure underlying physical dynamics. 3 Counterfactual PDEs and Causal Responses Given a structural PDE model \mathcal{N}[u;\gamma]=0 with solution u:\Omega\times[0,T]\to\mathbb{R} , we define a counterfactual PDE as the system obtained by a structural intervention on the parameters \gamma . Let \gamma\mapsto\gamma^{\prime} denote such an intervention, possibly altering physical coefficients, source terms, or constitutive laws. The