Group-Theoretic Structure Governing Identifiability in Inverse Problems

Isshin Arai, Tomoaki Itano · 2025

Read Group-Theoretic Structure Governing Identifiability in Inverse Problems by Isshin Arai, Tomoaki Itano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08995.txt.

Introduction

Isshin Arai and Tomoaki Itano set hard limits on what any method can reconstruct about a physical system from observations, using the symmetry structure of the data itself. They define a reconstruction dimension, the maximum number of recoverable components. They show it is fixed sector by sector by the group representations carried by the observation spaces and the maps between them.

The working example is fluid mechanics: recovering the local velocity-gradient tensor, the full record of stretching and rotation in a flow, from the orientations of particles suspended in it. An equivariant neural network built for three-dimensional rotations finds exactly the reconstructable subspaces the representation theory predicts. Whether the bound is fully saturated then depends on the physics and the geometry of the data. The authors note this gives practitioners a principled ceiling before they start fitting.

Catalog record

CREATORIsshin Arai, Tomoaki Itano
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08995

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Group-Theoretic Structure Governing Identifiability in Inverse Problems Preprint: APS/123-QED Isshin Arai, Tomoaki Itano Abstract In physical systems possessing symmetry, reconstructing the underlying causal structure from observational data constitutes an inverse problem of fundamental importance. In this work, we formulate the inverse problem of causal inference within the framework of group-representation theory, clarifying the structure of the representation spaces to which the causality and estimation maps belong. This formulation leads to both theoretical and practical limits of reconstructability (identifiability). We show that the local velocity-gradient tensor, regarded as a causal factor , can be reconstructed from the orientational motion of suspended particles. In this setting, the estimation map must act as a group homomorphism between the observation and causal spaces, and the reconstructable subspace is constrained by the decomposition structure of the SO(3) representation. Based on this principle, we construct an SO(3)-equivariant neural network (implemented with the e3nn framework) and verify that the identifiability determined by the group-representation structure is reproduced in the actual learning process. These results demonstrate a fundamental principle that the group-representation structure determines the reconstructability (identifiability limit) in inverse problems of causal inference. I Introduction In physics, a fundamental class of inverse problems involves inferring the underlying causal structure of a system (e.g., independent component analysis Hyvärinen et al. 2001 and inverse scattering problems Colton et al. 1998 ). Such problems can also be formulated as inverse mapping problems, in which the input is reconstructed from the output by explicitly specifying the forward map Alvarez et al. 2009 . Physical systems are strongly constrained by symmetry, yet the mechanism by which symmetry restricts estimators and determines what information can be reconstructed has not been explicitly formulated. In this work, we formulate the inverse problem of causal inference in symmetric systems using homomorphisms between representation spaces. This formulation implies that the admissible set of estimation maps is restricted to the space of group homomorphisms, and that such constraints define the fundamental limit of identifiability in the inverse problem. This provides a universal principle applicable to any physical system possessing symmetry. We further demonstrate this principle of identifiability numerically using an SO(3)-equivariant neural network, showing that preserving representational homomorphism—encapsulating both “constraints and limits”—significantly enhances the accuracy and stability of causal reconstruction. Neural-network-based estimators that exploit system symmetries have been widely reported for both forward Batzner et al. 2022 and inverse Celledoni et al. 2021 ; Tang and Xu 2025 problems (see also Ref. Geiger and Smidt 2022 ). Existing SO(3)-equivariant networks such as e3nn are constructed based on group-representation decomposition, but the explicit role of each representation component in reconstructability for inverse problems has not been clarified. Our numerical demonstration thus suggests that the proposed principle provides a theoretical guideline for representation selection and network design in equivariant neural networks. The remainder of this paper is organized as follows. Section II formulates inverse problems in physics within the framework of group-representation theory and presents examples of symmetric systems and their corresponding representation structures. Section III discusses the principle of identifiability in specific systems, where the estimation map is approximated using an SO(3)-equivariant neural network. Finally, Section IV summarizes our findings and outlines possible future directions. II Causal inference and representation theory In this section, we formulate inverse problems in physics from the viewpoint of group-representation theory and then present a concrete example for the SO(3) system. Let X and Y denote the input and output spaces, respectively, and let there exist a forward map f representing the causal structure of the system: f:X\to Y,\qquad x\in X,\;y=f(x)\in Y. Here, f represents a physical process such as temporal evolution, chemical reaction, scattering, or measurement. The inverse problem, in this context, is to infer the causality underlying f . The causality may refer to the map f itself or its constituent elements ( causal factors ). Thus, the inverse problem can be equivalently regarded as constructing a mapping from the input–output pair (x,y) to the causal space O : F:X\times Y\to O,\qquad(x,y)\mapsto o,\quad o\in O. In physical systems, both the input and the causality relationships are often subject to symmetry. This means that the system as a whole is invariant under the action of a symmetry group G , which imposes constraints on the estimation map F . Specifically, for any g\in G , the following commutative diagram must hold: Figure 1: Commutative diagram of the mappings. where \rho denotes a representation of the group G . Accordingly, an ideal estimation map F satisfies F\circ\rho_{X\times Y}(g)=\rho_{O}(g)\circ F,\qquad\forall g\in G, which implies F\in\mathrm{Hom}_{G}(V_{X\times Y},V_{O}). Henceforth, X , Y , and O are treated as representation spaces V_{X} , V_{Y} , and V_{O} under the group action of G . Here, V_{X\times Y} and V_{O} correspond to the representation spaces of the input–output pairs and the causality, respectively. From this formulation, it follows that the reconstructable part of the causality in an inverse problem is determined by the representation decomposition of these spaces. Let us now consider a concrete system possessing SO(3) symmetry. The orientational dynamics of a particle suspended in an incompressible fluid (in the limit where thermal fluctuations, shape effects, and inertia are negligible) is described as an SO(3)-symmetric system Jeffery 1922 ; Goto et al. 2011 ; Arai et al. 2025 : \dot{\mathbf{s}}=\mathbf{s}\times\bigl(\mathbf{s}\times(\nabla\mathbf{u}\cdot\mathbf{s})\bigr), where \mathbf{s}\in\mathbb{S}^{2} denotes the particle orientation vector, and \nabla\mathbf{u}\in\mathcal{D} is the local velocity-gradient tensor. The physical process map f can then be defined as f(\nabla\mathbf{u}):\mathbf{s}\mapsto\dot{\mathbf{s}},\qquad\mathbf{s}\in\mathbb{S}^{2},\;\dot{\mathbf{s}}\in T_{\mathbf{s}}\mathbb{S}^{2}. (1) For a finite set of observation directions \mathcal{S}_{N}^{*}=\{{\mathbf{s}}_{i}\}_{i=1}^{N} , the map is given by f^{*}:\nabla\mathbf{u}\mapsto\{(\dot{\mathbf{s}}_{i},\mathbf{s}_{i})\}_{i=1}^{N},\qquad\dot{\mathbf{s}}_{i}=\mathbf{s}_{i}\times\bigl(\mathbf{s}_{i}\times(\nabla\mathbf{u}\cdot\mathbf{s}_{i})\bigr). The injectivity of f^{*} is guaranteed for N\geq 4 when the observation directions \{\mathbf{s}_{i}\} are in general position, i.e., not confined to a single plane (thus including at least four non-coplanar directions). Once the injectivity of f^{*} is ensured, the inverse map F=(f^{*})^{-1}:\mathcal{C}_{N}^{*}\to\mathcal{D} is well defined, establishing a one-to-one correspondence between the set of observed pairs \mathcal{C}_{N}^{*}=\{(\dot{\mathbf{s}}_{i},\mathbf{s}_{i})\}_{i=1}^{N} and the space of velocity-gradient tensors \mathcal{D} . This injectivity condition provides the minimal requirement for the existence of an estimation map in the inverse problem. The map F must also be equivariant under the group action: F\circ\rho_{\mathcal{C}_{N}^{*}}(R)=\rho_{\mathcal{D}}(R)\circ F,\qquad\forall R\in\text{SO}(3). Thus, among all well-defined estimation maps F , the physically admissible ones belong to the space of group homomorphisms, F\in\mathrm{Hom}_{\text{SO}(3)}(V_{\mathcal{C}_{N}^{*}},V_{\mathcal{D}}). III Results In this section, we clarify the theoretical limit of identifiability for the example introduced above, and then numerically verify it by approximating the estimation map F using an SO(3)-equivariant neural network, referred to as the Velocity Gradient Network (VGN). III.1 Theoretical limit of identifiability The estimation map F is constrained to the space of SO(3)-equivariant homomorphisms, F\in\mathrm{Hom}_{\text{SO}(3)}(V_{\mathcal{C}_{N}^{*}},V_{\mathcal{D}}). The identifiability of causal factors is determined jointly by the representation structure of the group and the tensor composition (direct sum or tensor product) of F . The structure permitted by group symmetry defines a fundamental upper bound , whereas the specific design of the estimator determines a practical upper bound . The causal factor, the local velocity-gradient tensor \nabla\mathbf{u} , has the following Clebsch–Gordan decomposition. V_{1}\otimes V_{1}=V_{0}\oplus V_{1}\oplus V_{2}, where V_{0} , V_{1} , and V_{2} correspond to the isotropic (scalar), antisymmetric (rotational), and symmetric-traceless (strain) components, respectively. From a practical standpoint, regarding each observation pair (\mathbf{s}_{i},\dot{\mathbf{s}}_{i}) as one unit of information, each input pair transforms under the action

Read the complete text