Generalized Lie Symmetries in Physics-Informed Neural Operators
Amy Xiang Wang, Zakhar Shumaylov, Peter Zaika, Ferdia Sherry, Carola-Bibiane Schönlieb · 2025
Read Generalized Lie Symmetries in Physics-Informed Neural Operators by Amy Xiang Wang, Zakhar Shumaylov, Peter Zaika, Ferdia Sherry, Carola-Bibiane Schönlieb (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00373.txt.
Introduction
Amy Xiang Wang and co-authors strengthen physics-informed neural operators with a richer kind of symmetry, in a 2025 paper. These operators learn to solve whole families of partial differential equations. Feeding them the equations' symmetries speeds training, but ordinary point symmetries often yield no useful training signal. The team turns to a richer class, generalized symmetries, using their evolutionary form as extra loss terms.
Those forms supply a richer set of generators, so the symmetry loss actually bites during training. Experiments show better data efficiency and accuracy than point-symmetry versions. The authors frame the fix as listening to what the equation's structure is really saying. Their method needs no extra data, only a smarter use of known physics. They target scientific computing tasks where labeled solutions are expensive.
Catalog record
| CREATOR | Amy Xiang Wang, Zakhar Shumaylov, Peter Zaika, Ferdia Sherry, Carola-Bibiane Schönlieb |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-00373
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generalized Lie Symmetries in Physics-Informed Neural Operators Amy Xiang Wang, Zakhar Shumaylov, Peter Zaika, Ferdia Sherry, Carola-Bibiane Schönlieb Abstract Physics-informed neural operators (PINOs) have emerged as powerful tools for learning solution operators of partial differential equations (PDEs). Recent research has demonstrated that incorporating Lie point symmetry information can significantly enhance the training efficiency of PINOs, primarily through techniques like data, architecture, and loss augmentation. In this work, we focus on the latter, highlighting that point symmetries oftentimes result in no training signal, limiting their effectiveness in many problems. To address this, we propose a novel loss augmentation strategy that leverages evolutionary representatives of point symmetries, a specific class of generalized symmetries of the underlying PDE. These generalized symmetries provide a richer set of generators compared to standard symmetries, leading to a more informative training signal. We demonstrate that leveraging evolutionary representatives enhances the performance of neural operators, resulting in improved data efficiency and accuracy during training. Keywords Deep learning \cdot Physics-informed \cdot Neural Operator \cdot PINN \cdot Lie point symmetries \cdot Generalized symmetries 1 Introduction Deep neural networks are increasingly used for scientific computing, particularly in simulating complex physical systems governed by partial differential equations (PDEs) [ 11 ] , where traditional methods struggle [ 24 ] . Physics-informed neural networks (PINNs) [ 24 ] integrate physical laws and constraints directly into the learning process, demonstrating success in various applications [ 24 , 29 , 35 , 14 , 27 , 33 ] . However, classical PINNs face challenges under varying parameters and boundary conditions and often encounter training challenges due to unbalanced gradients and non-convex loss landscapes [ 10 , 15 , 22 ] . Neural operators offer a compelling alternative, which unlike standard feedforward neural networks, learn mappings between infinite-dimensional function spaces, directly connecting parameters and initial/boundary conditions to PDE solutions [ 21 , 32 ] . This eliminates the need for independent simulations and, when combined with physics-informed loss functions, often improves generalization and physical validity. We focus on this class of approaches. In a separate direction, the field of geometric deep learning has demonstrated the practical and theoretical benefits of incorporating symmetry information into neural networks, leading to improved performance through beneficial inductive biases [ 6 , 5 ] . For example, the translational equivariance of convolutional neural networks (CNNs) [ 9 , 18 ] has been suggested as an important reason for their successes in tasks such as image classification [ 16 , 12 ] . Similarly, recent work in neural operators has shown that incorporating PDE symmetries improves generalization and training efficiency. However, most research has focused on Lie point symmetries due to their well-established theoretical foundation and systematic derivation methods [ 23 , 13 , 3 ] . In contrast, the potential of generalized symmetries remains largely unexplored due to their unsuitability for data augmentation or equivariant architectures. This paper demonstrates that generalized PDE symmetries can nonetheless provide valuable inductive biases when incorporated through loss augmentation. 1.1 PDE Symmetries in Deep Learning Incorporation of point symmetries into neural solvers has received significant attention, leading to the development of many approaches that can be broadly classified into three categories: Data augmentation is the simplest way to add symmetry information into neural PDE solvers [ 4 , 20 ] by augmenting the training data with transformed versions obtained by applying symmetry operations. While straightforward to implement, this approach can increase training costs. Loss augmentation is an alternative way to inject symmetry information by appropriately regularizing the loss using symmetry information [ 1 , 19 , 34 ] . This often leads to improved generalization and sample efficiency, although it may not guarantee equivariant models. Architecture augmentation aims to directly embed symmetries into the model architecture. Given the complexity of point symmetry groups associated with PDEs, this requires either general techniques [ 26 ] or exploiting simpler subgroups with existing architectures [ 31 ] . Beyond these, alternative approaches exist, based on problem reformulations [ 2 , 17 ] or those focused on other types of structures, e.g. from Hamiltonian dynamics [ 7 , 8 , 30 ] . 2 PDE Symmetries Here, we introduce the notion of PDE symmetries. The formal presentation here closely follows [ 23 ] , and the reader is strongly encouraged to read it for more in-depth discussions of the concepts. In simple words, PDE point symmetries are transformations that map solutions of a given PDE to other solutions of the same PDE. To derive these symmetries, traditionally the focus is shifted to Jet spaces, where the problem of studying PDE symmetries is transformed into the simpler task of studying symmetries of algebraic equations. By employing one-parameter groups of transformations, it becomes possible to systematically derive all such symmetries by examining their infinitesimal actions. Suppose we are considering a system \Delta of n -th order differential equations involving p independent x=\left(x^{1},\dots,x^{p}\right)\in X , and q dependent variables u=\left(u^{1},\dots,u^{q}\right)\in U . Jet Spaces and Prolongations: Consider f:X\rightarrow U smooth and let U_{k} be the Euclidean space, endowed with coordinates u_{J}^{\alpha}=\partial_{J}f^{\alpha}(x) in multi-index notation so as to represent the above derivatives. Furthermore, set U^{(n)}=U\times U_{1}\times\cdots\times U_{n} to be the Cartesian product space, whose coordinates represent all the derivatives of functions u=f(x) of all orders from 0 to n . The total space X\times U^{(n)} , whose coordinates represent the independent variables, the dependent variables and the derivatives of the dependent variables up to order n is called the n -th order jet space of the underlying space X\times U . Given a smooth function u=f(x) , there is an induced function u^{(n)}=\operatorname{pr}^{(n)}f(x) , called the n -th prolongation of f , defined by the equations u_{J}^{\alpha}=\partial_{J}f^{\alpha}(x). Thus \mathrm{pr}^{(n)}f is a function from X to the space U^{(n)} , and for each x in X , \operatorname{pr}^{(n)}f(x) is a vector representing values of f and all its derivatives up to order n at the point x . The PDE is a system of equations \Delta\left(x,u^{(n)}\right)=0, with \Delta:X\times U^{(n)}\rightarrow\mathbb{R}^{l} smooth, determining a subvariety S_{\Delta}=\left\{\left(x,u^{(n)}\right):\Delta\left(x,u^{(n)}\right)=0\right\}\subset X\times U^{(n)} A symmetry group of the system \Delta will be a local group of transformations, G^{\Delta} , acting on some open subset M\subset X\times U such that “ G transforms solutions of \Delta to other solutions of \Delta ”, i.e. leaving S_{\Delta} invariant. Prolongations of actions Now suppose G acts on an open M\subset X\times U , i.e. independent and dependent variables. There is an induced local action of G on the n -jet space M^{(n)} , called the n -th prolongation of G denoted \mathrm{pr}^{(n)}G . This prolongation is defined so that it transforms the derivatives of functions u=f(x) into the corresponding derivatives of the transformed function \tilde{u}=\tilde{f}(\tilde{x}) . Consider now v a vector field on M , with a corresponding one-parameter group \exp(\varepsilon v) . The n -th prolongation of {v} is denoted \operatorname{pr}^{(n)}v , will be a vector field on the n -jet space M^{(n)} , and is defined to be the infinitesimal generator of the corresponding prolonged one-parameter group \operatorname{pr}^{(n)}[\exp(\varepsilon v)] . Relevance of these concepts is highlighted by the following theorem: Theorem 2.1 (2.31 in [ 23 ] ) . Suppose \Delta\left(x,u^{(n)}\right)=0 is a system of differential equations of maximal rank defined over M\subset X\times