A discrete physics-informed training for projection-based reduced order models with neural networks
N. Sibuet, S. Ares de Parga, J.R. Bravo, R. Rossi · 2025
Read A discrete physics-informed training for projection-based reduced order models with neural networks by N. Sibuet, S. Ares de Parga, J.R. Bravo, R. Rossi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13875.txt.
Introduction
Sibuet and co-authors present a physics-informed way to train reduced order models in this 2025 paper. Reduced models mimic costly simulations at a fraction of the cost, and neural versions learn the mimicry from snapshots. The team adds a second teacher: the leftover error, or residual, of the physics equations as computed by finite element software. That discrete residual guides the network alongside the snapshot data.
They also tweak the network layout to handle fast-fading solution modes better. A rubber beam bending under multi-axis loads serves as the test problem. The modified network beat the classic snapshot method by orders of magnitude in rebuild accuracy. Physics-informed training modestly closed the gap between rebuild and true reduced accuracy. The authors call for wider trials of residual-driven training.
Catalog record
| CREATOR | N. Sibuet, S. Ares de Parga, J.R. Bravo, R. Rossi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 109 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13875
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A discrete physics-informed training for projection-based reduced order models with neural networks N. Sibuet, S. Ares de Parga, J.R. Bravo, R. Rossi Abstract This paper presents a physics-informed training framework for projection-based Reduced Order Models (ROMs). We extend the PROM-ANN architecture by complementing snapshot-based training with a FEM-based, discrete physics-informed residual loss, bridging the gap between traditional projection-based ROMs and physics-informed neural networks (PINNs). Unlike conventional PINNs that rely on analytical PDEs, our approach leverages FEM residuals to guide the learning of the ROM approximation manifold. Key contributions include: (1) a parameter-agnostic, discrete residual loss applicable to non-linear problems, (2) an architectural modification to PROM-ANN improving accuracy for fast-decaying singular values, and (3) an empirical study on the proposed physics informed training process for ROMs. The method is demonstrated on a non-linear hyperelasticity problem, simulating a rubber cantilever under multi-axial loads. The main accomplishment in regards to the proposed residual-based loss is its applicability on non-linear problems by interfacing with FEM software while maintaining reasonable training times. The modified PROM-ANN outperforms POD by orders of magnitude in snapshot reconstruction accuracy, while the original formulation is not able to learn a proper mapping for this use-case. Finally, the application of physics informed training in ANN-PROM modestly narrows the gap between data reconstruction and ROM accuracy, however it highlights the untapped potential of the proposed residual-driven optimization for future ROM development. This work underscores the critical role of FEM residuals in ROM construction and calls for further exploration on architectures beyond PROM-ANN. Journal: Axioms 1 Introduction In recent years, the development of increasingly sophisticated high-fidelity models (HFMs) is crucial for simulating complex physical phenomena. One of the main computational challenges in HFMs is the need for very fine spatio-temporal resolutions, which results in extremely high-dimensional problems that can take weeks to solve, even on numerous parallelized computing cores. Therefore, it is vital to create methods that significantly reduce the computational time and resources required to enable the application of these models in time-sensitive scenarios, including real-time control systems, simulation-driven optimization and digital twins [ 1 , 2 , 3 ] . To address these computational challenges, projection-based reduced-order models (ROMs) have emerged as a powerful strategy, allowing for rapid simulation by approximating the dynamics of the high-dimensional system within a lower-dimensional latent space [ 4 ] . ROMs can be broadly classified as intrusive or non-intrusive , depending on how the reduced equations are derived. Intrusive ROMs project the governing equations directly onto a reduced space, typically via Galerkin projection [ 5 ] , Least-Squares Petrov–Galerkin (LSPG) projection [ 6 , 7 , 8 , 9 ] , or related Petrov–Galerkin formulations [ 10 ] . In contrast, non-intrusive ROMs avoid direct equation manipulation, instead employing supervised-learning methods like artificial neural networks (ANNs) or Gaussian processes to map parameters directly to reduced solutions, thereby fully decoupling the online computation from the original high-fidelity solver [ 11 , 12 , 13 , 14 , 15 ] . Intrusive projection-based ROMs typically involve an offline-online decomposition. In the offline stage, a latent space is computed from a collection of high-fidelity solutions sampled over a defined parametric domain. Proper Orthogonal Decomposition (POD) is a common approach, relying on Singular Value Decomposition (SVD) to obtain an optimal linear basis that efficiently captures the dominant dynamics [ 16 , 17 , 18 ] . The online stage then involves solving a reduced optimization problem within this latent space, resulting in dramatically reduced computational costs compared to the original HFM. Such strategies have demonstrated effectiveness in parametric linear problems [ 19 , 20 ] and nonlinear problems with moderate complexities [ 21 , 22 ] . Non-intrusive ROMs have attracted attention for scenarios where intrusive access to HFM operators is impractical or unavailable. Early successes include Gaussian processes and ANN regression models for aeroacoustic and structural problems [ 15 , 13 ] , as well as neural networks for predicting flow coefficients in combustion dynamics [ 11 , 12 ] . Recent extensions leverage convolutional autoencoders for complex spatio-temporal predictions [ 23 ] and generalized data-driven frameworks for nonlinear PDEs [ 14 ] . Later work with graph neural networks [ 24 ] aims at bypassing the need for structured meshes that convolutional autoencoders have. Despite their advantages in computational efficiency, these methods require large training datasets and their scale is still directly tied to the HFM’s dimensions. Nevertheless, intrusive linear ROMs, particularly those using POD-Galerkin formulations, have been noted to exhibit accuracy degradation and stability issues in highly nonlinear or convection-dominated regimes. For example, spurious mode growth was reported in compressible flows [ 25 ] , stability issues have been examined from dynamical systems perspectives [ 26 ] , and convergence difficulties have been highlighted in reactive flow scenarios [ 27 ] . These limitations have been attributed to the slow decay of the Kolmogorov n-width [ 28 ] , fundamentally restricting the representational power of linear subspaces. Consequently, a growing body of research has focused on developing nonlinear ROM strategies to overcome these fundamental expressivity barriers. Within intrusive ROMs, the formal theory for generic non-linear projection-based ROM was introduced in [ 29 ] , which was first demonstrated using a convolutional neural network to define a nonlinear mapping between the full and latent spaces. Despite several limitations—namely, limited scalability and the need for structured meshes—this architecture paved the way for further non-linear architectures. These include methods based on quadratic manifolds [ 30 ] , piecewise linear manifolds via local POD approaches [ 31 , 9 , 32 ] , and the PROM-ANN architecture from [ 33 , 34 ] ; the latter essentially being a non-linear approximation of POD using dense neural networks. Another approach to deal with non-linearizable dynamics is the use of spectral submanifolds [ 35 , 36 ] , which are more mathematically sound than data-based ones. These type of non-linear manifolds can be found under certain non-resonance conditions [ 37 ] , and their direct computation requires explicit knowledge of nonlinear coefficients in the equations of motion. Recent developments in [ 35 ] present a non-intrusive and data-free method to obtain these spectral submanifolds, but are currently limited to mechanical systems with up to cubic order non-linearities. In this paper, we propose a novel residual-informed training approach for constructing nonlinear ROM operators. While existing projection-based ROMs construct their projection operators based exclusively on learning the reconstruction of solution snapshots, we propose incorporating the discrete residual of the FEM-based HFM—the same residual used during online ROM projection—into the training of these operators. The reason being that, since the residual is the quantity to be optimized during ROM inference, its more accurate representation will necessarily improve the solutions of the ROMs. Our methodology is inspired by Physics-Informed Neural Networks (PINNs) [ 38 ] and their variants, e.g. [ 39 , 40 ] . PINNs are models based on neural networks that learn the solution function to a system of partial differential equations (PDEs) in their continuous form. This is achieved by embedding the governing PDEs directly into the loss function and taking advantage of the automatic differentiation capabilities of common machine learning libraries. However, their application in engineering workflows can be hindered by their