Equilibrium Conserving Neural Operators for Super-Resolution Learning
Vivek Oommen, Andreas E. Robertson, Daniel Diaz, Coleman Alleman, Zhen Zhang, Anthony D. Rollett, George E. Karniadakis, Rémi Dingreville 1-School of Engineering, Brown University, Providence, RI 02912, USA2-Center for Integrated Nanotechnologies, Sandia National Laboratories, Albuquerque, NM 87185, · 2025
Read Equilibrium Conserving Neural Operators for Super-Resolution Learning by Vivek Oommen, Andreas E. Robertson, Daniel Diaz, Coleman Alleman, Zhen Zhang, Anthony D. Rollett, George E. Karniadakis, Rémi Dingreville 1-School of Engineering, Brown University, Providence, RI 02912, USA2-Center for Integrated Nanotechnologies, Sandia National Laboratories, Albuquerque, NM 87185, (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13422.txt.
Introduction
Vivek Oommen and co-authors presented a way in 2025 to train neural solvers on coarse data yet get fine grained answers for physics problems. Such solvers are fast, but they usually need costly high detail training data.
Their design builds the laws of balance directly into the network, so the missing detail is partly made up by physics. The method was tested on two materials problems: pores inside a solid block, and crystals with random grain patterns. It removed the need for high detail data and cut the cost of gathering training data by about a hundred fold. The authors say the design should transfer to other physics based problems.
Catalog record
| CREATOR | Vivek Oommen, Andreas E. Robertson, Daniel Diaz, Coleman Alleman, Zhen Zhang, Anthony D. Rollett, George E. Karniadakis, Rémi Dingreville 1-School of Engineering, Brown University, Providence, RI 02912, USA2-Center for Integrated Nanotechnologies, Sandia National Laboratories, Albuquerque, NM 87185, |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13422
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Equilibrium Conserving Neural Operators for Super-Resolution Learning Vivek Oommen, Andreas E. Robertson, Daniel Diaz, Coleman Alleman, Zhen Zhang, Anthony D. Rollett, George E. Karniadakis, Rémi Dingreville 1-School of Engineering, Brown University, Providence, RI 02912, USA2-Center for Integrated Nanotechnologies, Sandia National Laboratories, Albuquerque, NM 87185, USA3-Department of Materials Science and Engineering, Carnegie Mellon University, Pittsburgh, PA 15123, USA4-Mechanics of Materials Department, Sandia National Laboratories, Livermore, CA 94550, USA5-Division of Applied Mathematics, Brown University, Providence, RI 02912, USA+-these authors contributed equally to this work, order selected randomly Abstract Neural surrogate solvers can estimate solutions to partial differential equations in physical problems more efficiently than standard numerical methods, but require extensive high-resolution training data. In this paper, we break this limitation; we introduce a framework for super-resolution learning in solid mechanics problems. Our approach allows one to train a high-resolution neural network using only low-resolution data. Our Equilibrium Conserving Operator (ECO) architecture embeds known physics directly into the network to make up for missing high-resolution information during training. We evaluate this ECO-based super-resolution framework that strongly enforces conservation-laws in the predicted solutions on two working examples: embedded pores in a homogenized matrix and randomly textured polycrystalline materials. ECO eliminates the reliance on high-fidelity data and reduces the upfront cost of data collection by two orders of magnitude, offering a robust pathway for resource-efficient surrogate modeling in materials modeling. ECO is readily generalizable to other physics-based problems. K eywords Physics-Informed Machine Learning | Hard Constraining Physics | Super-resolution | Elasticity Introduction Physics-based numerical simulations allow scientists to systematically and thoroughly analyze complex multiscale physical processes that dictate material behavior, from atomic interactions to macroscale engineering phenomena. Crystal-plasticity simulations [ 1 ] , for instance, have proven invaluable in manufacturing where by linking processing parameters to microstructural features they were used to identify the root causes of earring defects in deep drawing processes [ 2 ] . However, the computational demands of such simulations present significant challenges. Traditional numerical schemes, especially three-dimensional (3D) finite element methods, face crippling computational demands due to the exponential scaling of their degrees of freedom with respect to spatial dimensions [ 3 ] . This scaling behavior drives reliance on supercomputing clusters [ 4 ] with massive energy footprints [ 5 ] , advanced parallelization techniques [ 6 ] , and heterogeneous hardware solutions [ 7 ] . Yet, even with these workarounds, applications of simulations are still restricted to low resolutions and small domains [ 8 , 9 ] , particularly in applications requiring many repeated solves, e.g., microstructure-sensitive design [ 10 ] . Neural-network-based surrogate solvers have emerged as an alternative approach for efficiently solving complex partial differential equations (PDEs). Acceleration is achieved because the neural solver displays orders of magnitude lower inference costs than direct numerical simulation (DNS) [ 11 ] . Several neural surrogate strategies are being actively researched, including physics-informed neural networks [ 12 ] , neural operators [ 13 , 14 , 15 , 16 ] , and vectorized neural networks [ 17 , 18 ] . At the time of this writing, no single dominant methodology has been established; rather, ongoing research efforts focus on developing best practices to address certain important characteristics, including parametric PDEs and training data cost. One significant area of exploration – particularly in neural surrogates for computational mechanics – involves managing parametric PDEs under nonstationary input conditions, such as fluctuating boundary constraints and spatially heterogeneous microstructure fields. These parameters define parametric PDE families. Operator learning [ 19 , 20 ] and vectorized neural network methods [ 21 , 22 ] learn conditional mappings from these high-dimensional inputs (e.g., microstructural descriptors) to PDE solution fields. A notable challenge in surrogate modeling for solid mechanics is that predictive accuracy hinges on resolving the parametric dependence on material microstructures [ 23 ] . To address this complexity and achieve model support over this high-dimensional parametric space, neural network-based surrogate solvers often rely on data-driven strategies necessitating large training datasets of input-output pairs derived from traditional numerical solvers [ 24 ] . The significant cost of curating such large training datasets often practically offsets any downstream gains due to faster solving speeds. Physics-informed learning is a promising strategy for addressing the data-intensive requirements of traditional neural networks by supplementing reduced training data with domain-specific physical principles [ 25 , 26 , 27 ] . Popularized by Physics-Informed Neural Networks (PINNs) [ 28 , 29 ] , traditionally, physics-informed machine learning methods minimize the surrogate prediction’s deviations from the governing physics by weakly penalizing the PDE residual in the loss function. Although PINNs – used to solve single PDEs – rely only on the PDE residual for training, physics-informed extensions to continuous [ 27 , 26 ] and vectorized [ 30 ] operator methods for solving parametric PDEs rely on a mixture of the PDE residual and standard supervised training data. By penalizing deviations from governing PDEs [ 12 , 27 , 26 ] , these approaches reduce reliance on large training data requirements [ 25 , 26 ] while simultaneously improving physical plausibility of the solution for downstream tasks [ 28 ] and improving inference performance in regions with limited supervised data [ 26 , 28 ] . Although theoretically simple, the PINN approach can be challenging to implement due to poor training dynamics caused by the large spectral radii of common PDEs [ 31 , 32 ] . Recent advances have shown improved performance by directly embedding the physics into the network architecture using strong constraints [ 33 ] . For instance, Lu et al. demonstrated improved roll-out by using a neural network to perturb forward Euler updates in a time-dependent system [ 34 ] . Incorporating generalized physics principles can also be beneficial when system-specific physics are uncertain or when developing strong constraints is theoretically complex. For example, Hamiltonian neural networks and GENERIC formalism informed neural networks (GFINNs) incorporate energy conservation and strictly increasing entropy into neural network methods for dynamic systems [ 35 , 36 , 37 , 38 , 39 ] . Multi-resolution learning is another solution aimed at reducing the upfront cost of collecting training data [ 13 ] . Unlike vectorized methods which operate on a consistent discretized space (i.e., inference occurs on the same grid resolution as training), neural-operator methods are ‘mesh independent’; they learn mappings between generalized function spaces from the same discrete data [ 40 , 13 , 14 , 41 ] . Practically, this means that neural-operator-based networks can be trained on low resolution (i.e., coarsely sampled) data and used in inference for high resolution queries. Because of the exponential scaling of DNS with increasing resolution, the ability to train on low-resolution data can drastically reduce the upfront cost of collecting data. However, current neural-operator solutions have an important limitation. They assume that even the coarsely sampled training data is sufficiently sampled to capture the highest frequencies present in the high-resolution representation [ 40 ] . In other words, they assume the training data is sampled on a coarse grid whose Nyquist frequency is still greater than the intrinsic frequency of the underlying physical system of interest. Operators trained on data sampled below this intrinsic frequency limit predict oversmoothed PDE predictions [