PMNO: A novel physics guided multi-step neural operator predictor for partial differential equations
2025
Read PMNO: A novel physics guided multi-step neural operator predictor for partial differential equations (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01598.txt.
Introduction
Jin Song, Kenji Kawaguchi, and Zhenya Yan present PMNO, a neural operator that forecasts the behavior of physical systems far into the future, in a 2025 paper. Neural operators learn maps between whole fields, like a fluid's state now and later, but they often train poorly and fade on long forecasts. The design borrows two ideas from classic numerical solvers.
Instead of one past state, the model reads several, like a multi-step solver does. Its training uses an implicit stepping rule borrowed from the backward differentiation formula, which steadies long runs. A causal training order removes the need for staged retraining. The trained model also works at any grid fineness, since it learns the underlying field rather than the mesh. Tests span flat systems, odd-shaped domains, wave motion, and reaction-diffusion patterns, with the new model ahead throughout.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-01598
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PMNO: A novel physics guided multi-step neural operator predictor for partial differential equations Abstract Jin Song a,b , Kenji Kawaguchi c , Zhenya Yan d,b,e,∗ ∗ Corresponding author. Email addresses : [email protected] (J. Song), [email protected] (K. Kawaguchi), [email protected] (Z. Yan). a School of Advanced Interdisciplinary Science, University of Chinese Academy of Sciences, Beijing 100190, China b State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China c National University of Singapore, 21 Lower Kent Ridge Road, 119077, Singapore d School of Mathematics and Information Science, Zhongyuan University of Technology, Zhengzhou 450007, China e School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing 100049, China Abstract. Neural operators, which aim to approximate mappings between infinite-dimensional function spaces, have been widely applied in the simulation and prediction of physical systems. However, the limited representational capacity of network architectures, combined with their heavy reliance on large-scale data, often hinder effective training and result in poor extrapolation performance. In this paper, inspired by traditional numerical methods, we propose a novel physics guided multi-step neural operator (PMNO) architecture to address these challenges in long-horizon prediction of complex physical systems. Distinct from general operator learning methods, the PMNO framework replaces the single-step input with multi-step historical data in the forward pass and introduces an implicit time-stepping scheme based on the Backward Differentiation Formula (BDF) during backpropagation. This design not only strengthens the model’s extrapolation capacity but also facilitates more efficient and stable training with fewer data samples, especially for long-term predictions. Meanwhile, a causal training strategy is employed to circumvent the need for multi-stage training and to ensure efficient end-to-end optimization. The neural operator architecture possesses resolution-invariant properties, enabling the trained model to perform fast extrapolation on arbitrary spatial resolutions. We demonstrate the superior predictive performance of PMNO predictor across a diverse range of physical systems, including 2D linear system, modeling over irregular domain, complex-valued wave dynamics, and reaction-diffusion processes. Depending on the specific problem setting, various neural operator architectures, including FNO, DeepONet, and their variants, can be seamlessly integrated into the PMNO framework. Keywords: Partial differential equations, Neural operators, Machine learning, linear multi-step scheme, backward differentiation formula, physics guided, causal training 1 Introduction Spatiotemporal dynamics (e.g., chaotic dynamics, soliton interactions, and pattern formation) lies at the heart of physical systems [ 2 , 3 , 4 ] , and plays a crucial role across a wide range of scientific and engineering domains, including fluid mechanics, climate science, optics, Bose-Einstein condensates, biology, and finance [ 5 , 6 , 7 , 8 , 9 , 10 ] . Predicting and simulating their complex spatiotemporal dynamics from the available physical information is vital for controlling wave propagations, as well as for exploring the fundamental principles governing wave interactions in nonlinear media. Current approaches generally follow two divergent paradigms: physics-based numerical discretization and purely data-driven surrogate modeling. Fristly, traditional numerical solvers are primarily built upon time-integration schemes [ 11 , 12 , 13 ] coupled with spatial discretization techniques [ 14 , 15 , 16 ] . Grounded in first principles, these methods offer high numerical accuracy, but they still suffer from prohibitive computational costs when resolving fine-scale features in high-dimensional systems, a challenge exacerbated by the “curse of dimensionality”. Conversely, recent advances in machine learning have enabled data-driven strategies for modeling and understanding the behavior of complex physical systems [ 17 , 18 , 19 , 20 , 21 , 22 , 23 , 25 , 26 , 24 ] . Such successes are largely driven by the expressive power of deep neural networks, allowing them to learn intricate nonlinear dependencies from rich supervised data [ 27 ] . For example, machine learning techniques like convolutional neural networks (CNNs) and recurrent architectures bypass explicit physics encoding by learning input-output mappings directly from observational or synthetic datasets [ 24 , 23 ] . Moreover, Transformer architectures leverage self-attention mechanisms to capture dependencies across different positions within a sequence, making them particularly effective for modeling long-horizon temporal dynamics [ 25 , 26 ] . While such black-box models demonstrate impressive acceleration in some tasks like flow field reconstruction, their reliance on extensive training data and opaque extrapolation mechanisms raises concerns about generalizability to unseen operating regimes [ 28 ] . Purely data-driven methods based on deep learning typically extract representations from large datasets and heavily rely on data availability, which often leads to poor generalization and failure to adhere to underlying physical laws. Moreover, the reliance on fixed-resolution data and positional encodings limits the model’s flexibility and effectiveness in capturing multi-scale features or dealing with irregular domains. To address these limitations, neural operators have emerged as a promising class of deep learning models that aim to learn mappings between infinite-dimensional function spaces, circumventing spatial discretization constraints inherent to conventional PDEs solvers. Pioneering works like DeepONet and Fourier Neural Operators (FNO) demonstrate orders-of-magnitude speedup in predicting fluid dynamics and solid mechanics, and have been supported by universal approximation theorem [ 29 , 33 , 30 , 31 , 32 ] . Moreover, subsequent developments have introduced a variety of operator learning frameworks tailored to different problem settings. For instance, Graph Kernel Network (GNO) [ 34 ] are designed for learning over unstructured meshes or irregular geometries, while Multiwavelet-based operators [ 35 , 36 ] aim to enhance the efficiency and accuracy in multi-scale problems. These operator learning methods have also been applied to the prediction of various physical models and have achieved promising results [ 37 , 38 , 39 , 40 ] . Inspired by the physics-informed learning paradigm introduced by PINNs, physics-embedded neural operator models, such as physics-informed DeepONet (PIdeepONet) and PIFNO [ 41 , 42 ] , have been proposed to alleviate the reliance on large labeled datasets. These methods incorporate prior knowledge of governing physical laws to enable efficient learning in small-data regimes. However, the design of most existing neural operator architectures remains largely intuition-driven, which often limits their representational capacity when applied to complex physical systems. Moreover, the incorporation of physical constraints, while beneficial for data efficiency, can significantly complicate the optimization landscape, making it challenging for the network to make long-horizon prediction. These challenges call for a robust modeling framework that can harness the strengths of operator learning while mitigating its inherent limitations. Motivated by the aforementioned discussions, in this paper we put forward the physics guided multi-step neural operator (PMNO) method, a novel neural operator architecture that incorporates the advantages of linear multi-step methods to address the challenge in long-horizon prediction of complex physical systems. Unlike conventional operator learning approaches, the PMNO framework leverages multi-step historical data in the forward pass instead of relying on single-step inputs, and incorporates an implicit time-stepping mechanism rooted in the Backward Differentiation Formula (BDF) during the training process. Our main contributions of this paper can be summarized as follows: • The multi-step neural operator structures enhance the temporal dependency across different time steps, thereby improving the network’s expressive capacity for capturing complex dynamical behaviors. • BDF guided training paradigm enhances the model’s extrapolation capability, and facilitates more efficient and stable training with limited data. And the causal training strategy is employed to circumvent the need for