MoPINNEnKF: Iterative Model Inference using generic-PINN-based ensemble Kalman filter

Binghang Lu, Changhong Mou, Guang Lin · 2025

Read MoPINNEnKF: Iterative Model Inference using generic-PINN-based ensemble Kalman filter by Binghang Lu, Changhong Mou, Guang Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00731.txt.

Introduction

Binghang Lu, Changhong Mou, and Guang Lin propose in 2025 an iterative method that pairs physics-informed neural networks with a data filter. Note that the catalog title differs from the text's own title, and the text governs here. Such networks solve equations by building physical laws into training.

Noise and missing physics often hurt these networks in real problems. Their method uses a multi-objective optimizer to create a set of network variants along a best trade-off front. A Kalman filter then blends those variants with noisy observations. The blended result refines training, and the loop repeats. Tests on two benchmark equations beat standard networks.

Catalog record

CREATORBinghang Lu, Changhong Mou, Guang Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00731

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MoPINNEnKF: Iterative Model Inference using generic-PINN-based ensemble Kalman filter Binghang Lu, Changhong Mou, Guang Lin Abstract Physics-informed neural networks (PINNs) have emerged as a powerful tool for solving forward and inverse problems involving partial differential equations (PDEs) by incorporating physical laws into the training process. However, the performance of PINNs is often hindered in real-world scenarios involving noisy observational data and missing physics, particularly in inverse problems. In this work, we propose an iterative multi-objective PINN ensemble Kalman filter (MoPINNEnKF) framework that improves the robustness and accuracy of PINNs in both forward and inverse problems by using the ensemble Kalman filter and the non-dominated sorting genetic algorithm III (NSGA-III). Specifically, NSGA-III is used as a multi-objective optimizer that can generate various ensemble members of PINNs along the optimal Pareto front, while accounting the model uncertainty in the solution space. These ensemble members are then utilized within the EnKF to assimilate noisy observational data. The EnKF’s analysis is subsequently used to refine the data loss component for retraining the PINNs, thereby iteratively updating their parameters. The iterative procedure generates improved solutions to the PDEs. The proposed method is tested on two benchmark problems: the one-dimensional viscous Burgers equation and the time-fractional mixed diffusion-wave equation (TFMDWE). The numerical results show it outperforms standard PINNs in handling noisy data and missing physics. 1 Introduction The rapid advancement of machine learning and artificial intelligence has profoundly influenced a wide range of scientific and engineering disciplines [ 43 , 56 , 30 , 8 , 3 , 22 , 33 , 48 , 31 , 63 , 41 ] . Among these advancements, physics-informed neural network (PINN) [ 3 , 8 , 39 ] has emerged as a powerful tool for solving complex partial differential equations (PDEs) by integrating physical laws directly into the learning process. PINN leverages the expressive capabilities of neural networks to approximate solutions to PDEs, offering a mesh-free and flexible alternative to traditional numerical methods. However, the effectiveness of PINN can be significantly impaired in the presence of noisy and sparse observational data (forward problem) [ 3 , 60 , 53 ] , or missing physics, such as unknown coefficients in PDEs (inverse problem) [ 66 , 26 , 7 , 21 ] , which are common challenges in real-world applications. With perfect data, PINN is successfully used in forward and inverse problems. To train such a PINN, one needs to minimize a multi-objective loss function that includes the PDE residual (residual loss), initial conditions, boundary conditions (boundary loss), and data discrepancies (data loss) [ 49 , 39 , 55 , 38 , 62 , 50 , 59 , 64 ] . They are widely used in many different problems. For example, Mao et al. [ 39 ] utilized PINNs to infer density, velocity, and pressure fields for the one-dimensional Euler equations based on observed density gradient data. Similarly, Rasht et al. [ 50 ] employed PINNs for full waveform inversions in seismic imaging to determine wave speed from observational data. Despite the success of PINNs, there are still several challenges. First, PINN uses the soft constraints which tends to minimize the sum of the PDE residual, boundary, and data losses with appropriate weights, however, the imbalance among different loss functions during training period may result in unusual expensive training costs [ 58 ] . This can happen when certain terms dominate or vanish prematurely, resulting in inefficient training and therefore leading to non-optimal results. Second, PINNs are usually sensitive to available noisy data, which in fact is a very common setting in real-world applications. Indeed, noisy or imperfect data can “mislead” the training and therefore generate inaccurate results with inappropriate neural network parameters; the model errors in forward problem or only missing physics in inverse problem put the problem more challenging. Third, in inverse problems where only partial physics are known, i.e., PDEs with unknown parameters, the accuracy of traditional PINNs diminishes. This is because the PDE residual loss relies on both the neural network derivatives and the unknown parameters, which makes accurate inference challenging without balanced losses in training and access to high-quality data. This paper proposes an integrated MoPINNEnKF framework that combines the M ulti- o bjective P hysics I nformed N eural N etwork with en semble Kalman F ilter (EnKF) [ 15 , 16 , 28 ] to solve PDEs in both forward and inverse settings with noisy observational data. The MoPINNEnKF uses reference-point-based non-dominated sorting approach (hereby, referred to as NSGA-III) [ 10 , 11 , 12 ] to solve the multi-objective loss function in the original PINN. Specifically, MoPINNEnKF employs NSGA-III to generate ensemble members of PINNs within the optimal Pareto front where these ensemble members are further used as forecast model results in EnKF, together with available observation data to iteratively refines the PINNs by updating its data loss function. The MoPINNEnKF framework integrates the advantages of two methods, evolution multi-objective optimizer , i.e., NSGA-III and ensemble Kalman filter (EnKF). The former can provide more balanced and effective training for PINNs with a multi-objective loss function while the optimal solutions from NSGA-III consist of various members on the optimal Pareto front, expressing the model uncertainty. In particular, NSGA-III treats each component of PINN loss as distinct objectives and in the training process, the non-dominated sorting and crowding distance calculation methods is employed [ 36 ] . On the other hand, the later, i.e., EnKF can be used to assimilate model and observational data to find the optimal solutions in the Bayesian sense. While the original Kalman filter only handles linear systems [ 28 ] , the ensemble Kalman filter (EnKF) and its variant [ 1 , 15 , 16 , 40 , 4 , 45 ] extends it to a wider range of problems by using a Monte Carlo approach. Essentially, the EnKF begins with a probability distribution (represented by ensemble members in the forecast) and a likelihood function for observed data, then applies Bayes’ theorem to update this distribution (the “analysis” or posterior) once new observations are introduced. However, neural network–based PDE solvers often struggle to generate ensemble members that capture model uncertainty (model errors). The EnKF has Therefore, this MoPINNEnKF approach iterately refines the PINNs while leveraging the strengths of NSGA-III’s multi-objective optimization capabilities and EnKF’s denoising to improve the accuracy and robustness. This method can be used in both forward and inverse problem settings for the given PDEs. It is also important to note that, in the inverse problem setting for PINNs, there are two different approaches: (I) The unknown physical parameters are treated as additional independent variables and included as inputs to the neural network, which is trained over a range of parameter values [ 6 , 5 ] ; (II) The physical parameters are treated as trainable variables. While they do not explicitly appear in the network architecture, they affect the training process through their contribution to the loss function via the PDE residual. In this paper, we use the second approach for the inverse problem, i.e., putting unknown physics term as the trainable variables which directly contributes to the PDE residual in PINN’s loss function. In brief summary, our primary contribution includes the following: 1. We employ

Read the complete text