Physics-Informed Neural Networks for Solving Forward and Inverse PDEs with Limited and Noisy Data: Application to Solar Corona Modeling
Hubert Baty · 2025
Read Physics-Informed Neural Networks for Solving Forward and Inverse PDEs with Limited and Noisy Data: Application to Solar Corona Modeling by Hubert Baty (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-19843.txt.
Introduction
Hubert Baty, writing alone in 2025, shows how a type of neural network that uses physics rules can solve hard equations when data are sparse or noisy. The method can work from data at the edge of a region or from points inside it.
Baty also uses the networks in reverse, to find unknown values in the equations from the data at hand. The main test case is the solar corona, the hot outer layer of the Sun, where strong magnetic fields shape hot gas. The paper makes the case that this tool suits such plasma problems well.
Catalog record
| CREATOR | Hubert Baty |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-19843
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Physics-Informed Neural Networks for Solving Forward and Inverse PDEs with Limited and Noisy Data: Application to Solar Corona Modeling Hubert Baty Abstract I will demonstrate the effectiveness of Physics-Informed Neural Networks (PINNs) in solving partial differential equations (PDEs) when training data are scarce or noisy. The training data can be located either at the boundaries or within the domain. Additionally, PINNs can be used as an inverse method to determine unknown coefficients in the equations. This study will highlight the application of PINNs in modeling magnetohydrodynamic processes relevant to strongly magnetized plasmas, such as those found in the solar corona. 1 Introduction This paper builds upon the previous work of Baty & Vigon (2024), which demonstrated the use of Physics-Informed Neural Networks (PINNs) for solving partial differential equations (PDEs) in the context of modeling magnetic fields in the solar corona. The primary objective of that study was to explore both the advantages and limitations of PINNs in comparison to traditional numerical methods, which are commonly used to solve problems with boundary conditions defined over the integration domain. In that work, the basic variant of PINNs, known as the vanilla version, was introduced. For further details, readers may also refer to Baty (2024). In this study, we focus on scenarios where the data available at the boundaries are either highly limited and/or noisy. Furthermore, in some cases, these data may be located away from the boundary of the integration domain, for instance, at points within the domain itself. Additionally, we address inverse problems where one or more coefficients in the differential equations are unknown. These situations pose significant challenges for classical numerical methods, which may become difficult—or even impossible—to implement. As a concrete example, we examine the problem of stationary magnetic reconnection, previously studied by Baty & Vigon (2024), where a set of incompressible magnetohydrodynamic (MHD) equations is applied in two dimensions. This paper is structured as follows. Section 2 provides a brief overview of the fundamentals of the vanilla PINNs method. In Section 3, we examine the direct approach for problems involving sparse boundary data, noisy data, or data located outside the boundary. Section 4 introduces the inverse method for determining unknown coefficients in the PDEs. Finally, we present our conclusions in Section 5 2 Vanilla PINNs Method Physics-Informed Neural Networks (PINNs) is a machine learning approach that integrates physical laws directly into the neural network training process. In its simplest form, known as vanilla PINNs, this method minimizes a loss function that combines the residuals of the differential equations and the errors from the available training data. Consider a partial differential equation (PDE) that depends on two spatial variables x and y and written in the residual form: \mathcal{L}(u(x,y),x,y)=0, where \mathcal{L} is the differential operator and u(x,y) is the solution to be approximated. The goal is to find an approximate function \hat{u}(x,y;\theta) , represented by a neural network, that minimizes the combined loss between the data errors and the PDE residuals. The total loss function in the vanilla PINNs method consists of two main terms: \mathcal{L}_{\text{total}}=\lambda_{\text{data}}\mathcal{L}_{\text{data}}+\lambda_{\text{PDE}}\mathcal{L}_{\text{PDE}}, where \mathcal{L}_{\text{data}} is the error between the observed data values and the model predictions, and \mathcal{L}_{\text{PDE}} is the PDE residual, evaluated at a set of collocation points in the (x,y) domain. The parameters \lambda_{\text{data}} and \lambda_{\text{PDE}} are weighting factors that adjust the relative importance of the data and PDE residuals in the total loss function. In this work, these two factors are simply set to unity. The two partial loss functions are evaluated using mean squared errors (see Baty 2024). Additionally, the different derivative terms (in PDE residual) are evaluated using the automatic differentiation (AD) technique, also used for the gradient descent technique (see below). 2.1 Gradient Descent Method for Training PINNs The gradient descent (GD) method is a core optimization technique used to train PINNs. It enables the efficient minimization of the loss function, which includes both the data errors and the residuals of the PDEs. The goal of gradient descent is to iteratively update the \theta parameters (weights and biases) of the neural network to minimize the total loss, a measure of how well the network approximates the solution to the PDE while respecting the physical constraints. In the context of PINNs, the total loss function typically consists of two terms: the data loss and the PDE residual loss. Gradient descent updates the network parameters based on the gradients (partial derivatives) of the loss function with respect to each parameter. Mathematically, the update rule for a parameter \theta_{i} is given by: \theta_{i}^{(k+1)}=\theta_{i}^{(k)}-\text{l\_r}\frac{\partial\mathcal{L}_{\text{total}}}{\partial\theta_{i}^{(k)}}, where: • \theta_{i}^{(k)} is the parameter at iteration k , • l_r is the learning rate, controlling the step size of the update, • \frac{\partial\mathcal{L}_{\text{total}}}{\partial\theta_{i}^{(k)}} is the gradient of the total loss function with respect to the parameter \theta_{i} . The gradients are typically computed using backpropagation, a technique that efficiently calculates the derivatives of the loss function with respect to the network parameters by applying the chain rule of differentiation. Backpropagation, combined with gradient descent, allows the network to learn from both the physical laws encoded in the PDE residuals and the available data. The learning rate l_r plays a crucial role in the convergence of the optimization process. If the learning rate is too large, the network may overshoot the optimal solution, leading to poor performance. Conversely, if the learning rate is too small, convergence may be slow, requiring more iterations to reach the optimal solution. 2.2 Training data points and collocation points Let us consider an integration domain enclosed by a bounding boundary, denoted \partial D . In this study, we examine cases where the training data (represented by red dots in Figure 1) are located either on the boundary or within the integration domain. Additionally, the amount of available data may be limited and not necessarily uniformly distributed. Figure 1: Schematic representation of an arbitrary 2D integration domain, and distribution of the training data points (red dots) situated on the boundary (left panel) and within the domain (right panel). Regarding the collocation points used to evaluate the PDE residual, they are distributed throughout the domain, as illustrated in Figure 2 Figure 2: Schematic representation of an arbitrary 2D integration domain, and distribution of the collocation points (blue dots) within the integration domain. 2.3 The neural network architecture The minimization is achieved using a feed-forward neural network, as illustrated in Figure 3. The network consists of an input layer with two neurons for the two spatial coordinates, followed by three hidden layers (each with five neurons), and finally by a single output neuron. In this example, only one output neuron is required when solving for a single differential equation corresponding to the u(x,y) solution. The minimization process is completed when the gradient descent (GD) method converges, yielding the optimal \theta^{*} parameter values and the associated solution. Additionally, in the case of inverse PINNs (discussed below), extra parameters must be included in the \theta parameters Figure 3: Example of a neural network architecture used in the PINNs method, featuring three hidden layers with five neurons per layer 2.4 The algorithm and implementation In this work, we employ the well-known Adam optimizer for the gradient descent (GD) method. The algorithm is implemented using the TENSORFLOW library, a popular