A PINN-enriched Finite Element Method for Linear Elliptic Problems

Xiao Chen, Yixin Luo, Jingrun Chen · 2025

Read A PINN-enriched Finite Element Method for Linear Elliptic Problems by Xiao Chen, Yixin Luo, Jingrun Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14913.txt.

Introduction

Xiao Chen, Yixin Luo, and Jingrun Chen blend neural networks into the finite element method in a 2025 numerical analysis study. Finite elements are the workhorse for engineering equations, while physics-informed neural networks learn approximate solutions from the equation itself. Their hybrid runs in three steps: train the network, add its solution to the finite element space, then solve finally inside that enriched space.

Enrichment can add or multiply the network's output against standard basis functions. Convergence analysis and tests support the scheme. The blend aims to let a rough neural guess do the hard shaping, leaving the reliable finite element machinery to certify the answer.

Catalog record

CREATORXiao Chen, Yixin Luo, Jingrun Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-14913

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A PINN-enriched Finite Element Method for Linear Elliptic Problems Xiao Chen, Yixin Luo, Jingrun Chen Abstract . In this paper, we propose a hybrid method that combines finite element method (FEM) and physics-informed neural network (PINN) for solving linear elliptic problems. This method contains three steps: (1) train a PINN and obtain an approximate solution u θ u_{\theta} ; (2) enrich the finite element space with u θ u_{\theta} ; (3) obtain the final solution by FEM in the enriched space. In the second step, the enriched space is constructed by addition v + u θ v+u_{\theta} or multiplication v ⋅ u θ v\cdot u_{\theta} , where v v belongs to the standard finite element space. We conduct the convergence analysis for the proposed method. Compared to the standard FEM, the same convergence order is obtained and higher accuracy can be achieved when solution derivatives are well approximated in PINN. Numerical examples from one dimension to three dimensions verify these theoretical results. For some examples, the accuracy of the proposed method can be reduced by a couple of orders of magnitude compared to the standard FEM. 1. Introduction Linear elliptic partial differential equations (PDEs) [ 11 ] demonstrate importances in various applications of science and engineering, including fluid flow, heat conduction, and electrostatics. They are characterized by their solutions’ smoothness and the existence of a unique solution under appropriate boundary conditions. A plethora of methods have been proposed for numerically solving linear elliptic PDEs, and we focus our attention on the finite element method (FEM) [ 4 , 5 , 13 ] , physics-informed neural networks (PINN) [ 19 ] as well as Deep Ritz method [ 23 ] . The finite element method is a numerical technique for solving PDEs that has been widely used in engineering and physics due to its flexibility and accuracy. It involves approximating the solution over small, simple geometric elements, which approximate the entire domain of interest. The standard finite element method involves the construction of a set of basis functions that span the solution space, followed by the assembly of a system of equations that is then solved for the unknown coefficients. However, this approach can be computationally expensive and rely on the quality of mesh, especially for large-scale problems. Posteriori error estimate [ 1 ] and adaptive mesh refinement [ 22 ] has been widely used to improve the results and decrease the time cost. Recently, significant advancement has been achieved in numerical methods for PDEs with the introduction of physics-informed neural networks. These networks are a class of deep learning algorithms trained on the governing equations of the physical systems, rather than solely on the data. PINNs have demonstrated the ability to approximate solutions to different types of PDEs [ 12 ] . They are particularly promising for problems where traditional numerical methods may struggle, such as those with complex geometries [ 3 ] , heterogeneous materials, or multi-scale features [ 15 ] . The key innovation of PINNs is the incorporation of physical laws directly into the learning process, which ensures that the learned solution satisfies the underlying equations exactly, without the need for a large amount of training data. However, neural network-based methods suffer from limited accuracy, and the training process is time-consuming. Due to the lack of an efficient optimization method for the training process, they are hard to train to arrive at the global optimal state, especially when the penalty term is used to handle the boundary condition. A number of new models [ 16 , 21 , 7 ] have been proposed aiming to improve the performance of PINN. Some previous works have explored methods based the balance of traditional methods and PINN. In [ 21 ] , the author only optimizes the parameters in output layer and take neural network as basis in Discontinuous Galerkin method [ 2 , 17 ] to make training process a linear solver. In [ 18 ] , domain is decomposed into two non-overlapping regions: a finite element domain for boundary and a neural network domain for interior region. PINN is multiplied by finite element basis in finite element domain for enforcing the Dirichlet boundary conditions. In [ 9 ] , PINN can be used as a prior to correct the basis for discontinuous Galerkin methods. Along with this line, we propose to enrich the traditional finite element basis functions with PINNs. In this new method, there are three steps to numerically solve PDEs: (1) train a PINN and obtain an approximate solution u_{\theta} ; (2) enrich the finite element space with u_{\theta} ; (3) obtain the final solution by FEM in the enriched space. In the second step, the enriched space is constructed by addition v+u_{\theta} or multiplication v\cdot u_{\theta} , where v belongs to the standard finite element space. The theoretical and numerical results show that the enriched finite element method using PINNs offers better accuracy benefited by PINN and convergence order by FEM. The paper is organized as follows: In Section 2, we introduce the concept of Physics-Informed Neural Networks and classical finite element method; in Section 3, we present our method for enriching finite element basis functions with PINNs; in Section 4, we provide error analysis of the modified finite element method; in Section 5, we demonstrate the effectiveness of our approach through a series of numerical experiments, comparing the performance of the enriched finite element method against traditional FEM; finally, we conclude with a discussion of the potential applications of this method and the challenges that remain to be addressed in future research. 2. Preliminaries We first introduce the physics-informed neural network, a novel numerical method based on neural networks for solving PDEs, and the classical finite element method. 2.1. Physics-informed neural networks Consider the linear elliptic equation (2.1) \left\{\begin{aligned} -\nabla\cdot(a(\boldsymbol{x})\nabla u(\boldsymbol{x}))+c(\boldsymbol{x})u(\boldsymbol{x})=&f(\boldsymbol{x}),\quad&&\boldsymbol{x}\in\Omega,\\ u(\boldsymbol{x})=&g(\boldsymbol{x}),&&\boldsymbol{x}\in\partial\Omega,\end{aligned}\right. where \Omega is smooth enough. PINNs use the fact that classical fully-connected neural networks are smooth functions of their inputs, as long as their activation functions are also smooth, to approximate the solution to (2.1). The smoothness of neural networks makes sure that after adding it to finite element space, the space is still a subspace of Sobolev space. In contrast to traditional numerical methods such as the finite element method and finite difference method (FDM), where system parameters are determined by solving linear systems of equations, the degrees of freedom (DoF) in Physics-Informed Neural Networks correspond to the weights and biases of the neural network architecture. These parameters are obtained through the minimization of a predefined loss function. Unlike conventional methods, the optimization process in PINNs is inherently more complex, primarily due to the nonlinear nature of typical activation functions employed in neural networks. In our case, the PINN is a smooth neural network with one to three hidden layers that takes as the input the variable x. We denote the network u_{\theta} , which is parameterized by \theta\in\Theta . The core idea of PINN is to transform the original PDE into the following minimization problem: (2.2) \theta=\mathop{\arg\min}\limits_{\theta\in\Theta}J(\theta), where J(\theta)=J_{r}(\theta)+\lambda J_{b}(\theta) . We introduce two different terms in (2.2): J_{r}(\theta) represents the loss of residual of PDE and J_{b}(\theta) represents the loss of boundary conditions. \lambda is the penalty coefficient. The

Read the complete text