Multi-level Neural Networks for high-dimensional parametric obstacle problems
Martin Eigel, Cosmas Heiß, Janina E. Schütte · 2025
Read Multi-level Neural Networks for high-dimensional parametric obstacle problems by Martin Eigel, Cosmas Heiß, Janina E. Schütte (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05026.txt.
Introduction
Martin Eigel, Cosmas Heiß and Janina Schütte develop multi-level neural networks for high-dimensional parametric obstacle problems, in work from 2025. In such problems, parameters shape both the governing diffusion equation and the obstacle's place and surface. Random parameters make the task harder still, since the solution map lives in many dimensions.
Their network is a convolutional design modelled on a finite element multigrid method for constrained problems. Multi-level data is fed in by preprocessing, which speeds training and keeps energy-norm errors small. The multigrid link also allows a full prior analysis of convergence and cost. Numerical tests show state-of-the-art results on this hard problem class, the authors report.
Catalog record
| CREATOR | Martin Eigel, Cosmas Heiß, Janina E. Schütte |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05026
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-level Neural Networks for high-dimensional parametric obstacle problems Martin Eigel, Cosmas Heiß, Janina E. Schütte Abstract A new method to solve computationally challenging (random) parametric obstacle problems is developed and analyzed, where the parameters can influence the related partial differential equation (PDE) and determine the position and surface structure of the obstacle. As governing equation, a stationary elliptic diffusion problem is assumed. The high-dimensional solution of the obstacle problem is approximated by a specifically constructed convolutional neural network (CNN). This novel algorithm is inspired by a finite element constrained multigrid algorithm to represent the parameter to solution map. This has two benefits: First, it allows for efficient practical computations since multi-level data is used as an explicit output of the NN thanks to an appropriate data preprocessing. This improves the efficacy of the training process and subsequently leads to small errors in the natural energy norm. Second, the comparison of the CNN to a multigrid algorithm provides means to carry out a complete a priori convergence and complexity analysis of the proposed NN architecture. Numerical experiments illustrate a state-of-the-art performance for this challenging problem. A Preprint 1 Introduction Free boundary problems arise in different research and engineering areas. They constitute solutions of a PDE with a priori unknown boundaries. Well-known examples include classes of obstacle problems and variational inequalities. The solution of a classical obstacle problem describes the position of an elastic membrane as a function u , which is fixed on the boundary of the domain D , always lies above some known obstacle \varphi and is under the influence of some forcing f , see [ 31 ] . The interface where the membrane touches the obstacle is a priori unknown. On the part of the domain where the membrane hangs freely, the position function fulfills a stationary diffusion equation. Fixing u on the boundary, the problem considered here has the form \begin{cases}u(x,\mathbf{y})\geq\varphi(x,\mathbf{y})&\text{for all }x\in D\\ -\nabla\cdot(\kappa(x,\mathbf{y})\nabla u(x,\mathbf{y}))=f(x,\mathbf{y})&\text{for all }x\text{ such that }u(x,\mathbf{y})>\varphi(x,\mathbf{y})\\ -\nabla\cdot(\kappa(x,\mathbf{y})\nabla u(x,\mathbf{y}))\geq f(x,\mathbf{y})&\text{for all }x\in D\end{cases}, (1.1) depending on some coefficient \kappa and some countably infinite dimensional parameter vector \mathbf{y}\in\Gamma\subseteq\mathbb{R}^{\mathbb{N}} . The dependence on \kappa has for instance also been considered in [ 16 , 25 ] . Obstacle problems are found in a variety of applications, namely the Stefan problem describing the process of ice melting in water, can be rewritten in form of the obstacle problem [ 12 ] . Furthermore, the obstacle problem finds applications in financial mathematics [ 5 , 6 , 27 ] and the minimizer of interaction energies can be written in terms of the solution of an obstacle problem [ 8 ] , which are encountered e.g. in in physics in particle behavior [ 22 , 23 ] or in biology in collective behavior of animals [ 3 , 11 , 15 ] . For more information on practical uses of the obstacle problem, we refer to [ 17 , 18 , 31 ] and references therein. With the gaining popularity of scientific machine learning (SciML), neural networks have been applied to solve obstacle problems in different ways, where the equations can be incorporated into a loss function. The obstacle condition can either be encoded in the neural network architecture, as e.g. in the first approach in [ 38 ] or in [ 2 ] , or it can be enforced by penelization, as e.g. in the second approach in [ 38 ] or in [ 9 ] . In [ 1 ] , the variational formulation of the obstacle problem is rewritten in a min-max formulation that is then used for training. In the work presented here the coefficient and the obstacle depend on some high-dimensional stochastic parameter vector. In this setting the obstacle problem has to be solved for a large number of realizations of the vector. Classical mathematical solvers, as for example presented in [ 20 ] apply to a large class of coefficients. We exploit and inherent distribution of the parameters to develop more efficient tuned surrogate models mapping realizations of \kappa and \varphi to solutions of the obstacle problem. A surrogate model mapping \varphi to the solution has been derived in [ 33 ] . The proximal neural network architecture with activation functions enforcing the obstacle condition was analyzed in the more general setting of variational inequalities. The convergence achieved in [ 33 , Theorem 4.2] based on a fixed \kappa and \varphi is comparable to the convergence achieved in the present work for variable \kappa and \varphi as the analysis is based on an iterative scheme to approximate the solution in both cases. The architecture is implemented for the obstacle problem with variable obstacles [ 33 , Example 4.4, Section 6.3] , where \varphi can be mapped to the solution of the problem. The architecture in our work is analyzed and implemented for a variable obstacle and an additional variable coefficient and forcing. Here, a multi-level decomposition of the solutions is utilized to implement individual networks approximating a coarse solution and fine grid corrections. As in this decomposition corrections on fine grids are only of small values, only a low accuracy is needed on fine grids with many parameters. This can be made use of by implementing comparably small NN architectures on high levels in terms of either the number of trainable parameters or number of samples on fine grids. Stochastic properties of the parametric obstacle problem are computed and analyzed based on multi-level decompositions of finite element spaces in [ 25 ] for fixed obstacles and in [ 4 ] for stochastic obstacles, based on adaptive finite element methods in [ 26 ] . The considered architecture inspired by the CNN constructed in [ 21 ] for parametric partial differential equations is analyzed in terms of expressivity specifically for the obstacle problem, i.e. with respect to the needed number of trainable parameters to achieve a required accuracy. We prove that CNNs can approximate a projected Richardson iteration leading to bounds on the number of parameters only depending logarithmically on the required accuracy. Furthermore, we prove that a multigrid algorithm based on the projected Richardson iteration and a monotone restriction operator can be approximated by the applied architecture. This shows that the surrogate model is at least as expressive as the multigrid solver. The CNN architecture is tested for different parameter dimensions and for constant and variable obstacles and elasticities. Main contributions: • A CNN architecture mapping the coefficient, obstacle, and force to the solution of the obstacle problem is presented. • The architecture is analyzed in terms of expressivity. To the best of the authors knowledge, the achieved theoretical convergence results have so far only been derived for obstacle-to-solution maps for other architectures. The main result is presented in Corollary 5.3 . Assuming that the coefficient is uniformly bounded from below and above there exists a constant C>0 such that for any \varepsilon>0 there exists a CNN \Psi with the number of parameters bounded by \#\Psi\leq C\log\left({\varepsilon^{-1}}\right) such that and for all \mathbf{y}\in\Gamma parameterizing the coefficient, force and obstacle it holds \displaystyle\left\|\Psi({\bm{\kappa}},\mathbf{f},\bm{\varphi})-\mathbf{u}(\cdot,\mathbf{y})\right\|_{H^{1}}\leq C\left(\left\|f\right\|_{\ast}+\left\|\bm{\varphi}\right\|_{H^{1}}\right)\varepsilon, where \mathbf{u} is the collection of finite element coefficients of the solution of a discretized parametric obstacle problem and {\bm{\kappa}},\mathbf{f},\bm{\varphi} are the discretized coefficient, force, and obstacle. •