Data-Driven, ML-assisted Approaches to Problem Well-Posedness

Tom Bertalan, George A. Kevrekidis, Eleni D. Koronaki, Siddhartha Mishra, Elizaveta Rebrova, Yannis G. Kevrekidis · 2025

Read Data-Driven, ML-assisted Approaches to Problem Well-Posedness by Tom Bertalan, George A. Kevrekidis, Eleni D. Koronaki, Siddhartha Mishra, Elizaveta Rebrova, Yannis G. Kevrekidis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19255.txt.

Introduction

Tom Bertalan and co-authors use data driven tools to probe if differential equation problems are well posed, in a 2025 paper. A well posed problem has a solution that exists, is unique, and depends in a stable way on its starting and boundary data. Classic theory needs those data stated with arbitrary precision on the boundary alone.

Real data, though, come as patches of solution at scattered space time spots, or as several solutions of one operator. The team shows how machine and manifold learning can infer well posedness traits in cases where rigorous theorems are not known. The study joins a data assimilation view with an operator learning view.

Catalog record

CREATORTom Bertalan, George A. Kevrekidis, Eleni D. Koronaki, Siddhartha Mishra, Elizaveta Rebrova, Yannis G. Kevrekidis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-19255

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data-Driven, ML-assisted Approaches to Problem Well-Posedness Tom Bertalan, George A. Kevrekidis, Eleni D. Koronaki, Siddhartha Mishra, Elizaveta Rebrova, Yannis G. Kevrekidis Abstract Classically, to solve differential equation problems, it is necessary to specify sufficient initial and/or boundary conditions so as to allow the existence of a unique solution. Well-posedness of differential equation problems thus involves studying the existence and uniqueness of solutions, and their dependence to such pre-specified conditions. However, in part due to mathematical necessity, these conditions are usually specified “to arbitrary precision” only on (appropriate portions of) the boundary of the space-time domain. This does not mirror how data acquisition is performed in realistic situations, where one may observe entire “patches” of solution data at arbitrary space-time locations; alternatively one might have access to more than one solutions stemming from the same differential operator. In our short work, we demonstrate how standard tools from machine and manifold learning can be used to infer, in a data driven manner, certain well-posedness features of differential equation problems, for initial/boundary condition combinations under which rigorous existence/uniqueness theorems are not known. Our study naturally combines a data assimilation perspective with an operator-learning one. 1 Introduction Take an operator (a simple, linear one, like u_{xx}=0 ); discretize it, say with finite differences, into a set of linear equations; and then solve these equations between, say, x=0 and x=1 – but (a) do it variationally, with a random seed for an off-the-shelf nonlinear optimizer, and (b) do it many times (as we will see below, what we do has intimate connections to randomized numerical linear algebra). The outcome is more or less easy to guess: if one prescribes two conditions –whether initial ( u(0),u_{x}(0) ), or boundary ( u(0),u(1) ), or interior (say u(0.2),u(0.9) )– there will be a unique (discretized) solution (with zero residuals, to machine precision). If one prescribes a single condition, there will be a one-parameter infinite family of solutions (zero residuals to machine precision). If one prescribes zero boundary conditions, there will be a two-parameter infinity of solutions (zero residuals). But if one prescribes three conditions, what happens? If they are compatible, a unique solution (zero residuals). If incompatible, no solutions — but what will the variational solver converge to? Clearly, statistical processing of sets of randomized solutions (more accurately, randomized outcomes of the variational solution process) for this simple problem can provide information about its well-posedness: whether the solution exists, and whether it is unique. And when neither of these things is the case, the reader may already perceive that studying the statistics of the results contains valuable information about the nature/degree of overconstrainedness/“capacity” (to use a modern term) of this inconsistency. From this simple ODE problem, the step to, say, first order PDEs, and the computer-assisted exploration of the compatibility of their initial conditions is an obvious one, with more natural steps to follow. 103 years ago, Jacques Hadamard published a truly influential memoir in the Princeton University Bulletin; its title was “Sur les problèmes aux derivées partielles at leur signification physique.” [ 1 ] It is worth repeating (in translation) his frontispiece quotation by Poincaré himself: “Physics does not only give us the opportunity to solve problems — it also makes us intuit the solution”. And it is also worth repeating the introductory paragraph of the paper: The principal problems that the geometers have been led to pose relative to partial differential equations fall into two general types: the Dirichlet problem (and its analogs) in which the unknown function, defined in a certain domain, must satisfy, at every point of the boundary of this domain, a certain condition (let’s consider, for fixing ideas, a second order problem); the problem of Cauchy, in which the conditions to satisfy at every point of the boundary are two in number, one giving the value of the function at that point and one giving the value of one of its first derivatives. This three-and-a-half page memoir has cast a long shadow in the analysis (and practice) of solving partial differential equations, articulating the conditions of existence, uniqueness, and smooth dependence on (initial and) boundary conditions. Solving partial differential equations can be thought of as a constrained manifold completion problem. Knowing the right initial/boundary conditions and the law of the PDE (its Right-Hand-Side, RHS), we can solve it, and solve it uniquely if the problem is well posed. If the problem is underconstrained, we would find (too) many solutions; if it is overconstrained, we will find none. In traditional numerical analysis, one typically does not even embark upon solving such a problem, unless one is already certain the problem is well posed (and we are not even touching upon the relation between well posedness of the full problem and well posedness of its discretization, nor on the important issue of smooth dependence on initial/boundary conditions). There have been rivers of ink (and probably Gigabytes of storage) used for publications proving, conjecturing, exploiting the well-posedness of a problem on the path towards solving it. Enter machine learning approaches to numerically solving partial differential equations (to “fix ideas” as Hadamard said, let’s consider the powerful approach embodied in Physics-Informed Neural Networks, PINNs [ 2 ] ). The approaches are mainly variational, taking advantage of automatic differentiation and the programming ease of packages like TensorFlow and Pytorch. What we will discuss is not (emphatically not!) confined to machine learning approaches to solving PDEs. Yet it is only fair to acknowledge that these methods (and the software infrastructure associated with them) naturally give rise to new “experimental” avenues exploring/establishing well posedness. Because of their inherently variational nature, and because of the (ridiculous for the older ones of us) ease of obtaining a solution, they allow us to do what, up to say 10 years ago, was unthinkable: 1. Attempt (without fear!) to solve a problem a million times – rather than making trebly sure it is well posed before solving it; 2. Collect the solutions and explore (through, say, manifold learning) their statistics (their nature and intrinsic dimensionality, for example) as well as the degree to which they satisfy the loss function (the PDE residuals and the attempted initial/boundary conditions); 3. Armed with this information, attempt to establish well posedness; 4. If the problem is not well posed, explore what (and how much, and how many different options of how much) it would take it make it so. Why suddenly consider problems whose well posedness is unknown a priori , 103 years after Hadamard? The answer is simple: because in our big data era the observations are many, and are not obtained conveniently where his “geometers” would place them — at the domain boundary. They may be at the boundary or the interior ; they may be observations of some arbitrary mixed derivative(s) of the function in question; they may (what riches!) be available over entire connected or disconnected subdomains in space or space-time (see Figure 1); and they may – alas – be intrinsically incompatible, so that the problem is both oveconstrained and underconstrained simultaneously in different parts of the solution space domain. How to deal with these situations? More precisely: how to deal with these situations practically numerically? This is what this paper is

Read the complete text