Discretization-independent multifidelity operator learning for partial differential equations
Jacob Hauck, Yanzhi Zhang · 2025
Read Discretization-independent multifidelity operator learning for partial differential equations by Jacob Hauck, Yanzhi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07292.txt.
Introduction
Jacob Hauck and Yanzhi Zhang develop an operator learning model for equations that govern physics, in work from 2025. Such models learn the map from an input function to a solution function. A practical snag is that most models are tied to one grid, so changing resolution can break them.
Their encode, approximate, and reconstruct design learns basis representations for inputs and outputs. That makes the model independent of the grid used. The authors prove approximation guarantees under both strong and weaker assumptions. Tests cover local and non local equations, steady and time dependent. The work is framed as a first full study of how grid freedom enables learning at many resolutions.
Catalog record
| CREATOR | Jacob Hauck, Yanzhi Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-07292
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Discretization-independent multifidelity operator learning for partial differential equations Jacob Hauck, Yanzhi Zhang Abstract We develop a new and general encode-approximate-reconstruct operator learning model that leverages learned neural representations of bases for input and output function distributions. We introduce the concepts of numerical operator learning and discretization independence , which clarify the relationship between theoretical formulations and practical realizations of operator learning models. Our model is discretization-independent, making it particularly effective for multifidelity learning. We establish theoretical approximation guarantees, demonstrating uniform universal approximation under strong assumptions on the input functions and statistical approximation under weaker conditions. To our knowledge, this is the first comprehensive study that investigates how discretization independence enables robust and efficient multifidelity operator learning. We validate our method through extensive numerical experiments involving both local and nonlocal PDEs, including time-independent and time-dependent problems. The results show that multifidelity training significantly improves accuracy and computational efficiency. Moreover, multifidelity training further enhances empirical discretization independence. Keywords. Operator learning, discretization independence, multifidelity learning, reduced-order modeling, performance gap, nonlocal PDEs. 1 Introduction Operator learning is a relatively new form of machine learning in which one attempts to learn an operator, in the functional analysis sense, instead of a single function [ 37 , 20 ] . Such models are usually applied to learning function-to-function mappings in the context of partial differential equations (PDEs), most often the solution operators of PDEs, which map an input function, like an initial condition or coefficient function, to the corresponding solution of the PDE [ 18 ] . Operator learning has been applied to many scientific and engineering problems, for example to fluid flow in porous media [ 7 ] and turbulent flow modeling in fluid mechanics [ 26 ] , to crack propagation in material science [ 12 ] , to climate modeling [ 17 ] , and to multiphase flow in geophysics [ 39 ] . Operator learning for solving complex problems is increasing in popularity primarily due to its potential to provide significantly more efficient surrogate solvers that rely only on data (meaning that no knowledge of the underlying system is required) [ 23 ] . To be considered true approximations of an operator, models in operator learning should, like traditional numerical methods, have the ability to produce accurate results independent of the discretization used to represent the input and output functions [ 23 ] . We will call this property discretization independence . 1 1 1 Although some ideas have been proposed [ 18 , 2 ] to define discretization independence mathematically, there is still a lack of consensus; although, it is generally agreed that some form of discretization independence distinguishes operator learning from other machine learning methods. An important consequence of discretization independence of operator learning models is that they can handle naturally multifidelity problems, which are characterized by the presence of data with multiple levels of fidelity to the true underlying functions being represented. Most operator learning models, however, have only been applied to high fidelity data. Multifidelity operator learning is important because there is a trade-off between level of fidelity and cost to obtain for data: generally, the higher the fidelity, the greater the accuracy but also the greater the cost to obtain and to use [ 10 ] . Multifidelity learning reduces the cost of data generation and model training by lowering the fidelity of training data as much as possible without sacrificing accuracy, which is particularly important since operator learning often requires large datasets to be effective. However, optimizing this cost–accuracy tradeoff is largely unstudied in operator learning; we aim to address this gap in this work. Existing operator learning methods can be broadly classified into three groups according to their overall structure: neural operators [ 22 , 23 ] , transformers [ 5 , 25 ] , and encode-approximate-reconstruct models [ 20 , 13 ] . The encode-approximate-reconstruct framework has two main advantages over other approaches: simple structure and well-understood approximation theory [ 21 ] . These methods, however, often fail to be discretization independent because some architectural choices depend on a specific representation of the input or output function [ 4 , 14 , 28 ] . For example, DeepONet [ 28 ] requires the input function to be sampled on a fixed set of sensor points; more detailed discussion on discretization independence, or lack thereof, for encode-approximate-reconstruct methods is given in Section 3.1 . Consequently, these methods currently struggle to handle multifidelity problems. So far a limited number of other methods have attempted to use encode-approximate-reconstruct models for multifidelity learning [ 15 , 30 , 8 ] , but these methods require separate submodels to handle different fidelities, as the underlying models used are not discretization independent. We remark that the idea of discretization independence has been explored for neural operators [ 18 ] and transformers [ 5 , 11 ] in relation to different sampling meshes [ 25 , 23 ] , in which they have been shown to be very effective, but the use of discretization independence in these models has not been applied to multifidelity learning. In this work, we develop a new and general encode-approximate-reconstruct operator learning model that is discretization-independent and inherently enables multifidelity learning (see Figure 1 ). Our main contributions can be summarized as follows: • We develop the new concepts of numerical operator learning and discretization independence . These concepts clarify the relationship between theoretical and practical realizations of operator learning and provide a novel qualitative means of comparing operator learning models in terms of discretization independence, which we demonstrate on several popular models. • We propose a novel operator learning architecture that learns neural representations of bases for input and output function distributions. We prove theoretical approximation guarantees for our method, demonstrating universal approximation in a uniform sense, under strong assumptions on the input functions, and in a statistical sense, under weaker assumptions. Our method has significantly better discretization independence compared to existing approaches. • Our method enables the seamless integration of data representations with variable fidelity through the explicit handling of different discretizations, making it particularly effective for multifidelity learning. We conduct the first detailed study on how discretization independence facilitates multifidelity operator learning and validate it through extensive experiments. Our experiments verify the discretization independence of our method. Furthermore, we demonstrate that multifidelity training can reduce some types of error caused by low-fidelity training data, enabling faster training with lower-fidelity, and therefore less expensive, datasets. Moreover, our experiments show that multifidelity training can further improve empirical discretization independence. Figure 1: Diagram of the proposed operator learning model. This paper is organized as follows. In Section 2 we introduce operator learning and present a more general concept of discretization independence. In Section 3 we describe our new method, demonstrate its discretization independence properties, prove approximation theorems, and show that other encode-approximate-reconstruct have limited discretization independence in comparison. In Section 4 we perform numerical experiments that verify discretization independence of our method in practice and also provide insights into issues with single-fidelity learning and benefits of multifidelity learning using our model. Finally, in Section 5 we provide some concluding remarks and discussion. 2 Background and related work In this section we establish the main concepts of