Active operator learning with predictive uncertainty quantification for partial differential equations
Nick Winovich, Mitchell Daneker †, Lu Lu, Guang Lin ∗ · 2025
Read Active operator learning with predictive uncertainty quantification for partial differential equations by Nick Winovich, Mitchell Daneker †, Lu Lu, Guang Lin ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03178.txt.
Introduction
Nick Winovich and three co-authors present a 2025 paper on fast solvers for partial differential equations that also own up to their doubt. Neural operators can spit out solutions in a flash, but users need to know how far to trust each answer. Older doubt gauges cost a lot to train and run.
Their light method is built for a popular solver type and ports to kin solvers too. On linear and curved test equations, its doubt bands were fair and held up on new kinds of inputs. The authors show the bands can steer tasks like Bayesian search that full solvers make too pricey.
Catalog record
| CREATOR | Nick Winovich, Mitchell Daneker †, Lu Lu, Guang Lin ∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 113 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03178
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Active operator learning with predictive uncertainty quantification for partial differential equations Nick Winovich, Mitchell Daneker †, Lu Lu, Guang Lin ∗ Abstract With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying reliable surrogate models in scientific applications. Existing uncertainty quantification (UQ) frameworks employ ensembles or Bayesian methods, which can incur substantial computational costs during both training and inference. We propose a lightweight predictive UQ method tailored for Deep operator networks (DeepONets) that also generalizes to other operator networks. Numerical experiments on linear and nonlinear PDEs demonstrate that the framework’s uncertainty estimates are unbiased and provide accurate out-of-distribution uncertainty predictions with a sufficiently large training dataset. Our framework provides fast inference and uncertainty estimates that can efficiently drive outer-loop analyses that would be prohibitively expensive with conventional solvers. We demonstrate how predictive uncertainties can be used in the context of Bayesian optimization and active learning problems to yield improvements in accuracy and data-efficiency for outer-loop optimization procedures. In the active learning setup, we extend the framework to Fourier Neural Operators (FNO) and describe a generalized method for other operator networks. To enable real-time deployment, we introduce an inference strategy based on precomputed trunk outputs and a sparse placement matrix, reducing evaluation time by more than a factor of five. Our method provides a practical route to uncertainty-aware operator learning in time-sensitive settings. Journal: Journal of Computational Physics 1 Introduction Understanding and managing uncertainty is essential for data-driven models in high-consequence, real-time environments. This has motivated extensive research on uncertainty quantification (UQ), which estimates confidence in predictions based on data availability Smith [2013] , Sullivan [2015] , Karniadakis et al. [2021] . At the same time, scientific and engineering teams are quickly adopting neural surrogates to accelerate demanding tasks such as solving PDEs and performing adaptive simulations Zhou and Barati Farimani [2025] . These models offer speed and flexibility, but ensuring their predictions are trustworthy via traditional UQ remains a challenge due to high computational costs and the black-box nature of neural surrogates. Neural surrogates leverage the Universal Approximation Theorem, which states that neural networks can approximate any continuous function under mild conditions Cybenko [1989] , Hornik et al. [1989] , Leshno et al. [1993] . Building on this, operator networks such as DeepONet Lu et al. [2021] and Fourier Neural Operators (FNO) Li et al. [2020a] extend the idea by learning solution operators for entire families of PDEs with a single trained model Zhang et al. [2024] , Zhang [2024] . When using neural surrogates, however, accurate approximations from large datasets are not enough; without trustworthy uncertainty information, surrogates can mislead downstream decisions critical for creating effective control policies and guiding experimental design. This undermines the robustness of adaptive workflows, highlighting a pressing open question: how can these models be augmented with computationally efficient and reliable uncertainty estimates to support trustworthy decision-making Zhu et al. [2023] , Lee et al. [2024] ? Current UQ techniques for operator networks frequently use ensembles or Bayesian training schemes. Randomized-prior techniques like UQDeepONet Yang et al. [2022] and Bayesian DeepONet Lin et al. [2022] offer useful uncertainty estimates but have significant computational overhead, particularly during inference time when parallelism is constrained. Ensemble-based UQ evaluation costs scale linearly with ensemble size and as such, is generally impractical for real-time applications without access to considerable high-performance computing resources. As DeepONets have been promoted as fast surrogates Lin et al. [2023] , with work like POD-DeepONet Lu et al. [2022] targeting even further speed improvements, introducing computational bottlenecks to facilitate UQ fundamentally undermines their practical utility. These limitations are particularly important because the uses of uncertainty quantification extends beyond error estimation; it supports adaptive procedures such as model improvement via active learning (AL) and target optimization via Bayesian optimization (BO). Pickering et al. Pickering et al. [2022] demonstrated that DeepONet models equipped with UQ can guide data acquisition for AL, reducing costs in complex simulations and experiments Settles [2009] , Gal et al. [2017] , Houlsby et al. [2011] , Karniadakis et al. [2021] . Related strategies, such as BO, leverage UQ to balance exploration and exploitation. The literature leaves a gap for lightweight, predictive uncertainty methods that calibrate to model error in deterministic-training regimes and integrate seamlessly with outer-loop tasks. Figure 1 : (a) The uncertainty-equipped operator network architecture splits predictions into mean and variance estimates. Depending on the operator network used, the uncertainty predictions could be integrated into the network like for our DeepONet, or an external (secondary) network such as for FNO. Which framework is used will depend on network architecture, but generalizes to any operator network. We interpret network outputs as parameters for a predictive probability distribution, which are calibrated to the observed error distributions during training. (b) The uncertainty estimates provided by the operator networks are employed to help guide outer-loop data aquisition procedures in function spaces . The quantity of interest (QoI) and variance estimates are derived from the operator network predictions, and this information is used to guide data acquisition by balancing exploitation and exploration. In this work, we introduce a generalizable predictive UQ framework for operator networks, based on ConvPDE-UQ networks Winovich et al. [2019] and developed in parallel with the works of Moya et al. Moya et al. [2023] , Moya et al. [2025] . In contrast to Moya’s 2025 work comparing conformalized DeepONets with Bayesian ensembles and other works in the literature, our framework extends predictive UQ to generalized operators for regression tasks. Additionally, we integrate our network into Bayesian-optimization and active-learning pipelines, with examples using DeepONet and FNO. We introduce a novel placement matrix for more efficient structured outputs during model deployment and provide a detailed architecture for DeepONet that delivers calibrated variance estimates using a single network. Predictive uncertainty avoids ensembles and keeps overhead low during both training and inference. The framework interprets network outputs as parameters of a predictive distribution and calibrates these parameters to observed error distributions via a negative log-likelihood (NLL) loss. To separate mean and uncertainty predictions, we split the final layers of the branch and trunk and use a log- \sigma parameterization for stability. We validate our approach on linear and nonlinear PDEs and assess generalization on both in-distribution and out-of-distribution (OoD) function spaces. The predictive uncertainty estimates are well-aligned with observed errors near the tail-end of training, remain unbiased and non-skewed, and increase appropriately in more challenging OoD regimes while staying low in simpler cases. Finally, we demonstrate how predictive UQ accelerates outer-loop procedures in a visually intuitive BO example in 1D time with two peaks in parameter space as well as a more demanding AL setup for a 2D advection problem where we compare traditional UQ methods (Bayesian networks and Ensembles) to ours. We finally showcase our method in an AL scenario where traditional UQ is too expensive, a 2D wave equation on a star-shaped domain, showing improved data efficiency and accuracy relative to baselines without UQ. An overview of the uncertainty-equipped networks and outer-loop workflows is provided in Fig. 1 , with distinctions for our optimized single network DeepONet (integrated UQ) and using secondary