Data-Efficient Neural Operator Training via Physics-Based Active Learning

Alicja Polanska, Lorenzo Zanisi, Vignesh Gopakumar, Stanislas Pamela · 2026

Read Data-Efficient Neural Operator Training via Physics-Based Active Learning by Alicja Polanska, Lorenzo Zanisi, Vignesh Gopakumar, Stanislas Pamela (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21348.txt.

Introduction

Alicja Polanska and co-authors present physics-based acquisition, an active learning method for data-efficient neural operator training. Neural operators cut simulation cost but need large training sets, and active learning selects the most informative samples in turn. Their method uses the partial differential equation residual to guide selection, adding a physics bias so simulation cost goes where the model's physical grasp is weakest. Tests on Burgers and Navier-Stokes equations show it beats random selection and matches the best prior data efficiency.

Catalog record

CREATORAlicja Polanska, Lorenzo Zanisi, Vignesh Gopakumar, Stanislas Pamela
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16236
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21348

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data-Efficient Neural Operator Training via Physics-Based Active Learning Alicja Polanska, Lorenzo Zanisi, Vignesh Gopakumar, Stanislas Pamela Abstract Solving partial differential equations with neural operators significantly reduces computational costs but remains bottlenecked by high training data requirements. Active learning offers a natural framework to mitigate this by selectively acquiring the most informative samples in an iterative manner. We introduce physics-based acquisition – a novel physics-informed active learning algorithm that leverages the partial differential equation residual to guide data selection. We validate the method by presenting numerical experiments for the 1D Burgers equation and the 2D compressible Navier-Stokes equations. We show that, in our experiments, physics-based acquisition consistently outperforms random acquisition and matches the state of the art in data efficiency. At the same time, it has the unique advantage of injecting a physics inductive bias into the training process, ensuring that simulation cost is spent where the model’s physical understanding is weakest. AL active learning PRE physics residual error PDE partial differential equation CPU central processing unit GPU graphical processing unit FNO Fourier neural operator LCMD largest cluster maximum distance IC initial condition PINN physics-informed neural network SBAL stochastic batch active learning FFT fast Fourier transform RMSE root mean square error UQ uncertainty quantification 1 Introduction In the physical sciences, PDE are the language used to describe complex dynamical systems. From modelling plasma dynamics in fusion reactors to simulating galaxy formation, we rely on numerical solvers to predict the evolution of complex and highly parameterised PDE systems. However, numerical solvers can be extremely computationally expensive, which prevents their use in highly iterative control and optimisation workflows. For example, high-fidelity plasma simulations can take several weeks if not months on modern supercomputers ( Smith et al. 2020 ) , galaxy formation simulations require millions of CPU hours ( Pillepich et al. 2017 ) . To alleviate this computational burden, many machine learning-based methods for approximating PDE solution operators have been proposed, most notably neural operator surrogate models ( Li et al. 2020b ; Kovachki et al. 2023 ; Lu et al. 2021 ; Takamoto et al. 2022 ) . Neural operators require large training sets to obtain surrogate models that perform well for a desired range of PDE parameters, initial and boundary conditions. As the training data comes from the very simulators the surrogate models are supposed to replace, we are posed with the proverbial ‘chicken-and-egg’ problem in surrogate modelling ( Brandstetter et al. 2022 ) : for very expensive simulators, it is essential to reduce the size of the training sets to make surrogate modelling feasible in the first place. AL ( AL ) offers a natural solution to this problem. As a paradigm designed to minimise labelling costs, AL iteratively selects the most informative unlabelled data points to add to the training set ( MacKay 1992 ; Ren et al. 2021 ; Li et al. 2024 ) . This approach is especially useful in settings where obtaining data labels carries a high cost, making it ideal for improving the data efficiency of neural operators. AL for PDE has been utilised in previous studies for simplified tasks such as the prediction of univariate outputs, or fixed time point solutions ( Pestourie et al. 2020 ; Pickering et al. 2022 ; Wu et al. 2023a ; Bajracharya et al. 2024 ; Wu et al. 2023b ) . Recently, AL has also been explored for the task of full spatio-temporal trajectory prediction with neural operators ( Musekamp et al. 2024 ; Kim et al. ) . Most of these works attempt to adapt standard AL tools to PDE learning by, e.g., prioritising acquisition of simulations where an ensemble of surrogates produces the highest variance ( Pestourie et al. 2020 ; Pickering et al. 2022 ) , information-theoretic arguments ( Wu et al. 2023b ; Wu et al. 2023a ) , variance reduction methods ( Kim et al. ) or clustering ( Musekamp et al. 2024 ) . Instead, we notice that the residual of the PDE provides a viable metric over the solution accuracy of the neural surrogate. Solutions with high residual values often tend to deviate further from the physical solution. PDE residuals are utilised widely for machine learning frameworks in the context of PINN ( Raissi et al. 2019 ) and have been the main workhorse of PDE analysis and optimisation within numerical and computational physics ( Quarteroni & Valli 2008 ) . In recent work, the PRE ( PRE ) was introduced as an uncertainty measure for neural operators ( Gopakumar et al. 2025 ) . The PRE provides a natural and physically-grounded acquisition function for AL : we can improve the surrogate by querying simulations where its current predictions are the most unphysical. Concurrently, PDE residuals have been utilised for single-shot coreset selection for neural operator training ( Satheesh et al. 2025 ) . However, such static approaches cannot adapt as the surrogate model improves during training. Our contributions are as follows: We introduce a novel physics-based acquisition strategy that utilises the PDE residual as a principled physics-informed measure of model epistemic uncertainty; We integrate this strategy into the al4pde framework ( Musekamp et al. 2024 ) , providing a robust benchmark against established methods; We demonstrate that our physics-based approach achieves competitive data efficiency with state-of-the-art methods, while injecting a physics inductive bias. 2 Methodology 2.1 Active Learning for Neural Operators Neural operators learn mappings between infinite-dimensional function spaces. For a given family of PDE , the model learns a discretisation-independent solution operator. Although many neural operator architectures have been devised in recent years ( Cao et al. 2023 ; Alkin et al. 2025 ; Serrano et al. 2024 ) , in this short proof-of-concept work, we focus on FNO ( Li et al. 2020a ) due to their efficiency and cost-accuracy trade-off ( de Hoop et al. 2022 ) . The FNO architecture is based on spectral convolutions, where the input to each layer is first converted to the frequency domain via a FFT ( FFT ), then multiplied by a weight matrix in Fourier space, and finally transformed back to the original domain using an inverse FFT ( Li et al. 2020a ) . We condition the model on the PDE parameters by appending the raw parameter values as additional constant channels to the model input ( Takamoto et al. 2023 ) , following the al4pde implementation ( Musekamp et al. 2024 ) . AL algorithms utilise acquisition functions to sample new training data iteratively from a data pool and have demonstrated data-efficiency gains across classification ( Ren et al. 2021 ) and regression ( Holzmüller et al. 2023 ) compared to the random sampling baseline. al4pde is a recently introduced extensible framework for the development and evaluation of AL algorithms for neural PDE solvers ( Musekamp et al. 2024 ) . It is implemented as an open-source Python package 1 1 1 https://github.com/dmusekamp/al4pde , providing solvers for a variety of parametric PDE , neural surrogate models and state-of-the-art AL algorithms borrowed from the literature on AL for standard regression problems ( Holzmüller et al. 2023 ) . Specifically, acquisition functions pick sets of IC and PDE parameters by exploiting surrogate solutions obtained autoregressively from trained

Read the complete text