Goal-Driven Adaptive Sampling Strategies for Machine Learning Models Predicting Fields Journal: Aerospace Science and Technology
Jigar Parekh, Philipp Bekemeyer · 2026
Read Goal-Driven Adaptive Sampling Strategies for Machine Learning Models Predicting Fields Journal: Aerospace Science and Technology by Jigar Parekh, Philipp Bekemeyer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21832.txt.
Introduction
Jigar Parekh and Philipp Bekemeyer study how to teach machine learning models from costly simulations without wasting runs. Models that predict whole physical fields, such as airflow, are prized because full simulations like computational fluid dynamics are expensive. Each training sample costs real computing time.
The challenge is reaching the accuracy a task needs with as few samples as possible. The authors develop goal-driven adaptive sampling strategies, which choose new samples based on the end goal rather than generic coverage. Their work appeared in an aerospace science and technology journal context in 2026. Smarter sampling matters in engineering design, where a model that is accurate in the wrong places is little better than no model at all.
Catalog record
| CREATOR | Jigar Parekh, Philipp Bekemeyer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21832
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Goal-Driven Adaptive Sampling Strategies for Machine Learning Models Predicting Fields Journal: Aerospace Science and Technology Jigar Parekh, Philipp Bekemeyer Abstract Machine learning models are widely regarded as a way forward to tackle multi-query challenges that arise once expensive black-box simulations such as computational fluid dynamics are investigated. However, ensuring the desired level of accuracy for a certain task at minimal computational cost, e.g. as few black-box samples as possible, remains a challenges. Active learning strategies are used for scalar quantities to overcome this challenges and different so-called infill criteria exists and are commonly employed in several scenarios. Even though needed in various field an extension of active learning strategies towards field predictions is still lacking or limited to very specific scenarios and/or model types. In this paper we propose an active learning strategy for machine learning models that are capable if predicting field which is agnostic to the model architecture itself. For doing so, we combine a well-established Gaussian process model for a scalar reference value and simultaneously aim at reducing the epistemic model error and the difference between scalar and field predictions. Different specific forms of the above-mentioned approach are introduced and compared to each other as well as only scalar-valued based infill. Results are presented for the NASA common research model for an uncertainty propagation task showcasing high level of accuracy at significantly smaller cost compared to an approach without active learning. PACS 0000 , 1111 MSC 0000 , 1111 † † graphicalabstract: † † highlights: A model-agnostic active learning strategy for field predictions that extends classical infill criteria beyond scalar outputs. A unified scalar–field surrogate training framework that jointly reduces epistemic uncertainty and enforces consistency between global coefficients and distributed values. Significant accuracy gains at reduced computational cost, demonstrated on the NASA Common Research Model for uncertainty propagation. 1 Introduction High-fidelity aerodynamic simulations (e.g. CFD solutions of the flow around an aircraft) provide detailed flow field information and accurate performance metrics, but they remain computationally expensive especially if multiple parameter combination are to be investigated. Surrogate modeling has become a cornerstone in aerodynamic design to at least partially alleviate this cost. Data-driven models such as Gaussian process regressions, reduced-order models (ROMs), or machine learning and deep learning models, such as graph neural networks (GNNs) are trained to approximate the simulation outputs, trading a high upfront simulation cost for a fast predictive model. A critical challenge is to ensure that the surrogate is sufficiently accurate with a limited number of training samples (simulation runs). The design and analysis of computer experiments is well established in the literature [ 27 , 48 , 1 ] providing a solid basis with samples spread of the design space. However, domain specifics like the difference between subsonic and transonic flow are unknown to such design of experiment techniques and, hence, can not be accounted for. Adaptive sampling, or active learning, addresses this by iteratively selecting new sample points in the design or parameter space that are expected to maximally improve the surrogate. For scalar objectives – for example, predicting a single quantity like a drag coefficient or lift-to-drag ratio – there are well-established infill (acquisition) criteria that guide this selection. A classic approach is the Efficient Global Optimization (EGO) algorithm using the expected improvement (EI) criterion [ 26 , 46 ] , which balances exploration and exploitation by favoring points likely to yield a better optimum of the objective. Alternatively, when the goal is accurate surrogate modeling for uncertainty quantification (UQ) rather than purely optimization, one can target reductions in the surrogate’s prediction error across the input distribution. In Gaussian process (GP) surrogates, for instance, methods like Active Learning Cohn (ALC) choose new samples that would maximally reduce the integrated predictive variance of the model [ 3 ] . Such variance-based criteria (related to integrated mean squared error) seek to minimize overall surrogate uncertainty with respect to the input probability density function, ensuring the model is accurate on average for UQ analysis [ 21 , 8 , 50 ] . In summary, for single-output surrogates, techniques like EI and variance reduction provide principled ways to improve surrogate fidelity with minimal samples [ 3 , 21 ] . These methods have been successfully applied in aerodynamic optimization and analysis, where adaptively sampling the design space yields faster convergence to optimal designs and more reliable surrogate predictions than space-filling designs alone. However, many problems in aerodynamic design and analysis demand field predictions rather than just scalar outputs. For example, predicting the pressure or velocity field around an airfoil or across a wing’s surface is crucial for understanding shock locations, flow separation, and structural loads — information that a single scalar, e.g. the drag coefficient, cannot capture. Building surrogates for such distributed outputs which can be thought of as high-dimensional vectors or functions defined on a spatial domain is far more complex. First, the dimensionality of the output – potentially thousands of values describing a field – often necessitates some form of dimensionality reduction. Common approaches include reduced-order modeling techniques such as proper orthogonal decomposition (POD) to represent the field in terms of a few dominant modes or the mapping of a latent variable to the field [ 39 , 55 ] . Alternatively, one may use deep learning models such as autoencoders that learn a compressed latent representation of the field. Second, even if a surrogate can predict a field, adaptively sampling to improve a field prediction surrogate is not straightforward. In contrast to a scalar objective, a field has many features and possible sources of error, e.g. a surrogate might accurately predict overall trends but miss a local shock entirely. Hence, there is a need for field-based infill criteria that guide the selection of new simulation points by considering the surrogate’s performance on the entire field output. Some studies have begun to explore this; for instance, adaptive sampling strategies for POD-based surrogates have been proposed to iteratively fill the parametric space and improve the surrogate accuracy [ 22 ] . Furthermore, vector-valued Gaussian processes, which extend standard GP models to directly handle multi-output fields and quantify uncertainty over them, have been developed to drive max-variance based infill strategies [ 2 , 42 ] . However, proposed techniques are either limited in scope or tailored towards a certain model type. Extending adaptive sampling to field prediction tasks raises several key challenges. 1. Scalarizing field outputs: Unlike a single objective, a field output must be summarized or reduced to a one-dimensional criterion for decision-making. Determining an appropriate scalarization (for example, an integrated error norm over the field, a worst-case error, or a weighted sum of errors at critical locations) is non-trivial and can bias the sampling toward certain regions of the input space. Multiobjective optimization research offers many scalarizing functions to combine multiple objectives into one [ 10 ] , but those methods typically handle a handful of objectives, not the thousands of degrees of freedom in a field. Applying a naive scalarization to a field (e.g. simply using the average error) might overlook localized phenomena, whereas focusing only on the maximum error might overweight outliers. Thus, defining a scalar criterion that truly reflects surrogate field accuracy is an open question. 2. Managing epistemic uncertainty: