A Surrogate-Augmented Symbolic CFD-Driven Training Framework for Accelerating Multi-objective Physical Model Development Journal: Journal of Computational Physics
Yuan Fang, Fabian Waschkowski, Maximilian Reissmann, Richard D. Sandberg, Takuo Oda, Koichi Tanimoto · 2025
Read A Surrogate-Augmented Symbolic CFD-Driven Training Framework for Accelerating Multi-objective Physical Model Development Journal: Journal of Computational Physics by Yuan Fang, Fabian Waschkowski, Maximilian Reissmann, Richard D. Sandberg, Takuo Oda, Koichi Tanimoto (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19031.txt.
Introduction
Yuan Fang and five co-authors speed up a costly way of building flow models for fluid simulations. In CFD-driven training, each candidate formula from machine learning is placed inside a fluid solver and checked against reference data. Hundreds or thousands of full runs make the process very expensive for complex flows.
A fast surrogate model learns from past solver runs and guesses each new candidate's error first. Only candidates with small predicted error, or high doubt, earn a full solver run. The surrogate also handles several goals at once. Across one- and two-dimensional flows, training cost fell sharply while accuracy stayed close to the original method.
Catalog record
| CREATOR | Yuan Fang, Fabian Waschkowski, Maximilian Reissmann, Richard D. Sandberg, Takuo Oda, Koichi Tanimoto |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-19031
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Surrogate-Augmented Symbolic CFD-Driven Training Framework for Accelerating Multi-objective Physical Model Development Journal: Journal of Computational Physics Yuan Fang, Fabian Waschkowski, Maximilian Reissmann, Richard D. Sandberg, Takuo Oda, Koichi Tanimoto Abstract Computational Fluid Dynamics (CFD)-driven training, which combines machine learning (ML) techniques with fluid dynamics software that provides CFD feedback, has shown great potential for developing implementable and physically consistent closure models with improved accuracy compared to conventional baseline models. In the original CFD-driven training framework, each ML-generated candidate model is embedded in a CFD solver, and its performance is evaluated by comparing computed quantities of interest against reference data. However, exploring optimal models requires hundreds to thousands of CFD evaluations, resulting in prohibitive training costs for complex industrial flows, where a single CFD calculation can already be computationally expensive. To address this limitation, we propose an extended framework that, for the first time, integrates surrogate modeling into symbolic CFD-driven training in real time, aiming to reduce the overall training cost. The surrogate model learns to approximate the errors of the ML-generated models based on previous CFD evaluations, and this surrogate mapping is continuously refined throughout the training process. Newly generated models are first assessed by the surrogate. Only those predicted to yield small errors or high uncertainty are subsequently re-evaluated with full CFD computations. Specifically, the generated discrete expressions from symbolic regression are mapped into a continuous space using the averaged values of the input symbols as inputs to the probabilistic surrogate model. To accommodate multi-objective model training, particularly in situations where assigning fixed weights to competing quantities is challenging, the surrogate model is further generalized to multi-output settings. This is achieved by extending the kernel function to a matrix form, enabling one mean and variance prediction per training objective. Based on these probabilistic outputs, various selection metrics and thresholds are evaluated to identify the optimal setup. The proposed surrogate-augmented CFD-driven training framework is developed and demonstrated across a range of cases, encompassing statistically one- and two-dimensional flows, as well as single-expression (targeting only the turbulence model) and multi-expression (simultaneous optimization of both turbulence and heat-flux models). Across all cases, the framework achieves a substantial reduction in training cost while the resulting models maintain comparable predictive accuracy to those obtained with the original CFD-driven approach. † † graphicalabstract: † † highlights: Integrated surrogate modeling into a symbolic-regression CFD-driven training framework for physical-model development Verified the framework’s robustness across varied hyperparameter settings and flow cases involving turbulence alone or coupled with heat flux. 1 Introduction Among the various efforts to incorporate machine learning (ML) into physical model development, Computational Fluid Dynamics (CFD)-driven training has demonstrated remarkable and continuing success [ 34 , 22 , 30 ] . In this approach, ML algorithms are directly coupled with CFD solvers, so that each ML-generated candidate model is embedded in the solver and evaluated via full CFD calculations. The CFD outputs are then used to compute the cost function, which serves as feedback to the ML algorithm. The training process continues iteratively until the cost function converges to a predefined threshold or the maximum number of iterations is reached. This tight integration offers two advantages: Firstly, the trained models exhibit strong robustness and physical consistency, since they are validated within the CFD solver rather than merely fitted to post-processed training goals [ 31 ] . Secondly, the cost function can be flexibly defined in terms of quantities of engineering interest beyond the closure terms themselves, allowing the model to be trained to target any physically meaningful flow quantities that can be extracted from the CFD solution. These advantages enable the development of turbulence [ 34 , 22 ] , heat flux [ 32 ] , transition [ 7 ] models in Reynolds-Averaged Navier-Stokes (RANS) calculations, or LES sub-grid-scale [ 21 ] and wall [ 5 ] models using only limited reference data, thus even sparse experimental data can be employed for model training. Extensions to the CFD-driven training framework have enabled the development of physical models for increasingly complex flow scenarios, but have also increased training costs. Waschkowski [ 30 ] developed two such functionalities, named multi-expression and multi-objective training. The former allows multiple models that interactively affect the final flow prediction, such as coupled transition and turbulence modeling [ 7 ] or joint heat flux and turbulence modeling [ 33 ] , to be trained simultaneously. The latter enables consideration of multiple quantities of interest in constructing the cost function without predefining their relative weights, thereby avoiding bias in the optimization process [ 7 , 1 ] . Moreover, to improve the generalizability of ML-trained models, multi-case training has been proposed to train models across multiple flow cases with varying geometries and operation conditions [ 8 ] . Although these extensions significantly expand the applicability of CFD-driven training to complex and realistic problems, they also enlarge the search space, thereby increasing training costs. For example, if the ML algorithm initially generates 100 candidate models and subsequently updates 50 models in each of the following 100 training iterations, assuming that one CFD evaluation requires one core hour, the total computational cost amounts to (100+50\times 99)\times 1=5,050 core hours. This severely limits the applicability of the CFD-driven training framework to more complex, industry-related cases, such as unsteady, three-dimensional, or multiphase flows, where even a single CFD calculation is computationally expensive. Therefore, the extremely high training cost remains a significant barrier to the broader application of CFD-driven training. To mitigate this prohibitive computational cost, this study introduces surrogate modeling into the CFD-driven training framework. Surrogate modeling techniques have demonstrated great potential in design optimization problems [ 13 , 24 , 9 ] , uncertainty quantification [ 26 , 28 ] and inverse modeling [ 2 , 17 ] , where they effectively bridge the gap between limited high-fidelity data and low-fidelity predictions. For CFD-driven training, the surrogate model is designed to exploit the wealth of information contained in previously generated models, including those with relatively large errors that are typically discarded, and to leverage this information to reduce training cost. It is expected that as the training progresses, many candidate models become fine-tuned and share similar structures and comparable performance, making full CFD evaluations for all of them unnecessary and computationally expensive. Surrogate modeling, which constructs a computationally efficient approximation of a complex and expensive system using data from a limited number of prior evaluations, therefore naturally fits this problem. By learning from accumulated CFD results from earlier training and continuously refining itself during subsequent iterations, the surrogate model can predict the performance of most newly generated candidates, allowing full CFD evaluations to be reserved for those with high potential or considerable uncertainty. This integration is expected to reduce overall training costs while maintaining substantial predictive accuracy. Various surrogate modeling approaches have been proposed in the literature. Traditional polynomial response surface models approximate the system response using low-order polynomials in the input variables; however, they suffer from the curse of dimensionality, as the number of polynomial terms grows with the number of inputs. This often leads to overfitting and limits their capability to capture complex nonlinear relationships [ 4 , 3 ] . Radial basis function (RBF) models, on the other hand, offer good interpolation