TGLF-SINN: Deep Learning Surrogate Model for Accelerating Turbulent Transport Modeling in Fusion

Yadi Cao, Futian Zhang, Wesley Liu, Tom Neiser, Orso Meneghini, Lawson Fuller, Sterling Smith, Raffi Nazikian, Brian Sammuli, Rose Yu · 2025

Read TGLF-SINN: Deep Learning Surrogate Model for Accelerating Turbulent Transport Modeling in Fusion by Yadi Cao, Futian Zhang, Wesley Liu, Tom Neiser, Orso Meneghini, Lawson Fuller, Sterling Smith, Raffi Nazikian, Brian Sammuli, Rose Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07024.txt.

Introduction

Yadi Cao and 9 co-authors present a lean stand-in for a costly fusion model in a 2025 paper. The source model, TGLF, forecasts how turbulence moves heat and particles in a tokamak, a ring-shaped fusion device. A full device run needs that forecast thousands of times, which is far too slow, so a neural net stand-in is trained to give fast, smooth answers in its place.

Their net, TGLF-WINN, is built to learn from few cases. First, smart feature choices shrink the range the net must learn. Next, rules drawn from wave physics keep its answers sane when data are thin. Last, a Bayesian step picks the most telling new cases to train on, based on where the net is most unsure. The goal is a stand-in that stays true even when each training case is costly to make.

Catalog record

CREATORYadi Cao, Futian Zhang, Wesley Liu, Tom Neiser, Orso Meneghini, Lawson Fuller, Sterling Smith, Raffi Nazikian, Brian Sammuli, Rose Yu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07024

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TGLF-SINN: Deep Learning Surrogate Model for Accelerating Turbulent Transport Modeling in Fusion Yadi Cao, Futian Zhang, Wesley Liu, Tom Neiser, Orso Meneghini, Lawson Fuller, Sterling Smith, Raffi Nazikian, Brian Sammuli, Rose Yu Abstract The Trapped Gyro-Landau Fluid (TGLF) model provides fast, accurate predictions of turbulent transport in tokamaks, but whole device simulations requiring thousands of evaluations remain computationally expensive. Neural network (NN) surrogates offer accelerated inference with fully differentiable approximations that enable gradient-based coupling but typically require large training datasets to capture transport flux variations across plasma conditions, creating significant training burden and limiting applicability to expensive gyrokinetic simulations. We propose TGLF-SINN (Spectra-Informed Neural Network) with three key innovations: (1) principled feature engineering that reduces target prediction range, simplifying the learning task; (2) physics-guided regularization of transport spectra to improve generalization under sparse data; and (3) Bayesian Active Learning (BAL) to strategically select training samples based on model uncertainty, reducing data requirements while maintaining accuracy. Our approach achieves superior performance with significantly less training data. In offline settings, TGLF-SINN reduces logarithmic root mean squared error (LRMSE) by 12. 4% compared to the current baseline TGLF-NN . Using only 25% of the complete dataset with BAL, we achieve LRMSE only 0.0165 higher than TGLF-NN and 0.0248 higher than our offline model (0.0583). In downstream flux matching applications, our NN surrogate provides 45× speedup over TGLF while maintaining comparable accuracy, demonstrating potential for training efficient surrogates for higher-fidelity models where data acquisition is costly and sparse. 1 Introduction Comprehensive simulation of fusion devices (“whole-device” modeling) is critical for understanding plasma behavior and optimizing reactor performance [ 1 , 2 , 3 ] . Turbulent transport is central to these simulations, strongly coupled with neoclassical simulations [ 4 , 5 ] , pedestal regions [ 6 , 7 ] , and equilibrium modeling [ 8 , 9 , 10 , 11 ] . Although gyrokinetic simulations [ 12 , 13 , 14 , 15 , 16 ] provide the most comprehensive turbulent transport through five-dimensional phase space modeling, they are computationally expensive, requiring hours on supercomputers for single evaluations and making them impractical for coupled workflows. Reduced order models (ROMs) based on quasi-linear theory [ 17 , 18 , 19 ] mitigate these costs by performing linear instability analysis and then post-fixing with theory-based “saturation rules” [ 20 ] that are calibrated on datasets generated by gyrokinetic simulations. The Trapped Gyro-Landau Fluid (TGLF) model [ 21 , 20 , 22 ] represents the state of the art, which requires only seconds per evaluation versus hours for gyrokinetic simulations. However, whole-device simulations that require thousands of transport evaluations per time step remain computationally expensive. Machine learning has accelerated physics simulations in all domains [ 23 , 24 , 25 , 26 ] , with fusion applications in control optimization [ 27 , 28 ] and surrogate modeling. Direct plasma profile evolution surrogates using CNNs and LSTMs [ 29 , 30 ] show significant prediction errors, while Fourier neural networks applied to MHD data [ 31 , 32 ] use coarser modeling than kinetic theory. Moreover, directly surrogating plasma profile evolution is not practical, as it requires an exhaustive dataset that accounts for all factors from multiphysics components and control signals in tokamak operation. In contrast, component-level surrogates for turbulent transport [ 33 , 34 , 35 , 36 , 37 ] offer more practical alternatives. TGLF-NN [ 34 , 35 ] trains neural networks to predict the TGLF output, reducing the evaluation time to microseconds. However, these methods require large datasets to capture wide parameter ranges and flux magnitude variations. QuaLiKiz-NN addresses this through mixture-of-experts (MOE) design [ 36 , 37 ] , dividing datasets by instability modes and promoting negative flux predictions during training while clipping to zero during inference. Yet, this approach has limitations: comprehensive models like TGLF don’t inherently clip fluxes, and predictions remain sensitive to expert misclassification. In this paper, we propose TGLF-SINN (Spectra-Informed Neural Network) to address data-efficiency challenges through three key improvements: 1) Feature Tuning : Systematic feature engineering and preprocessing with new loss terms that improve flux magnitude differentiability over TGLF-NN ; 2) Spectral Regularization : Incorporating per-wavenumber transport fluxes as regularization terms, leveraging TGLF’s spectral integration structure; 3) Bayesian Active Learning (BAL) : Strategic data point selection using Expected Information Gain [ 39 ] to minimize training data requirements [ 38 ] . Our experiments demonstrate that these combined innovations yield more accurate, noise-robust surrogates, particularly in sparse data settings. With BAL, TGLF-SINN achieves comparable performance using only 25% of full datasets, with LRMSE only 0.0165 higher than TGLF-NN offline performance and 0.0248 higher than TGLF-SINN offline results. Our contributions include: (1) TGLF-SINN, incorporating principled feature engineering and spectra-informed regularization for improved accuracy over TGLF-NN ; (2) demonstration of superior robustness in noisy, sparse dataset settings; (3) BAL integration reducing data requirements to a fraction of full datasets; (4) validation of our method in downstream flux-macthing applictions. Combined, our method shows a great potention for extension to higher-fidelity models like full gyrokinetic simulations [ 40 ] where data generation is prohibitively expensive. 2 Related Work TGLF and Saturation Rules. TGLF [ 21 , 20 ] is a quasi-linear transport model that projects gyrokinetic equations into moment equations. It then performs linear mode analysis at N_{y} different wavenumbers \{k_{y1}^{1},\dots,k_{y}^{N_{y}}\} around the thermal equilibrium distribution to obtain quasilinear weights and intensities, with nonlinear mode interactions post-modeled using empirical “saturation rules” [ 41 , 42 , 20 ] that are calibrated on a dataset simulated by gyrokinetic simulations. TGLF is extensively validated and considered state-of-the-art for plasma studies [ 34 , 35 ] . We use TGLF with the “SAT2” [ 43 , 44 , 45 , 46 ] saturation rule as our training targets. Machine Learning Surrogates for Fusion. There are two distinct approaches for surrogate modeling in plasma: 1) learning complete plasma profile evolution (CNN+LSTM [ 29 ] , FNO [ 31 , 32 ] ), and 2) learning components like core turbulent transport [ 33 , 34 , 35 , 36 , 37 ] . The former suffers from high training difficulty and scalability issues due to hidimensional inputs due to multi-physics and control variables, making the curation datasets impractical. Component-level approaches narrow input ranges, enabling easier training and flexible downstream coupling. We focus on core turbulent transport surrogates using TGLF-NN [ 34 , 35 ] as our baseline. Bayesian Methods for Fusion. Bayesian methods are proven useful in fusion diagnostics and equilibrium inference [ 47 , 48 , 49 , 50 , 51 , 52 , 53 ] and coupling between different physics components [ 54 ] . Bayesian active learning (BAL) s a specific instance of Bayesian optimization, who selects informative data points for expensive acquisition scenarios and has been applied to QuaLiKiz surrogates [ 36 ] . We employ BAL as one of the contribution to reduce TGLF-SINN training data requirements. 3 Preliminaries 3.1 TGLF and Saturation Rules TGLF computes the total turbulent fluxes of particles \Gamma , momentum \Pi , and heat Q by summing the contributions from each linear mode at different wavenumbers \{k_{y}^{1},\dots,k_{y}^{N_{y}}\} : \Gamma=\sum_{j=1}^{N_{y}}\Gamma^{j}(k_{y}^{j}),\quad\Pi=\sum_{j=1}^{N_{y}}\Pi^{j}(k_{y}^{j}),\quad Q=\sum_{j=1}^{N_{y}}Q^{j}(k_{y}^{j}). (1) Here, \Gamma^{j},\Pi^{j},Q^{j} denote the corresponding fluxes at each wavenumber k_{y}^{j} . These contributions

Read the complete text