Self-scaling tensor basis neural network for Reynolds stress modeling of wall-bounded turbulence

Zelong Yuan, Yuzhu Pearl Li · 2026

Read Self-scaling tensor basis neural network for Reynolds stress modeling of wall-bounded turbulence by Zelong Yuan, Yuzhu Pearl Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29659.txt.

Introduction

Yuan and Li present a self-scaling tensor basis neural network for Reynolds stress in wall-bounded turbulence. Tensor basis networks are a grounded way to close RANS simulations. Their weak point is robustness across Reynolds numbers and shapes. The new model normalizes inputs with velocity-gradient invariants. That gives a built-in scale with no empirical coefficients or wall distance. The form keeps Galilean and rotational invariance. Tests on channel and hill flows matched simulation data closely. A model trained at low Reynolds number generalized to higher ones.

Catalog record

CREATORZelong Yuan, Yuzhu Pearl Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58670
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29659

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-scaling tensor basis neural network for Reynolds stress modeling of wall-bounded turbulence Zelong Yuan, Yuzhu Pearl Li Abstract Recent advances in data-driven turbulence modeling have established tensor basis neural networks (TBNN) as a physically grounded framework for Reynolds-stress closure in Reynolds-averaged Navier–Stokes (RANS) simulations. However, their robustness in wall-bounded turbulent flows remains limited across Reynolds numbers and geometries due to the lack of an intrinsic scaling mechanism. In this work, we propose a self-scaling tensor basis neural network (STBNN) for Reynolds-stress modeling of wall-bounded turbulence. The model incorporates an invariant velocity-gradient normalization derived from the first two invariants of the velocity-gradient tensor, providing an intrinsic and geometry-independent scale that balances strain and rotation effects without relying on empirical coefficients or wall-distance inputs. Owing to its frame-indifferent formulation, the approach preserves Galilean and rotational invariance while maintaining a physically interpretable representation of Reynolds-stress anisotropy. STBNN is evaluated through a priori and a posteriori studies using direct numerical simulation (DNS) data of canonical wall-bounded flows, including plane channel and periodic hill flows. In a priori tests, the model accurately reproduces Reynolds-stress anisotropy, with correlation coefficients exceeding 99% and relative errors below 10%, while capturing near-wall scaling and logarithmic-layer behavior. In a posteriori RANS simulations, STBNN predicts mean velocity profiles in close agreement with DNS and improves prediction of separation and reattachment compared with linear and quadratic eddy-viscosity models and the baseline TBNN. Notably, a model trained at low Reynolds numbers generalizes to higher Reynolds numbers and unseen geometries. These results demonstrate the effectiveness of the proposed framework for data-driven Reynolds-stress modeling in wall-bounded turbulent flows. I Introduction High-fidelity prediction of turbulent flows remains a fundamental challenge in computational fluid dynamics (CFD), owing to the prohibitive computational expense of direct numerical simulation (DNS) and large-eddy simulation (LES) for practical engineering applications. Speziale 1990 ; Durbin 2018 ; Pope 2000 Consequently, Reynolds-averaged Navier–Stokes (RANS) approaches remain the workhorse of industrial CFD simulations and are expected to retain this role for the foreseeable future. Slotnick et al. 2014 ; Duraisamy, Iaccarino, and Xiao 2019 ; Duraisamy 2021 The fundamental challenge of RANS modelling lies in accurately closing the Reynolds-stress tensor arising from the averaging of the Navier–Stokes equations. Over the past decades, a wide range of RANS turbulence closures have been developed, ranging from linear eddy-viscosity models (LEVM) such as Spalart–Allmaras Spalart and Allmaras 1992 ; Spalart 2000 , k-\varepsilon Jones and Launder 1972 ; Launder and Sharma 1974 ; Yakhot and Orszag 1986 ; Yakhot et al. 1992 and k-\omega families Wilcox 1988 ; Menter 1994 ; Wilcox 2008 ; Menter and Matyushenko 2025 to more elaborate Reynolds-stress transport models (RSM). Wilcox 2006 ; Li, Larsen, and Fuhrman 2022 ; Li and Fuhrman 2022 Eddy-viscosity models offer computational efficiency and numerical robustness but their accuracy often deteriorates in flows with strong anisotropy and separation, whereas RSMs improve physical fidelity at an increased computational cost and reduced robustness. In recent years, machine-learning-based methods have gained increasing attention as promising tools for improving turbulence closures. Tracey, Duraisamy, and Alonso 2015 ; Singh and Duraisamy 2016 ; Pan and Duraisamy 2018 ; Zhu et al. 2019 ; Gamahara and Hattori 2017 ; Yang et al. 2019 ; Xie, Yuan, and Wang 2020 ; Xie, Xiong, and Wang 2021 ; Yuan, Xie, and Wang 2020 ; Yuan et al. 2021a ; Yuan et al. 2021b ; Yuan et al. 2022 ; Novati, de Laroussilhe, and Koumoutsakos 2021 ; Bae and Koumoutsakos 2022 ; Kutz 2017 ; Milani, Ling, and Eaton 2021 ; Zhang et al. 2022 ; Cai et al. 2024 Early studies demonstrated that data-driven correction of Reynolds stresses can improve mean-flow predictions over those obtained from the baseline two-equation k-\varepsilon model. Wang, Wu, and Xiao 2017 ; Wu, Xiao, and Paterson 2018 ; Xiao and Cinnella 2019 A major advance was the tensor-basis neural network (TBNN) proposed by Ling et al. Ling, Kurzawski, and Templeton 2016 ; Ling, Jones, and Templeton 2016 , which embeds Galilean and rotational invariance into the constitutive representation of the anisotropy tensor. Subsequent developments incorporated physics-informed learning strategies Wu, Xiao, and Paterson 2018 ; Jiang et al. 2021 , symbolic-regression frameworks Weatheritt and Sandberg 2016 ; Zhao et al. 2020 ; Ji et al. 2025 , realizability constraints McConkey et al. 2025 , historical effects Myklebust, Fuhrman, and Li 2025 and improved coupling algorithms Boureima et al. 2022 ; Liu et al. 2023 to enhance robustness when integrating learned stresses into RANS solvers. Despite these significant advances, a fundamental limitation persists: even invariant-preserving models show limited generalization to Reynolds numbers and geometries outside the training conditions. Xiao and Cinnella 2019 ; Duraisamy, Iaccarino, and Xiao 2019 A possible explanation is that the local mean-velocity gradient does not uniquely determine the turbulence state in wall-bounded flows. Moreover, frameworks such as the TBNN commonly employs the turbulent time scale k/\varepsilon for normalization, where k is the turbulent kinetic energy and \varepsilon is the dissipation rate. The difficulty of accurately predicting \varepsilon near walls introduces regime-dependent uncertainty and consequently degrades generalization. The present work addresses this issue by introducing a self-scaling tensor-basis neural network (STBNN) closure. Instead of modifying network architecture or increasing training data, the approach reformulates the input representation using an invariant-based normalization derived from the first two invariants of the velocity-gradient tensor. This normalization provides an intrinsic local time scale that balances strain and rotation effects and enables dynamically similar turbulence states to be represented consistently across Reynolds numbers and geometries. The developed model preserves frame invariance while improving the generalization capability of data-driven RANS modelling. The proposed STBNN is investigated using both a priori and a posteriori assessments to examine its predictive capability and practical applicability in RANS computations. Canonical channel flows spanning a range of Reynolds numbers and the periodic-hill configuration with varying geometrical complexity are considered, enabling assessment across Reynolds-number variation within a canonical flow and applicability to flows with distinct underlying physics. Comparisons with conventional linear and quadratic eddy-viscosity models (QEVM) and the baseline TBNN are used to elucidate the impact of the physically consistent self-scaling formulation, particularly in terms of robustness and transferability across flow conditions. The remainder of this paper is structured as follows. The governing equations and turbulence models, including the LEVM, QEVM, TBNN and the proposed STBNN, are introduced in Sec. II . The flow configurations and associated DNS databases are described in Sec. III . Secs. IV and V present the a priori and a posteriori analyses, respectively. Concluding remarks are given in Sec. VI . II Governing equations and turbulence models The incompressible Navier–Stokes equations for a Newtonian fluid read ( Pope 2000 ) , \frac{{\partial{u_{i}}}}{{\partial{x_{i}}}}=0, (1) \frac{{\partial{u_{i}}}}{{\partial t}}+\frac{{\partial\left({{u_{i}}{u_{j}}}\right)}}{{\partial{x_{j}}}}=-\frac{{\partial p}}{{\partial{x_{i}}}}+\nu\frac{{{\partial^{2}}{u_{i}}}}{{\partial{x_{j}}\partial{x_{j}}}}, (2) where u_{i} , x_{i} , t , and p denote the velocity components, spatial coordinates, time, and the pressure divided by the constant density, respectively, and \nu represents the kinematic viscosity. The summation convention for repeated indices is adopted throughout this paper for simplicity. By decomposing the velocity and pressure fields into mean and fluctuating components via Reynolds averaging ( u_{i}=\bar{u}_{i}+u_{i}^{\prime} , p=\bar{p}+p^{\prime} ) and applying ensemble averaging to the governing equations, the Reynolds-averaged Navier–Stokes (RANS) equations are derived Reynolds 1895 : \frac{{\partial{{\bar{u}}_{i}}}}{{\partial{x_{i}}}}=0, (3) \frac{{\partial{{\bar{u}}_{i}}}}{{\partial t}}+\frac{{\partial\left({{{\bar{u}}_{i}}{{\bar{u}}_{j}}}\right)}}{{\partial{x_{j}}}}=-\frac{{\partial\bar{p}}}{{\partial{x_{i}}}}+\nu\frac{{{\partial^{2}}{{\bar{u}}_{i}}}}{{\partial{x_{j}}\partial{x_{j}}}}-\frac{{\partial{R_{ij}}}}{{\partial{x_{j}}}}, (4) where R_{ij}=\overline{u_{i}^{\prime}u_{j}^{\prime}} denotes

Read the complete text