HFNO: an interpretable data-driven decomposition strategy for turbulent flows Journal: Data-Centric Engineering Publication type: ARTICLE

M. Cayuela, P. Schmid, V. Le Chenadec, T. Sayadi · 2025

Read HFNO: an interpretable data-driven decomposition strategy for turbulent flows Journal: Data-Centric Engineering Publication type: ARTICLE by M. Cayuela, P. Schmid, V. Le Chenadec, T. Sayadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01535.txt.

Introduction

Marco Cayuela, Vincent Le Chenadec, Peter Schmid, and Taraneh Sayadi try to open the black box of Fourier neural operators. These models predict fluid flows well but hide their reasoning. Their design, HFNO, is built to be read. It handles different wavenumber bands, meaning different scales of motion, in separate parallel channels.

Inputs are lifted to a larger space and Fourier-transformed. They are then split into wavenumber bins. Each bin is processed by its own small network. The outputs are recombined, returned to physical space, and polished by a correction model, either a convolutional network or an echo state network. The design is tested on problems of rising difficulty: the one-dimensional Kuramoto-Sivashinsky equation, two-dimensional Kolmogorov flow, and predicting wall shear stress in turbulent channel flow.

Catalog record

CREATORM. Cayuela, P. Schmid, V. Le Chenadec, T. Sayadi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01535

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HFNO: an interpretable data-driven decomposition strategy for turbulent flows Journal: Data-Centric Engineering Publication type: ARTICLE M. Cayuela, P. Schmid, V. Le Chenadec, T. Sayadi Abstract Fourier Neural Operators (FNOs) have demonstrated exceptional accuracy in mapping functional spaces by leveraging Fourier transforms to establish a connection with underlying physical principles. However, their opaque inner workings often constitute an obstacle to physical interpretability. This work introduces Hierarchical Fourier Neural Operators (HFNOs), a novel FNO-based architecture tailored for reduced-order modeling of turbulent fluid flows, designed to enhance interpretability by explicitly separating fluid behavior across scales. The proposed architecture processes wavenumber bins in parallel, enabling the approximation of dispersion relations and non-linear interactions. Inputs are lifted to a higher-dimensional space, Fourier-transformed, and partitioned into wavenumber bins. Each bin is processed by a Fully Connected Neural Network (FCNN), with outputs subsequently padded, summed, and inverse-transformed back into physical space. A final transformation refines the output in physical space as a correction model, by means of one of the following architectures: Convolutional Neural Network (CNN) and Echo State Network (ESN). We evaluate the proposed model on a series of increasingly complex dynamical systems: first on the one-dimensional Kuramoto–Sivashinsky equation, then on the two-dimensional Kolmogorov flow, and finally on the prediction of wall shear stress in turbulent channel flow, given the near-wall velocity field. In all test cases, the model demonstrates its ability to decompose turbulent flows across various scales, opening up the possibility of increased interpretability and multiscale modeling of such flows. keywords Neural Operator, Fourier Neural Operator, Turbulent Flow, Scale Decomposition 2025 {Frontmatter} \authormark M. Cayuela et al . \authormark M. Cayuela et al. Impact Statement This work introduces the Hierarchical Fourier Neural Operator (HFNO) architecture, which decomposes the flow field into multiple spectral scales that are learnt and processed independently. This hierarchical treatment of scales significantly reduces model complexity while maintaining predictive accuracy in turbulent flow simulations and providing interpretability at various scales. Compared to standard Fourier Neural Operators, the HFNO achieves comparable statistical performance with five times fewer parameters. 1 Introduction Modeling high-dimensional dynamical systems governed by partial differential equations (PDEs), such as incompressible fluid flows or reactive transport phenomena, remains a central challenge in scientific computing. These systems exhibit complex nonlinear dynamics and span a broad range of spatial and temporal scales. Accurately resolving all relevant scales requires extremely high resolutions in both space and time, resulting in numerical models that routinely involve billions of degrees of freedom. As a result, high-fidelity simulations — such as Direct Numerical Simulation (DNS; Moin & Krishnan Mahesh 1998 ) or Large Eddy Simulation (LES; Piomelli 1999 ) — become prohibitively expensive, particularly at high Reynolds numbers ( Pope 2000 ) . Even with modern high-performance computing infrastructures, such simulations often require massive parallelization and remain mostly restricted to limited time horizons or simplified geometries. Recent advances in neural operator learning have opened new avenues for data-driven surrogate modeling of PDEs. Traditional neural network–based approaches, such as Physics-Informed Neural Networks (PINNs; Raissi et al. 2019 ), model the solution by taking spatial and temporal coordinates as input and enforcing the governing equations through the loss function. While effective for low-dimensional problems, these methods require retraining for each new geometry or discretization, which limits their scalability. More recently, neural operator frameworks have been introduced to learn mappings directly between infinite-dimensional function spaces rather than pointwise quantities. Among them, DeepONet ( Lu et al. 2021 ) represents the operator using two sub-networks — a branch network sampling the input function at sensor points and a trunk network depending on the output coordinates. Although DeepONet provides theoretical guarantees for universal operator approximation, its accuracy can be sensitive to the choice and number of sensor points, as well as to the sampling of the training functions. In contrast, the Fourier Neural Operator (FNO; Li et al. 2021 ) achieves mesh and resolution invariance by parameterizing integral kernels in the Fourier domain. This formulation enables the learned operator to generalize across different discretizations of the same underlying function space, making FNOs particularly attractive for scalable, resolution-independent surrogate modeling of complex dynamical systems ( Choubineh et al. 2023 ; Serrano et al. 2023 ; Wang 2024 ) . The FNO framework has since inspired a wide family of variants, including the Wavelet Neural Operator (WNO; Tripura & Chakraborty 2023 ), which improves multiscale feature representation through localized wavelet bases, and the Graph Neural Operator (GNO; Li et al. 2020 ), which extends operator learning to irregular domains and unstructured meshes. Despite their strong learning capabilities, Fourier Neural Operators (FNOs) remain deep architectures that offer limited interpretability. Although they embed physical knowledge through the use of Fourier transforms, it is still difficult to assign a clear physical meaning to the learned parameters after training. This limitation motivates the design of a new architecture, inspired by FNOs, that retains the advantages of spectral representations while promoting a more interpretable and scale-aware structure. Turbulent flows are inherently multiscale phenomena, characterized by a broad range of interacting spatial and temporal structures. Traditional modeling approaches in fluid mechanics, such as Reynolds-Averaged Navier–Stokes (RANS; Pope 2000 ; Launder & Spalding 1974 ) and Large-Eddy Simulation (LES; Sagaut Pierre 2006 ; Pope 2000 ; Meneveau & Katz 2000 ), explicitly exploit this separation of scales to design different modeling strategies for small- and large-small dynamics – for instance, resolving the energy-containing eddies while modeling the subgrid-scale dynamics. This principle of scale separation has long proven effective in promoting both interpretability and consistency across models operating at different resolutions. Inspired by this idea, the present work aims to design a neural architecture that can automatically identify and model these scales separately, bridging physical insight from turbulence theory with modern operator-learning techniques. To this end, this contribution introduces the Hierarchical Fourier Neural Operator (HFNO), a novel deep learning architecture inspired by FNO, designed both to learn mappings between infinite-dimensional function spaces and to decompose predictions across different scales. Our model divides the Fourier domain into disjoint wavenumber bins, each of which is processed by a dedicated Fully Connected Neural Network (FCNN; Hornik et al. 1989 ). This enables the model to learn scale-specific nonlinear transformations, leading to improved generalization and physical interpretability. A final correction model – implemented as either a CNN ( Lecun et al. 1998 ; Ian Goodfellow et al. 2016 ) or an Echo State Network ( Jaeger 2010 ) – further refines the output via a residual modeling. The paper is organized as follows. Section 2 presents the general framework of operator learning, with a focus on FNOs. Section 3 introduces the HFNO architecture proposed in this study. Section 4 presents the results of our architecture compared to baseline methods when applied to several cases of variable complexity. Finally, conclusions of the work are discussed in Section 5 . 2 Neural Operator In the general case of Operator learning, the goal is to learn a mapping between two infinite-dimensional function spaces. Let \mathcal{D}\subset\mathbb{R}^{d} be a bounded open set, and let \mathcal{U}=\mathcal{F}(\mathcal{D};\mathbb{R}^{d_{u}}) and \mathcal{Y}=\mathcal{F}(\mathcal{D};\mathbb{R}^{d_{y}}) be Banach spaces of functions taking values in \mathbb{R}^{d_{u}} and \mathbb{R}^{d_{y}} respectively. Here, \mathcal{D} denotes the subset of the domain where the function is observed, and \mathcal{U} and \mathcal{Y} represent the input and output

Read the complete text