Fourier-Invertible Neural Encoder (FINE) for Homogeneous Flows
Anqiao Ouyang, Hongyi Ke, Qi Wang · 2025
Read Fourier-Invertible Neural Encoder (FINE) for Homogeneous Flows by Anqiao Ouyang, Hongyi Ke, Qi Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15329.txt.
Introduction
Anqiao Ouyang, Hongyi Ke, and Qi Wang present a neural encoder that squeezes data about flows into a compact code without losing the ability to rebuild it. Their design, FINE, mixes reversible filters and steady-rising activation curves with a Fourier cutoff, so compression respects the shift symmetry of the data.
The team tested the encoder on interacting waves in one dimension, a turbulent one-dimensional system, and a two-dimensional turbulence set. FINE rebuilt the data with errors five to nine times lower than standard convolutional autoencoders, while using only a fifth or less of their parameters. The authors offer the design as a principled, light-weight route to shrinking data from physical systems while keeping it readable.
Catalog record
| CREATOR | Anqiao Ouyang, Hongyi Ke, Qi Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15329
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fourier-Invertible Neural Encoder (FINE) for Homogeneous Flows Anqiao Ouyang, Hongyi Ke, Qi Wang Abstract Invertible neural architectures have recently attracted attention for their compactness, interpretability, and information-preserving properties. In this work, we propose the Fourier-Invertible Neural Encoder (FINE), which combines invertible monotonic activation functions with reversible filter structures, and could be extended using Invertible ResNets. This architecture is examined in learning low-dimensional representations of one-dimensional nonlinear wave interactions and exact circular translation symmetry. Dimensionality is preserved across layers, except for a Fourier truncation step in the latent space, which enables dimensionality reduction while maintaining shift equivariance and interpretability. Our results demonstrate that FINE significantly outperforms classical linear methods such as Discrete Fourier Transformation (DFT) and Proper Orthogonal Decomposition (POD), and achieves reconstruction accuracy better than conventional deep autoencoders with convolutional layers (CNN) — while using substantially smaller models and offering superior physical interpretability. These findings suggest that invertible single-neuron networks, when combined with spectral truncation, offer a promising framework for learning compact and interpretable representations of physics datasets, and symmetry-aware representation learning in physics-informed machine learning. 1 Introduction Understanding complex patterns in physics-based simulation data—such as those arising in turbulence, oceanography, and astrophysics—remains a fundamental challenge in scientific machine learning (Sci-ML). The intricate nonlinear interactions and symmetries must be captured through the use of data reduction. In canonical flow systems, such as three-dimensional isotropic turbulence ( Park and Lozano-Durán 2025 ) and wall-bounded turbulence ( Motoori and Goto 2021 ) , coherent structures and spatial correlations suggest the existence of low-dimensional manifolds that encode essential physical behavior. These datasets often contain symmetries crucial for reduced-order models, such as circular translation-equivariance. Harmonic Networks (H-Nets) achieve equivariance to translations and full 360° rotations by employing circular harmonics as filters, enabling consistent responses to rotated inputs without requiring multiple rotated versions of the filters ( Worrall et al. 2017 ) . Additionally, Tensor Field Networks are locally equivariant to 3D rotations and translations, utilizing filters built from spherical harmonics to process 3D point clouds effectively ( Thomas et al. 2018 ) . Renormalization group (RG) symmetry also plays a significant role in understanding turbulence. Onsager’s "ideal turbulence" theory describes turbulent energy cascades without probabilistic assumptions and yields a local, deterministic version of the Kolmogorov 4/5th law, offering insights into energy transfer mechanisms in turbulent flows ( Eyink 2024 ) . Furthermore, the transfer of kinetic energy from large to small scales in turbulence is commonly attributed to the stretching of vorticity by the strain rate, but strain self-amplification also plays a role, enhancing the understanding of turbulence dynamics ( Johnson 2020 ) . Despite the success of deep learning-based autoencoders in learning data-driven low-dimensional manifolds, most existing autoencoders do not respect these innate symmetries of physics data. For example, extreme aerodynamic flows can be compressed through machine learning into a low-dimensional manifold, enabling real-time sparse reconstruction and control of extremely unsteady gusty flows ( Fukami and Taira 2023 ) . Expanding upon the discussion of deep learning-based autoencoders in fluid dynamics, recent advancements have demonstrated that effective learning of turbulent flow structures can be achieved even with minimal data. This method leverages the inherent scale-invariance and multiscale features present in turbulence, enabling the model to reconstruct high-resolution flow fields from low-resolution inputs across various Reynolds numbers. ( Fukami and Taira 2024 ) . In addition, the network designs are inherited from computer vision, relying on fixed activation functions and non-invertible structures. These architectures also prioritize expressivity over interpretability or physical consistency. This manuscript introduces a novel framework for physics-based representation learning: Fourier-Invertible Neural Encoder (FINE). Built upon flexible, monotonous activation functions and invertible filters. This approach integrates invertible single-neuron layers with a Fourier truncation bottleneck to enforce circular shift equivariance and enable dimensionality reduction. 1.1 Homogenious flow fields and Dimensionality Reduction Many physical systems exhibit spatial homogeneity, where the underlying dynamics remain invariant under spatial translations. In such cases, the dataset \mathcal{D} is said to be translation-equivariant, satisfying \mathcal{TD}=\mathcal{D} , where \mathcal{T} denotes a translation operator ( Helwig et al. 2023 ) . Translation-equivariant structures are particularly prominent in fluid dynamics, where homogeneous turbulence, channel flows, and periodic shear flows frequently arise in idealized or canonical settings. The importance of such homogeneous flows and their coherent structures is extensively reviewed in the study of wall-bounded turbulence ( Jimenez 2018 ) , highlighting their role as key benchmarks for understanding turbulence dynamics. The large-scale nature of turbulent flow datasets imposes significant computational costs, necessitating effective dimensionality reduction techniques. Recent advancements, such as convolutional autoencoders, have demonstrated the ability to extract low-dimensional latent representations of turbulent flows while preserving critical spatiotemporal structures. This approach significantly outperforms classical linear methods in capturing extreme events and multiscale phenomena ( Doan et al. 2023 ) . Leveraging the translational invariance inherent in homogeneous flows enables the construction of efficient representations using Fourier-based methods, convolutional architectures, and more recently, symmetry-aware neural networks. For instance, Fourier Neural Operators (FNOs) exploit the Fast Fourier Transform (FFT) to capture translation-invariant properties in PDE solutions ] ( Li et al. 2024 ) , and geo-FNO further extends this approach by learning deformations that map irregular geometries into translation-compatible latent spaces ( Li et al. 2024 ) . A suite of widely used dimensionality reduction techniques—including Proper Orthogonal Decomposition (POD) ( Lumley 1967 ) , Principal Component Analysis (PCA) ( Abdi and Williams 2010 ) , Dynamic Mode Decomposition (DMD) ( Schmid 2010 ) , and Spectral POD (SPOD) ( Towne et al. 2018 ) —are fundamentally rooted in linear algebra and Fourier analysis. These methods are all essentially based on the Singular Value Decomposition (SVD) of datasets. When the datasets are translation-equivariant, Fourier modes emerge naturally as the eigenfunctions of the associated covariance or evolution operators ( Bolla et al. 2021 ) , rendering these method very limited in terms of extracting useful information. These techniques share a common underlying assumption: the dynamics of the decomposed modes can be approximated as linear superpositions. This assumption, however, conflicts with the inherently nonlinear nature of turbulent flows, where mode interactions are strongly coupled and energy cascades across scales through nonlinear transfer. As a result, while these linear decompositions capture dominant energetic structures, they fail to account for the nonlinear mechanisms driving the system’s evolution. As these limitations are well documented ( Lusch et al. 2018 ) , recent efforts have turned toward nonlinear extensions such as kernel methods, autoencoders, and Koopman operator learning frameworks, which aim to overcome these intrinsic shortcomings by capturing richer dynamics beyond the linear regime. 1.2 Auto-encoders These limitations have motivated the development of nonlinear dimensionality reduction techniques, particularly autoencoders. Unlike traditional linear methods, autoencoders can learn highly nonlinear mappings, making them well-suited for modeling the intricate structures and dynamics of nonlinear systems ( Hinton and Salakhutdinov 2006 ) . In the scientific machine learning community, recent efforts have focused on incorporating physical symmetries—such as translation, rotation, and reflection invariance—directly into the architecture of autoencoders. For example, convolutional autoencoders naturally preserve translation equivariance. The introduction of Group Equivariant Convolutional Neural Networks (G-CNNs) has extended the equivariance properties of traditional CNNs to a broader range of transformations, such as rotations and reflections, through the use of group convolutions ( Cohen and Welling