Koopman Theory-Inspired Method for Learning Time Advancement Operators in Unstable Flame Front Evolution
Rixin Yu, Marco Herbert, Markus Klein, Erdzan Hodzic · 2024
Read Koopman Theory-Inspired Method for Learning Time Advancement Operators in Unstable Flame Front Evolution by Rixin Yu, Marco Herbert, Markus Klein, Erdzan Hodzic (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08426.txt.
Introduction
Yu, Herbert, Klein, and Hodzic teach neural networks to advance a flickering flame front in time. Predicting such unstable, chaotic flows is a classic hard problem. Inspired by Koopman theory, which lifts tangled dynamics into a space where they move more simply, the team builds two learners. One is a Fourier neural operator, the other a convolutional network, and both are trained to step the flame forward.
Tested on one- and two-dimensional flame cases, the new models beat traditional methods on short-term accuracy and on matching the long-term statistics of the flow. The authors present the approach as a promising frame for forecasting other complex systems ruled by partial differential equations.
Catalog record
| CREATOR | Rixin Yu, Marco Herbert, Markus Klein, Erdzan Hodzic |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-08426
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Koopman Theory-Inspired Method for Learning Time Advancement Operators in Unstable Flame Front Evolution Rixin Yu, Marco Herbert, Markus Klein, Erdzan Hodzic Abstract Predicting the evolution of complex systems governed by partial differential equations (PDEs) remains challenging, especially for nonlinear, chaotic behaviors. This study introduces Koopman-inspired Fourier Neural Operators (kFNO) and Convolutional Neural Networks (kCNN) to learn solution advancement operators for flame front instabilities. By transforming data into a high-dimensional latent space, these models achieve more accurate multi-step predictions compared to traditional methods. Benchmarking across one- and two-dimensional flame front scenarios demonstrates the proposed approaches’ superior performance in short-term accuracy and long-term statistical reproduction, offering a promising framework for modeling complex dynamical systems. I Introduction Partial differential equations (PDEs) are fundamental mathematical frameworks used to describe complex physical phenomena across diverse scientific and engineering domains. From fluid dynamics and climate modeling to quantum mechanics and biological systems, PDEs encapsulate intricate interactions and dynamical behaviors derived from underlying physical principles. However, solving PDEs, particularly nonlinear equations with complex boundary conditions, poses significant computational challenges, historically limiting our ability to simulate and predict such systems accurately. The computational landscape for solving PDEs has been transformed by the integration of machine learning (ML) and artificial intelligence (AI) techniques. Recent advancements have introduced a proliferation of operator learning methods, each contributing unique insights and capabilities for tackling complex mathematical problems. Early efforts in this domain leveraged convolutional neural networks (CNNs) [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] , drawing inspiration from computer vision to parameterize PDE operators in finite-dimensional spaces. These CNN-based approaches mapped discrete functions to image-like representations, offering innovative computational frameworks for PDE solutions. Building on CNN-based methods, neural operator techniques [ 8 , 9 ] emerged to learn operators of infinite dimensionality, achieving remarkable success across diverse benchmarks. Notable examples include Deep Operator Networks (DeepOnet) [ 10 ] and Fourier Neural Operators (FNO) [ 11 ] . These methods introduced sophisticated strategies for mapping between function spaces: FNO leverages Fourier transforms for efficient learning of continuous operators, while DeepOnet employs a branch-trunk network architecture to model complex relationships. Recent advancements have further extended these approaches, incorporating wavelet-based methods [ 12 , 13 ] , adaptations to complex domains [ 14 ] , and techniques for parametric-dependent operator learning [ 15 ] . Among the various operators encountered in PDE problems, the solution time-advancement operator is of particular interest. This operator maps the solution at a given time to the solution at a future time, over a short interval, under prescribed boundary conditions. By recurrently applying this operator — using its output as the input for the next step — it becomes possible to generate predictions over long time horizons. Applications such as weather forecasting, transient fluid flow simulations, and flame front evolution rely heavily on such operator learning approaches to capture dynamic evolution across spatial and temporal scales. Learning these operators presents unique challenges. While accurate short-term predictions are crucial, ensuring stability and fidelity in long-term predictions becomes particularly difficult for PDEs exhibiting chaotic solutions, where errors grow exponentially due to sensitivity to initial conditions. Previous studies have tackled this issue using recurrent training strategies [ 11 , 16 ] , minimizing multi-step errors over consecutive predictions. By contrast, non-recurrent training, which optimizes for single-step prediction accuracy, often leads to divergence in long-term solutions, especially for chaotic systems [ 16 ] . Inspired by Koopman operator theory [ 17 , 18 , 19 ] , we propose a novel approach to directly learn an extended solution advancement operator. The Koopman operator is a linear operator defined in an infinite-dimensional functional space of system observables, offering a powerful analytical framework for nonlinear dynamics. In this work, we adapt this concept to develop Koopman-inspired Fourier Neural Operators (kFNO) and Koopman-inspired Convolutional Neural Networks (kCNN). These architectures build on our previous findings [ 16 , 15 , 20 ] , which identified that two baseline approaches of FNO and CNN are suitable for learning time-advancement operators on chaotic PDEs solutions. Our approach transforms data into a high-dimensional latent space, where it is advanced iteratively to capture multi-step dynamics. This latent space transformation is a direct extension of existing operator learning methods, which lift low-dimensional input data into higher-dimensional spaces before projecting it back. To demonstrate the effectiveness of the proposed approach, we apply it to a canonical problem in combustion science: the evolution of unstable flame fronts driven by two intrinsic instabilities — the Darrieus-Landau (DL) and Diffusive-Thermal (DT) mechanisms. The former arises from hydrodynamic effects across density gradients [ 21 , 22 ] , while the latter stems from disparities in heat and reactant diffusion [ 23 , 24 ] . These instabilities are modeled using two nonlinear PDEs: the Michelson-Sivashinsky(MS) [ 25 ] and Kuramoto-Sivashinsky(KS) [ 26 ] equations, respectively. We benchmark our kFNO and kCNN models against baseline methods in both one- and two-dimensional configurations. Metrics for comparison include short-term prediction accuracy and long-term statistics in reproducing nonlinear front evolution, especially under chaotic scenarios. The paper is organized as follows: Section II details the problem setup for learning solution advancement operators and section III describes the proposed Koopman-inspired operator learning methods. Section IV shows the results on benchmarking the proposed methods against baseline approaches on 1D and 2D versions of the MS and KS equations. Finally, Section V summarizes the findings. II Problem Setup for Operator Learning In this section, we outline the problem setup for learning a PDE operator, alongside a description of recurrent training methods. Consider a system governed by a partial differential equation (PDE), typically involving multiple functions and mappings between them. A general operator mapping could be denoted as G:\mathcal{V}\to\mathcal{V}^{\prime};\quad v(x)\mapsto v^{\prime}(x^{\prime}), (1) where the input function v(x) , with x\in\mathcal{D} , belongs to the functional space \mathcal{V}(\mathcal{D},\mathbb{R}^{d_{v}}) , with domain \mathcal{D}\subset\mathbb{R}^{d} and codomain \mathbb{R}^{d_{v}} . The output function v^{\prime}(x^{\prime}) , where x^{\prime}\in\mathcal{D}^{\prime} , resides in another functional space \mathcal{V}^{\prime}(\mathcal{D}^{\prime},\mathbb{R}^{d_{v}^{\prime}}) , with domain \mathcal{D}^{\prime}\subset\mathbb{R}^{d^{\prime}} and codomain \mathbb{R}^{d_{v}^{\prime}} . In this work we are primarily interested in the time advancement operator for the solution of the PDE, defined as G:\phi(x,t)\mapsto\phi(x,t_{1}), (2) where \phi(x,t) is the solution to the PDE, and t_{j}=t+j\Delta_{t} for j=1,2,\dots represents a future time sequence separated by a small time increment \Delta_{t} . For simplicity, we assume that the input and output functions share the same domain and codomain, i.e., \mathcal{D}^{\prime}=\mathcal{D} , \mathcal{V}^{\prime}=\mathcal{V} , d^{\prime}=d , and d_{v}^{\prime}=d_{v} , with periodic boundary conditions on \mathcal{D} . In some cases, it may be preferable to work with a related operator that outputs solutions over multiple consecutive time steps: \bar{G}:\mathcal{V}\to\mathcal{V}^{n};\quad\phi(x,t)\mapsto(\phi(x,t_{1}),\phi(x,t_{2}),\dots,\phi(x,t_{n})), (3) where \mathcal{V}^{n} denotes the Cartesian product of n copies of \mathcal{V} . These two operators are related as \bar{G}=(G,G^{2},\dots,G^{n}), (4) where the superscript n over an operator denotes its n -th power, i.e., iterative application of G for n times: G^{n}=G\circ\dots\circ G . To approximate the operators G and \bar{G} using neural network methods, we define the networks as follows: \mathcal{G}:\mathcal{V}\times\Theta\to\mathcal{V},\quad\text{or equivalently},\quad\mathcal{G}_{\theta}:\mathcal{V}\to\mathcal{V},\quad\theta\in\Theta, (5) and \bar{\mathcal{G}}:\mathcal{V}\times\bar{\Theta}\to\mathcal{V}^{n},\quad\text{or equivalently},\quad\bar{\mathcal{G}}_{\bar{\theta}}:\mathcal{V}\to\mathcal{V}^{n},\quad\bar{\theta}\in\bar{\Theta}. (6) Here, \Theta and \bar{\Theta} denote the spaces of trainable parameters in the respective networks. The training objective is to find the optimal parameters \theta^{*}\in\Theta (or \bar{\theta}^{*}\in\bar{\Theta} ) such that \mathcal{G}_{\theta^{*}} approximates G