Accelerated Integration of Stiff Reactive Systems Using Gradient-Informed Autoencoder and Neural Ordinary Differential Equation

Mert Yakup Baykan, Vijayamanikandan Vijayarangan, Dong-hyuk Shin, Hong G. Im · 2025

Read Accelerated Integration of Stiff Reactive Systems Using Gradient-Informed Autoencoder and Neural Ordinary Differential Equation by Mert Yakup Baykan, Vijayamanikandan Vijayarangan, Dong-hyuk Shin, Hong G. Im (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01957.txt.

Introduction

Mert Yakup Baykan, Vijayamanikandan Vijayarangan, Dong-hyuk Shin, and Hong Im speed up combustion simulation in this two thousand twenty-five paper. Stiff reacting systems, like fuel mixes as they ignite, cost much to integrate, as their chemistry runs on split timescales. An autoencoder and neural ordinary differential equation model can squeeze the state and evolve it at low cost, as a reduced-order model. The team adds a loss term built from gradients of the latent variables.

Training data came from the Cantera solver. It covered ignition of hydrogen-air and ammonia-hydrogen mixes at constant pressure, across ranges of temperature and fuel ratio. Models trained with the latent gradient loss did far better past the training range, beating the mapping loss there. The study shows that putting time derivatives in the loss counts. A latent space can call dynamics at high fidelity, for a part of the cost.

Catalog record

CREATORMert Yakup Baykan, Vijayamanikandan Vijayarangan, Dong-hyuk Shin, Hong G. Im
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01957

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accelerated Integration of Stiff Reactive Systems Using Gradient-Informed Autoencoder and Neural Ordinary Differential Equation Mert Yakup Baykan, Vijayamanikandan Vijayarangan, Dong-hyuk Shin, Hong G. Im Abstract A combined autoencoder (AE) and neural ordinary differential equation (NODE) framework has been used as a data-driven reduced-order model for time integration of a stiff reacting system. In this study, a new loss term using a latent variable gradient is proposed, and its impact on model performance is analyzed in terms of robustness, accuracy, and computational efficiency. A data set was generated by a chemical reacting solver, Cantera, for the ignition of homogeneous hydrogen-air and ammonia/hydrogen-air mixtures in homogeneous constant pressure reactors over a range of initial temperatures and equivalence ratios. The AE-NODE network was trained with the data set using two different loss functions based on the latent variable mapping and the latent gradient. The results show that the model trained using the latent gradient loss significantly improves the predictions at conditions outside the range of the trained data. The study demonstrates the importance of incorporating time derivatives in the loss function. Upon proper design of the latent space and training method, the AE+NODE architecture is found to predict the reaction dynamics at high fidelity at substantially reduced computational cost by the reduction of the dimensionality and temporal stiffness. Journal: arXiv 1 Introduction In the pursuit of a sustainable energy mix in the future, the combustion of carbon-free or carbon-neutral fuels will become increasingly important. Clean and efficient utilization of conventional (in the near term) and alternative (in the long term) fuels requires high fidelity computational simulation tools that allow rapid predictions of reactive systems over a wide range of operating conditions [ 1 , 2 ] . The mathematical system describing chemically reacting flows involve a large dimensionality due to a number of reactive scalar variables and a wide spectrum of time scales associated with transport and chemistry. The large dimensionality poses tremendous challenges in developing a proper computational strategy to achieve desired rapid turnaround while preserving the prediction fidelity [ 3 , 4 ] . A common workaround to avoid the disparity between the flow and reaction time scales is to apply an operator splitting method, where transport and reaction terms are integrated separately within the integration algorithm. While the method improves the computational efficiency, splitting errors need to be properly taken care of in order to preserve the solution accuracy. Moreover, even after the operator splitting, the large spectrum of chemical time scales still remains in the reactive terms [ 5 ] . In detailed chemical kinetic mechanisms used in combustion simulations, elementary reaction rates span over a wide range of magnitudes, giving rise to a stiffness problem where the fastest and slowest chemical time scales differ by many orders of magnitude. A traditional method to reduce the dimensionality and temporal stiffness include steady-state and partial-equilibrium approximations [ 6 ] , eliminating a number of reactive scalar variables based on the fast species or reactions. The framework has been automated as computer-aided reduction method (CARM) [ 7 ] . However, this approach relies on pre-selection of eliminated species based on intuition or data, and thus its general application to large systems is limited. Alternatively, the directed relation graph (DRG) method [ 8 ] has successfully been used for developing reduced mechanisms by identifying unimportant species and reactions according to their mutual association in the chemical pathways based on a pre-set criterion. A more systematic mathematical identification of fast-slow species has been provided by the computational singular perturbation (CSP) framework [ 9 , 10 ] , where the characteristic mode separation and truncation are conducted by the eigenvalue decomposition, leading to skeletal mechanisms with reduced dimension and temporal stiffness [ 11 ] . The CSP algorithm has also been applied to accelerate time integration of ordinary differential equations of reactive systems by eliminating fast exhausted modes [ 12 , 13 ] . As an alternative approach to develop reduced order models (ROM) based on either experimental or computational data, the principal component analysis (PCA) has widely been used to construct a new set of orthonormal basis vectors, referred to as the principal components, which are linear transformations of the physical state variables into a reduced dimensional latent space. The resulting latent representations serve as a system of governing equations that can be integrated at much reduced computational costs [ 14 ] . More recently, the PCA approach has been combined with CSP for additional dynamic compression in time scales [ 15 ] . In the era of machine learning, dimensional reduction of data for various applications are commonly done by a deep neural network (DNN) architecture, where a large input variable vector undergoes multilayer perceptron (MLP) operations into a compressed latent space. A special case of the DNN framework with nonlinear activation functions applied to a solution vector is referred to as the autoencoder (AE), which is essentially a nonlinear multilayer extension of the PCA in dimensional reduction. It has been shown that AEs can effectively retain essential information when compressing data into a latent space [ 16 ] and have since been used in predicting the evolution of dynamical systems in the latent space [ 17 ] . In the application of DNN in describing the dynamical evolution of a physical system, the neural ordinary differential equation (NODE) method [ 18 ] has been developed. Unlike traditional discrete-step models, NODEs define the state vector as a continuous representation, which allows the adaptive time integration of the state variables. Owoyele and Pal [ 19 ] demonstrated the ability of NODEs in capturing the unsteady ignition dynamics of homogeneous reacting systems with detailed chemistry. A recent study [ 20 ] conducted a more extensive investigation of AE+NODE for homogeneous reacting systems by assessing various parameters such as the number of inner layers and latent variables as well as the training methods. The study demonstrated a significantly accelerated computational cost while preserving the same level of fidelity compared to the conventional variable-order implicit integration. Moreover, a remarkable finding was that the end-to-end training in the development of AE led to a substantial removal of temporal stiffness inherent in the original chemical kinetic models. A subsequent study [ 21 ] provided insights into why and how such a stiffness removal is automatically achieved through the AE+NODE training process. Moreover, Kumar et al. [ 22 ] incorporated a constraint based on elemental mass conservation to enhance accuracy. Despite these advancements, DNN-based ROMs require large datasets to accurately capture multi-mode physics. In general, ANN training relies on an inductively biased dataset due to computational complexity, large memory requirements, or difficulties in data collection. As a result, data-driven ROMs trained this way primarily learn the most probable events present in the dataset, leading to significant errors when applied to less probable scenarios. To address this limitation, Sholokhov et al. [ 23 ] proposed a latent gradient loss term into the training process, thus incorporating the physical constraints into the latent space. The results demonstrated improved model performance, particularly in scenarios where training data is scarce. Motivated by these new developments, the present study aims to address the additional challenges in achieving extrapolation accuracy of data-driven reduced-order models (ROMs)

Read the complete text