Meta-learning Structure-Preserving Dynamics

Cheng JingSchool of Computing and Augmented IntelligenceArizona State University [email protected] Uvini Balasuriya MudiyanselageSchool of Computing and Augmented IntelligenceArizona State University [email protected] Woojin ChoTelePIX Co., Ltd. [email protected] Minju JoLG CNS Co., Ltd minnju42@gmail · 2025

Read Meta-learning Structure-Preserving Dynamics by Cheng JingSchool of Computing and Augmented IntelligenceArizona State University [email protected] Uvini Balasuriya MudiyanselageSchool of Computing and Augmented IntelligenceArizona State University [email protected] Woojin ChoTelePIX Co., Ltd. [email protected] Minju JoLG CNS Co., Ltd minnju42@gmail (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11205.txt.

Introduction

Cheng Jing and co-authors teach physics-based models to adapt fast in this 2025 paper. Models that respect energy rules forecast motion well, but each new setup used to need full retraining and known settings. Quick-adapt learning offers a fix, yet common forms can generalize poorly.

The team tests signal-tuning tricks inside an energy-based learning frame. The tricks adjust the model from a few sample runs, with no need to name the system settings. Wide tests on standard problems show sharp forecasts after brief tuning. The tuned models also kept the energy traits that make such models trustworthy. The authors back tuning-based quick learning for physical systems.

Catalog record

CREATORCheng JingSchool of Computing and Augmented IntelligenceArizona State University [email protected] Uvini Balasuriya MudiyanselageSchool of Computing and Augmented IntelligenceArizona State University [email protected] Woojin ChoTelePIX Co., Ltd. [email protected] Minju JoLG CNS Co., Ltd minnju42@gmail
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-11205

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Meta-learning Structure-Preserving Dynamics Cheng JingSchool of Computing and Augmented IntelligenceArizona State University [email protected] Uvini Balasuriya MudiyanselageSchool of Computing and Augmented IntelligenceArizona State University [email protected] Woojin ChoTelePIX Co., Ltd. [email protected] Minju JoLG CNS Co., Ltd [email protected] Anthony GruberCenter for Computing ResearchSandia National Laboratories [email protected], Kookjin LeeSchool of Computing and Augmented IntelligenceArizona State University [email protected] Abstract Structure-preserving approaches to dynamics modeling have demonstrated great potential for modeling physical systems due to their strong inductive biases that enforce conservation laws and dissipative behavior. However, the resulting models are typically trained for fixed system configurations, requiring explicit knowledge of system parameters as well as costly retraining for each new set of parameters— a major limitation in many-query or parameter-varying scenarios. Meta-learning offers a potential solution, but existing approaches like optimization-based meta-learning often suffer from training instability or limited generalization capability. Inspired by ideas from computer vision, we introduce a modulation-based meta-learning framework that directly conditions structure-preserving models on compact latent representations of potentially unknown system parameters, avoiding the need for gray-box system knowledge and explicit optimization during adaptation. Through the application of novel modulation strategies to parametric energy-conserving and dissipative systems, we enable scalable and generalizable learning across parametric families of dynamical systems. Experiments on standard benchmark problems demonstrate that our approach achieves accurate predictions in few-shot learning settings, without compromising on the essential physical constraints necessary for dynamical stability and effective generalization performance across parameter space. 1 Introduction Scientific machine learning (SciML) has emerged as a powerful paradigm for modeling complex physical systems Baker et al. 2019 , enabling the discovery and prediction of dynamic behavior in fields ranging from fluid dynamics Karniadakis et al. 2021 ; Brunton et al. 2020 to materials science Butler et al. 2018 . Learning the underlying dynamics from data is essential when physical laws are unknown, partially known, or when direct simulation is computationally expensive. While physics-informed neural networks and related approaches have shown promise by incorporating physical biases into the learning process Raissi et al. 2019 , they typically do not enforce the preservation of structural properties exactly, especially when the learned models are queried for dynamical prediction outside of their training distribution. This can lead to poor generalization performance and the substantial violation of fundamental physical principles encoded in mathematical conservation laws. As a result, there is growing interest in developing tailored machine learning models that faithfully preserve the mathematical structure of physical systems. Recent work has introduced structure-preserving neural networks that embed physical inductive biases directly into their architectures. Hamiltonian neural networks (HNNs) Greydanus et al. 2019 ; Toth et al. 2020 and Lagrangian neural networks Lutter et al. 2018 ; Cranmer et al. 2020 conserve a notion of energy by modeling the system through its underlying symplectic or variational structure. Principled extensions of these models, such as port-Hamiltonian neural networks Zhong et al. 2020 ; Desai et al. 2021 , generalized Onsager principle-based networks Yu et al. 2021 and metriplectic neural networks Hernández et al. 2021 ; Lee et al. 2021a ; Gruber et al. 2023 ; Gruber et al. 2025 , have been proposed to handle dissipative systems, which include phenomena such as energy exchange and entropy production. While these structure-preserving approaches offer improved physical fidelity, they generally require complete knowledge of the system’s parameters and are trained in a parameter-specific manner—that is, parametric variation in the system (through, e.g., quantities like mass, damping, stiffness) may not be fully known or captured in closed form, and a new model must be trained for each parametric configuration. This retraining process can create significant inefficiency in practice, leading to the delayed adoption of structure-preserving methods in “many-query” applications. Conversely, many real-world systems exhibit parametric variations that are predictable and structured, e.g., a pendulum may have a range of different masses and lengths. In the Hamiltonian learning literature, some works have explored meta-learning approaches that learn to initialize model weights based on system parameters Lee et al. 2021b ; Song and Jeong , enabling faster adaptation to new problem configurations. These methods typically build on established meta-optimization strategies like model-agnostic meta-learning (MAML) Finn et al. 2017 , which aim to produce models capable of generalizing across a family of tasks. However, in the context of dissipative systems, and particularly in the learning of systems obeying the metriplectic formalism Morrison 1986 ; Morrison 2009 , there has been little to no exploration of such meta-learning strategies. This creates a significant gap in the development of generalizable, structure-preserving models that can efficiently adapt to new dynamical scenarios without full retraining. Moreover, they typically require update in high-dimensional model parameters and computation of gradients with respect to them, which often bring instabilities and computational burdens. To address these challenges, we propose a modulation-based meta-learning framework that sidesteps the issues with explicit optimization given new parameter configurations by directly conditioning the dynamics model on low-dimensional latent variables. Inspired by recent advances in implicit neural representations (INRs), where modulation is used to generalize across scenes or signals, we adapt and extend these techniques to the setting of structure-preserving dynamics. Our main technical contributions include: • exploration of modulation-based techniques for the meta-learning of provably structure-preserving dynamics with parametric dependence, • development of two novel modulation techniques with improved expressiveness over existing approaches, • integration of modulation-based meta-learning into a black-box strategy for learning conservative/dissipative dynamics with general and potentially unknown parametric dependence, • experimentation on benchmark problems consisting of three energy-conserving and two dissipative dynamical systems. 2 Technical Background We begin by describing established parameterization techniques for preserving important structure governing energy conserving and dissipative systems. 2.1 Hamiltonian mechanics and Hamiltonian neural networks Hamiltonian systems are those dynamical systems on phase space which arise from Hamilton’s least-action principle. In Hamiltonian systems, the state is canonically described by a set of generalized coordinates and their associated momenta, denoted as \bm{q}=[q_{1},...,q_{n}] and \bm{p}=[p_{1},...,p_{n}] , respectively. The dynamics are then defined by the symplectic gradient of the Hamiltonian function(al) \mathcal{H}(\boldsymbol{q},\boldsymbol{p}) on phase space, which represents the total energy, i.e., the sum of the kinetic and potential energies of the system. Precisely, the (canonical) Hamiltonian dynamics are defined by \derivative{\pmb q}{t}=\partialderivative{\mathcal H}{\pmb p},\quad\derivative{\pmb p}{t}=-\partialderivative{\mathcal H}{\pmb q}. (1) A key property of the evolution defined by Eq. ( 1 ) is that an isolated Hamiltonian system is guaranteed to conserve the total energy along solution trajectories. This follows from the vanishing of the dissipation rate, \derivative{\mathcal H}{t}=\left(\partialderivative{\mathcal H}{\pmb q}\right)^{\mathsf{T}}\derivative{\pmb q}{t}+\left(\partialderivative{\mathcal H}{\pmb p}\right)^{\mathsf{T}}\derivative{\pmb p}{t}=\left(\partialderivative{\mathcal H}{\pmb q}\right)^{\mathsf{T}}\partialderivative{\mathcal H}{\pmb p}-\left(\partialderivative{\mathcal H}{\pmb p}\right)^{\mathsf{T}}\partialderivative{\mathcal H}{\pmb q}=0 . The definition of Hamiltonian systems in terms of a single scalar potential function \mathcal{H} suggests a simple and natural parameterization for machine learning. HNNs Greydanus et al. 2019 parameterize the Hamiltonian function with a neural network \mathcal{H}_{\bm{\Theta}}(\boldsymbol{q},\boldsymbol{p}) consisting of learnable model parameters \bm{\Theta} . This choice allows HNNs to be trained by minimizing the loss \mathcal{L}_{\text{symp}}=\left\|\derivative{\pmb q}{t}-\partialderivative{\mathcal H_{\bm\Theta}}{\pmb p}\right\|_{2}^{2}+\left\|\derivative{\pmb p}{t}+\partialderivative{\mathcal H_{\bm\Theta}}{\pmb q}\right\|_{p}^{2}, (2) which we denote by the “symplecticity loss”, given data for the time derivatives of (\boldsymbol{q},\boldsymbol{p}) . A similar argument to the above guarantees that solution trajectories to Hamilton’s equations in the approximation \mathcal{H}_{\bm{\Theta}} will conserve the approximate total energy, regardless of how well \mathcal{H}_{\bm{\Theta}} is trained. 2.2 Metriplectic mechanics and GENERIC neural networks Despite the tremendous utility of the Hamiltonian

Read the complete text