Data-efficient Kernel Methods for Learning Hamiltonian Systems
Yasamin Jalalian 1, Mostafa Samir 2, Boumediene Hamzi 1, 3, 5, Peyman Tavallali 4, Houman Owhadi 1 · 2025
Read Data-efficient Kernel Methods for Learning Hamiltonian Systems by Yasamin Jalalian 1, Mostafa Samir 2, Boumediene Hamzi 1, 3, 5, Peyman Tavallali 4, Houman Owhadi 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17154.txt.
Introduction
Yasamin Jalalian, Mostafa Samir, Boumediene Hamzi, Peyman Tavallali, and Houman Owhadi wrote a 2025 arXiv paper on learning physical systems from data. Many systems follow Hamiltonian rules, which govern how energy shapes motion over time. Learning such a system from a few recorded paths could speed up science and engineering work, if the learned model stays true to the rules.
The team offers two kernel-based routes. One rebuilds the paths first and then learns the energy rule, while the other learns both at once. On test systems such as a mass on a spring, a swinging pendulum, and the Hénon-Heiles system, their frame beat older kernel baselines. The gains were largest when data was scarce. They also prove error bounds in advance, and give a broader frame that can learn other kinds of systems too.
Catalog record
| CREATOR | Yasamin Jalalian 1, Mostafa Samir 2, Boumediene Hamzi 1, 3, 5, Peyman Tavallali 4, Houman Owhadi 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17154
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-efficient Kernel Methods for Learning Hamiltonian Systems Yasamin Jalalian 1, Mostafa Samir 2, Boumediene Hamzi 1, 3, 5, Peyman Tavallali 4, Houman Owhadi 1 Abstract . Hamiltonian dynamics describe a wide range of physical systems. As such, data-driven simulations of Hamiltonian systems are important for many scientific and engineering problems. In this work, we propose kernel-based methods for identifying and forecasting Hamiltonian systems directly from data. We present two approaches: a two-step method that reconstructs trajectories before learning the Hamiltonian, and a one-step method that jointly infers both. Across several benchmark systems, including mass-spring dynamics, a nonlinear pendulum, and the Hénon-Heiles system, we demonstrate that our framework achieves accurate, data-efficient predictions and outperforms two-step kernel-based baselines, particularly in scarce-data regimes, while preserving the conservation properties of Hamiltonian dynamics. Moreover, our methodology provides theoretical a priori error estimates, ensuring reliability of the learned models. We also provide a more general, problem-agnostic numerical framework 1 that goes beyond Hamiltonian systems and can be used for data-driven learning of arbitrary dynamical systems. 1. Introduction Dynamical systems play a fundamental role in describing natural phenomena. Two essential aspects of their study are (i) system identification , which involves determining parametric or nonparametric models for the system’s evolution, and (ii) prediction or forecasting , which focuses on projecting the system’s state forward in time. With the advent of machine learning and its growing role in inferring data through mathematical models, known as physics-informed machine learning, data-driven methods have become increasingly important for treating both tasks [ 11 , 39 , 13 , 35 , 55 , 24 , 23 , 15 , 54 , 51 , 1 , 26 , 57 ] . Among the various learning approaches, reproducing kernel Hilbert spaces (RKHS) [ 19 , 38 ] have established solid mathematical foundations for the analysis of dynamical systems [ 3 , 7 , 8 , 9 , 43 , 34 , 47 , 44 , 32 , 46 , 42 , 41 , 29 , 22 , 27 , 28 , 30 , 35 , 6 , 31 ] , surrogate modeling [ 56 ] , and neural networks [ 58 ] . Compared to other learning approaches, kernel-based methods offer advantages in interpretability, theoretical analysis, numerical implementation and regularization, and uncertainty quantification (UQ), while also providing guaranteed convergence along with a priori error estimates [ 36 , 4 , 16 , 49 , 45 , 52 ] . A particularly interesting class of dynamical systems is Hamiltonian dynamics. These systems naturally arise in describing the evolution of a wide range of physical systems. They are especially important as their structure preserves fundamental quantities like energy and follows specific geometric principles. The problem of learning Hamiltonian dynamical systems from data has been treated recently using different approaches [ 5 , 12 , 14 , 18 , 33 , 48 , 60 ] , including neural networks designed to preserve symplectic structure [ 17 , 18 , 37 , 25 , 61 , 62 ] , Gaussian processes combined with variational integrators for structure-preserving modeling [ 59 ] , and methods for discovering governing equations and coordinates from data [ 40 , 14 ] . More concretely, consider the Hamiltonian system \displaystyle\begin{cases}\dot{q}=\partial_{p}H,\\ \dot{p}=-\partial_{q}H,\end{cases} where q(t)\in\mathbb{R}^{m} and p(t)\in\mathbb{R}^{m} represent the generalized position and the generalized momentum at time t , respectively, and H(q,p) is the Hamiltonian. Given discretized time series data on the interval [0,T_{\mathrm{final}}] for trajectories q and p and knowing that they come from an unknown Hamiltonian system, the problem of system identification corresponds to identifying q,p and H over the entire domain [0,T_{\mathrm{final}}] , whereas the problem of forecasting corresponds to predicting values of q and p after time T_{\mathrm{final}} using the identified Hamiltonian. In this work, we address both of these problems by using a similar methodology to the one of Kernel Equation Learning (KEqL) [ 36 ] which addresses problems in PDE learning. In particular, we propose two kernel-based methods, one that first aims at learning trajectories q,p and then learns Hamiltonian H and another method that simultaneously learns q,p and H . A visual scheme of the architecture is given in figure 1 . Inspired by the Computational Graph Completion (CGC) framework [ 52 ] , we model our problem as a computational graph problem by representing state variables as vertices, and functional dependencies between variables as directed edges. We represent unknown functions as red edges, and data as dotted edges. Then solving our problem is equivalent to completing the graph by approximating the unknown functions with the minimizers of optimal recovery problems over suitably-chosen reproducing kernel Hilbert spaces (RKHSs). This methodology is equivalent to replacing the unknown functions of the graph with Gaussian Processes and computing their MAP estimators given constraints imposed by the data and the structure of the graph. The RKHS perspective inherits the convergence and error estimate guarantees for kernel methods. Moreover, the GP perspective allows us to access the whole posterior distribution of point-wise approximations and employ them for UQ estimates. Figure 1 . Computational graph of the 2-step method (left) - Computational graph of the 1-step method (right). We demonstrate the efficiency of our simultaneous learning method compared to the two-step kernel-based approach, particularly in a scarce-data regime, across various physical problems. Our proposed framework is mathematically interpretable, and the architecture inherently results in a system with conserved energy. Additionally, we provide theoretical error bounds to assess the reliability of our predictions. Moreover, the numerical framework 1 1 1 The framework can be found at: https://github.com/Mostafa-Samir/CGC . that we provide with this work is a problem-agnostic general CGC implementation that goes beyond solving the problem at hand and can be used for inferring unknown variables in any arbitrary physical system from data. The paper is outlined as follows. In section 2, we begin by introducing the problem formally and proceed to describing the two suggested methods for its solution. In section 3, we prove a priori error rates for the 1-step methods. Section 4 is dedicated to discussion on the details of the implementation for both methods. In section 5, we demonstrate numerical results on several benchmark systems and discuss how they compare with each other in different data regimes. Finally, section 6 is dedicated to concluding remarks and future directions. A preliminary version of this paper was presented at Differential Equations for Data Science 2023 (DEDS2023) ( video , conference site ). 2. Problem Statement & Methodology 2.1. Problem Statement We start by formally introducing the problem and setting up notation. Let H:\mathbb{R}^{2m}\to\mathbb{R} be an unknown Hamiltonian defining a dynamical system via the equations \displaystyle\begin{cases}\dot{q}=\partial_{p}H(q,p),\\ \dot{p}=-\partial_{q}H(q,p),\end{cases} where q:\mathbb{R}\to\mathbb{R}^{m},\,p:\mathbb{R}\to\mathbb{R}^{m}, denote the generalized position and momentum respectively. At time t\in\mathbb{R}_{+} , we define the state of the full system as \displaystyle y(t):=\big(q(t),p(t)\big)^{\top}\in\mathbb{R}^{2m}, so that its evolution can be compactly written as \displaystyle\frac{\mathrm{d}y}{\mathrm{d}t}=\begin{pmatrix}\partial_{p}H(q(t),p(t))\\ -\partial_{q}H(q(t),p(t))\end{pmatrix}. Let T_{\mathrm{col}}\coloneqq\{t_{i}\}_{i=1}^{N} be a discretization of the interval [0,T_{\mathrm{final}}] , and let \{y(t_{i})\}_{i=1}^{N} constitute our full set of collocation points . To simulate partial observability within the collocation points, we introduce a sparsity factor \alpha\in(0,1] . This determines the proportion of collocation points that are not observed. Specifically, we define \displaystyle N_{\mathrm{obs}}:=\lfloor(1-\alpha)N\rfloor, and uniformly at random select N_{\mathrm{obs}} of the N time