Machine Learning Hamiltonian Dynamical Systems with Sparse and Noisy Data Preprint: APS/123-QED

Vedanta Thapar, Abhinav Gupta · 2026

Read Machine Learning Hamiltonian Dynamical Systems with Sparse and Noisy Data Preprint: APS/123-QED by Vedanta Thapar, Abhinav Gupta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17470.txt.

Introduction

Thapar and Gupta learn Hamiltonian systems from sparse, noisy data, where most methods collapse. Their adaptable symplectic recurrent network (ASRNN) weaves Hamiltonian structure and symplectic integration into the design, dodging time-derivative estimates and staying stable under noise. Even paths of just two oddly spaced points, possibly tainted by linked noise, yield sound long-term forecasts. The trained model then makes data for symbolic discovery tools, recovering exact equations for polynomial systems and close fits for the rest.

Catalog record

CREATORVedanta Thapar, Abhinav Gupta
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43402
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17470

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Machine Learning Hamiltonian Dynamical Systems with Sparse and Noisy Data Preprint: APS/123-QED Vedanta Thapar, Abhinav Gupta Abstract Machine learning has become a powerful tool for discovering governing laws of dynamical systems from data. However, most existing approaches degrade severely when observations are sparse, noisy, or irregularly sampled. In this work, we address the problem of learning symbolic representations of nonlinear Hamiltonian dynamical systems under extreme data scarcity by explicitly incorporating physical structure into the learning architecture. We introduce Adaptable Symplectic Recurrent Neural Networks (ASRNNs), a parameter-cognizant, structure-preserving model that combines Hamiltonian learning with symplectic recurrent integration, avoiding time derivative estimation, and enabling stable learning under noise. We demonstrate that ASRNNs can accurately predict long-term dynamics even when each training trajectory consists of only two irregularly spaced time points, possibly corrupted by correlated noise. Leveraging ASRNNs as structure-preserving data generators, we further enable symbolic discovery using independent regression methods (SINDy and PySR), recovering exact symbolic equations for polynomial systems and consistent polynomial approximations for non-polynomial Hamiltonians. Our results show that such architectures can provide a robust pathway to interpretable discovery of Hamiltonian dynamics from sparse and noisy data. I Introduction Since the 1990s, the science of machine learning has garnered great interest in the natural sciences community and with its recent rapid advancements, it has emerged as a powerful tool for artificial scientific discovery with applications ranging from modelling multiscale physical systems to complex biological processes 2 ; 32 ; 41 ; 44 . At the largest scales, ML architectures such as AlphaFold 24 and GNoMe 33 are being used for scientific breakthroughs that have the potential of revolutionising the fields of drug discovery and materials science respectively. There have also been impressive advancements in studying complex dynamical phenomena using neural networks such as in modelling nuclear fusion processes 3 ; 34 , climate and weather science 4 ; 13 ; 27 ; 28 , and the acceleration of fluid and molecular dynamics simulations 5 ; 26 ; 35 ; 40 among many others. Many of these approaches fall under the umbrella of physics-informed neural networks (PINNs), which explicitly incorporate prior physical knowledge into the learning process 25 ; 37 . A particularly important class of systems in this context is Hamiltonian dynamical systems, which exhibit rich behaviour including periodic, quasiperiodic, and chaotic dynamics 16 . Because their evolution is constrained by Hamilton’s equations, learning such systems while respecting their underlying structure has received considerable attention 25 . Hamiltonian Neural Networks (HNNs) 17 were amongst the first architectures to explicitly encode this structure and have been shown to outperform vanilla neural networks, especially in chaotic regimes 9 . Subsequent extensions include parameter-cognizant Adaptable HNNs 19 , symplectic recurrent architectures employing structure-preserving integrators (SRNNs) 7 , and further developments addressing inseparable Hamiltonians 42 , noncanonical coordinates 10 ; 8 , constraints 14 , and dissipation 36 . Alternative structure-preserving approaches, such as SympNets 23 , aim to learn symplectic maps directly, and recent work has unified many of these methods under the framework of Generalised Hamiltonian Neural Networks (GHNNs) 20 . Despite their predictive success, most Hamiltonian learning architectures remain largely black-box models, providing blurred insight into the underlying governing laws. This has motivated growing interest in interpretable machine learning approaches, particularly symbolic regression methods aimed at recovering explicit equations of motion from data 1 ; 32 . Prominent examples employed in this work include SINDy 6 which targets sparse representations of nonlinear ODEs via regression over a fixed function library, and the more general PySR framework 11 , an evolutionary symbolic regression method that does not require a predefined basis. Learning equations for Hamiltonian systems using physical priors has also been explored previously, for example in 12 . However, in the interest of interpretability, that approach avoids deep neural networks and instead combines SINDy with symplectic integration, limiting expressibility to the chosen basis and precluding parameter adaptability. Other symbolic regression approaches include probabilistic and Bayesian equation discovery methods 15 ; 18 , as well as physics-specific “artificial scientist” models such as SciNet, AIFeynman, AIPoincare, and AINewton 22 ; 38 ; 31 ; 29 . Importantly, these methods typically degrade severely when data are sparse, irregularly sampled, or noisy—conditions common in realistic experimental and observational settings 21 . In this work we address the following question: given a parametrised dynamical system and access to only very sparse, irregular, and noisy trajectory data for a limited set of parameter values, can one recover symbolic representations of the underlying Hamiltonian dynamics by incorporating appropriate physical priors? We propose Adaptable Symplectic Recurrent Neural Networks (ASRNNs), which combine parameter-cognizant Hamiltonian learning with symplectic recurrent integration focused on separable Hamiltonian systems. This allows the generation of regularly spaced trajectories for unseen parameter values, providing suitable data for symbolic discovery via PySINDy 6 and PySR 11 . This provides a modular approach that improves downstream interpretability without reducing expressibility. We evaluate ASRNNs constructed using small multilayer perceptrons (MLPs) on two representative systems: a two-parameter Henon–Heiles system and the single parameter Morse potential. While both systems have been considered previously in the context of Adaptable HNNs 19 , prior approaches assumed regularly sampled, noise-free data and struggled in multi-parameter settings. In contrast, ASRNNs trained on highly sparse and irregular observations generalise well across parameter space and, when used with symbolic regression, recover equations of motion and Hamiltonian structure despite severe data limitations. We also consider the ability of these architectures to extrapolate to parameter regimes with qualitatively different dynamics not included in the training set. The rest of the paper is organised as follows. The following section introduces the general structure of ASRNNs, Section III introduces the physical systems studied, Section IV describes data generation and training procedures, Section V presents empirical results, Section VI constructs a theoretical analysis of the ASRNN loss gradient under noise and Section VII concludes with a discussion of limitations and future directions. II Model structure A Hamiltonian Neural Network (HNN) 17 parametrises a time-independent Hamiltonian \mathcal{H}=\mathcal{H}(\mathbf{q},\mathbf{p}) using a neural network \mathcal{H}_{\theta}(\mathbf{q},\mathbf{p}) where (\mathbf{q},\mathbf{p}) are canonical coordinates. Hamilton’s equations are enforced during training via the loss, \mathcal{L}_{(\mathbf{q},\mathbf{p})}(\theta)=\left\lVert\frac{\partial\mathcal{H}_{\theta}}{\partial\mathbf{p}}-\frac{\partial\mathbf{q}}{\partial t}\right\rVert_{2}+\left\lVert\frac{\partial\mathcal{H}_{\theta}}{\partial\mathbf{q}}+\frac{\partial\mathbf{p}}{\partial t}\right\rVert_{2}, (1) which requires access to time derivatives (\dot{\mathbf{q}},\dot{\mathbf{p}}) . Adaptable HNNs extend this framework by introducing parameter channels \lambda , allowing Hamiltonians of the form \mathcal{H}(\mathbf{q},\mathbf{p};\mathbf{\lambda}) to be learned across parameter space 19 . However, both HNNs and AHNNs rely on derivative estimates (such as by finite differences), which are typically unreliable when data are sparse and noisy. To address this, Symplectic Recurrent Neural Networks (SRNNs) 7 replace derivative-based losses with recurrent integration using symplectic integrators, but are restricted to separable Hamiltonians \mathcal{H}(\mathbf{q},\mathbf{p})=\mathcal{K}(\mathbf{p})+\mathcal{V}(\mathbf{q}) where \mathcal{K},\mathcal{V} are kinetic and potential energy functions respectively. We propose ASRNNs (Adaptable Symplectic Recurrent Neural Networks) which combine parameter-cognizant Hamiltonian learning with symplectic recurrence. ASRNNs model Hamiltonians of the form \mathcal{H}(\mathbf{q},\mathbf{p};\lambda)=\mathcal{K}(\mathbf{p})+\mathcal{V}(\mathbf{q};\lambda), (2) where coordinates are scaled such that parameter dependence enters only through the potential. The model thus consists of two neural networks, i.e. \mathcal{H}_{\theta}(\mathbf{q},\mathbf{p};\lambda)=\mathcal{K}_{\theta_{1}}(\mathbf{p})+\mathcal{V}_{\theta_{2}}(\mathbf{q};\lambda) where \theta=(\theta_{1},\theta_{2}) . A Verlet integrator is used to perform the recurrent steps, \displaystyle\mathbf{p}\left(t+\frac{\Delta t}{2}\right)=\mathbf{p}(t)-\frac{\Delta t}{2}\frac{\partial\mathcal{V}_{\theta_{2}}}{\partial\mathbf{q}}\bigg|_{t} (3) \displaystyle\mathbf{q}\left(t+\Delta t\right)=\mathbf{q}(t)+\Delta t\frac{\partial\mathcal{K}_{\theta_{1}}}{\partial\mathbf{p}}\bigg|_{t+\frac{\Delta t}{2}} (4) \displaystyle\mathbf{p}\left(t+\Delta t\right)=\mathbf{p}\left(t+\frac{\Delta t}{2}\right)-\frac{\Delta t}{2}\frac{\partial\mathcal{V}_{\theta_{2}}}{\partial\mathbf{q}}\bigg|_{t+\Delta t}, (5) where \Delta t is a chosen time step. Training minimizes the trajectory-matching loss, \mathcal{L}_{(\mathbf{q}_{0},\mathbf{p_{0}};\lambda)}(\theta)=\sum_{t\in\mathcal{T}}\left(\left\lVert\mathbf{q}(t)-\mathbf{\hat{q}(t)}\right\rVert_{2}+\left\lVert\mathbf{p}(t)-\mathbf{\hat{p}(t)}\right\rVert_{2}\right), (6) where (\mathbf{q}_{0},\mathbf{p_{0}};\lambda) are

Read the complete text