An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systems
Panayiotis Ioannou, Pietro Liò, Pietro Cicuta · 2026
Read An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systems by Panayiotis Ioannou, Pietro Liò, Pietro Cicuta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20637.txt.
Introduction
Panayiotis Ioannou, Pietro Liò, and Pietro Cicuta compare two tools for learning how a system moves and changes over time. One tool is the neural ordinary differential equation, a network that learns the rule of change itself. The other is symbolic regression, which searches for a plain equation that fits the data.
The team works with noisy data made by two damped systems that swing and settle. They test how far the neural models can push past the data they were trained on. They also test whether symbolic regression can find the true equations again. Their study reports three key points from the tests. The two tools serve two ends: a good forecast, or a law a scientist can read.
Catalog record
| CREATOR | Panayiotis Ioannou, Pietro Liò, Pietro Cicuta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20637
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systems Panayiotis Ioannou, Pietro Liò, Pietro Cicuta Abstract Accurately modelling the dynamics of complex systems and discovering their governing differential equations are critical tasks for accelerating scientific discovery. Using noisy, synthetic data from two damped oscillatory systems, we explore the extrapolation capabilities of Neural Ordinary Differential Equations (NODEs) and the ability of Symbolic Regression (SR) to recover the underlying equations. Our study yields three key insights. First, we demonstrate that NODEs can extrapolate effectively to new boundary conditions, provided the resulting trajectories share dynamic similarity with the training data. Second, SR successfully recovers the equations from noisy ground-truth data, though its performance is contingent on the correct selection of input variables. Finally, we find that SR recovers two out of the three governing equations, along with a good approximation for the third, when using data generated by a NODE trained on just 10% of the full simulation. While this last finding highlights an area for future work, our results suggest that using NODEs to enrich limited data and enable symbolic regression to infer physical laws represents a promising new approach for scientific discovery. 1 Introduction Being able to accurately model the dynamics of complex systems or find the differential equations that govern them can help us in understanding those systems better and accelerate scientific discovery. Given the explosion of data and advances in machine learning, a key question arises: how can we best leverage experimental data to infer the dynamics of complex systems? Neural Ordinary Differential Equations (NODEs) [ 3 ] are a powerful tool for modelling dynamical systems, as their continuous-time nature mirrors that of differential equations. As a result, NODEs have been successfully applied across diverse scientific fields [ 10 , 9 ] . Much of the existing research has focused on improving NODE architectures [ 13 ] and assessing their robustness [ 12 ] . However, a significant gap remains in evaluating their performance under noisy synthetic data or real-world conditions. Specifically, their interpolation and extrapolation capabilities with respect to boundary conditions have been under-explored. This work addresses this gap by systematically investigating NODE performance using noise-infused synthetic data from two dynamical systems that exhibit damped oscillations: the cart-pole [ 6 ] and a biological model of bacterial adaptation to changing nutrient environments [ 5 ] . While NODEs excel at modelling dynamics, their black-box nature limits interpretability. In contrast, Symbolic Regression (SR) [ 4 ] can discover the exact governing equations; however, it often requires large datasets, which can be a significant challenge in experimental science. To address this, we investigate a pipeline that uses a trained NODE as a data augmentation tool for SR, assessing its ability to recover ground-truth equations from limited initial data. Our evaluation compares the performance of SR on direct ground-truth data (with and without noise) to its performance on a full dataset generated by a NODE trained on only 10% of the original simulation. 2 Methods This work investigates the extrapolation and interpolation capabilities of NODEs using noisy synthetic data generated from two dynamical systems: the cart-pole [ 6 ] and a biological system (which we refer to as the Bio-model) [ 5 ] . We also employ SR to determine if the original equations can be recovered directly from the noisy simulation data, as well as from the output generated by the NODE models. The NODE results were obtained using code adapted from the JAX-based [ 1 ] Diffrax library [ 8 ] . PySR was used for the SR analysis [ 4 ] , and the phaseportrait library [ 11 ] was used to create the phase space plot. All the details to reproduce this work are provided in the remainder of the methods section or in sections A , B and C of the appendix. Cart-pole. Equation 1 shows the angle dynamics of the cart-pole system assuming no friction between the cart and the rail [ 6 ] : \derivative[2]{\theta}{t}=\ddot{\theta}=\frac{g\sin{\theta}+\cos{\theta}(\frac{-F-m_{p}l\dot{\theta}^{2}\sin{\theta}}{m_{c}+m_{p}})-\frac{\mu_{p}\dot{\theta}}{m_{p}l}}{l(\frac{4}{3}-\frac{m_{p}\cos^{2}{\theta}}{m_{c}+m_{p}})} (1) where \theta is the angle between the vertical and the pole, \dot{\theta}=\derivative[]{\theta}{t} , F is the force acting on the cart, l is half of the length of the pole, m_{p} the mass of the pole, m_{c} the mass of the cart, \mu_{p} is the friction in the articulation between the cart and the pole and g the gravity. Using a forward simulation, equation 1 was solved numerically for many different initial conditions. This was done using the SciPy library, more specifically the integrate.odeint python function. The first data point [ \theta_{0} , \omega_{0} ] was at t = 0. The simulation ran until t = 10 seconds with 0.01 second time-steps. Noise of magnitude -5 to 5% (of the data point value) was added to each point using a uniform distribution. For the results in this report, the simulation was solved using: F = 0, l = 10 cm, m_{p} = 0.1 kg, m_{c} = 1 kg and \mu_{p} = 0.0008. This corresponds to an unforced cart-pole with friction only between the pole and the cart. Our analysis uses two separate models, each trained on a different set of initial conditions. Model A was trained on 35 boundary conditions, which are all combinations of initial angles from {0,0.6,1.2,1.8,2.4,3.14} and angular speeds from {0,2,4,6,8,10}, excluding the unstable equilibrium at [0,0]. The training data for Model A consists of 26 points from the first second of simulation for both the angle and angular speed, corresponding to a sampling rate of 25 Hz. The results in Figure 1(a) were generated by Model B, which was trained exclusively on the set of boundary conditions highlighted by the red box in the figure. Its training data was sampled at the same rate and time points as Model A. Bio-model. The system’s evolution is governed by the following ordinary differential equations [ 5 ] , where each is presented in both a simplified and an expanded form using only the three state variables ( \psi_{A} , \phi_{R} , \chi_{R} ) and constants ( \phi_{Rmax},\tilde{\epsilon},k_{\alpha},A,A_{2},\tau_{\chi} ): \displaystyle\derivative{\psi_A}{t}=(\phi_{Rmax}-\phi_{R})\nu_{f}-\lambda[\psi_{A},\phi_{R}](1+\psi_{A})=(\phi_{Rmax}-\phi_{R})k_{f}-\phi_{R}\tilde{\epsilon}\frac{\psi_{A}(\psi_{A}+1)}{\psi_{A}+k_{\alpha}} (2) \displaystyle\derivative{\phi_R}{t}=\lambda[\psi_{A},\phi_{R}](\chi_{R}-\phi_{R})=\phi_{R}(\chi_{R}-\phi_{R})\tilde{\epsilon}\frac{\psi_{A}}{\psi_{A}+k_{\alpha}} (3) \displaystyle\derivative{\chi_R}{t}=\frac{1}{\tau_{\chi}}(\omega_{R}[\psi_{A}]-\chi_{R})=\frac{1}{\tau_{\chi}}(\frac{\psi_{A}A}{\psi_{A}A+A_{2}}-\chi_{R}) (4) where the simplified form uses \lambda[\psi_{A},\phi_{R}] which is a function of \psi_{A} and \phi_{R} . The complete model derivation and a comprehensive description of the variables are available in [ 5 ] . Appendix C provides a brief overview of the variables and constants. The system’s evolution is driven by a shift in nutrient quality, represented by a change in the parameter \nu . Each value of \nu corresponds to a unique steady state solution for the state variables ( \psi_{A} , \phi_{R} , \chi_{R} ). For an example of these values, see Table A1 in the appendix. Experiments begin with the system in a steady state at an initial nutrient quality, \nu_{i} . At t = 0, \nu is abruptly changed to a final value, \nu_{f} , and the system evolves toward a new steady state. This is an up-shift if \nu_{f}>\nu_{i} and a down-shift if \nu_{f}<\nu_{i} . All experiments use a fixed \nu_{f} = 3.78. For the numerical simulations, we solved the model for 8 hours with a 0.01-hour time step and added noise to the data in a way similar to the cart-pole. For Model 2A,