Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements

Haoran Li, Muhao Guo, Yang Weng, Hanghang Tong · 2025

Read Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements by Haoran Li, Muhao Guo, Yang Weng, Hanghang Tong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01833.txt.

Introduction

Haoran Li, Muhao Guo, Yang Weng, and Hanghang Tong recast time-series modeling as a control problem in twenty twenty-five. Deep sequence models handle forecasting and interpolation well, but continuous-time versions learn their dynamics from unconstrained networks that can wobble under distribution shift. The authors instead pose the task as steering a differential equation with control actions toward a goal.

A discrete-time model reads the past and generates the control actions, coupling long-term features with short-term continuous dynamics. During training, model predictive control plans several steps ahead, scores them against the task cost, and picks the best current action. Under mild assumptions they show the multi-step scheme converges exponentially fast to the infinite-horizon solution, promising robustness and generalization for time-series tasks.

Catalog record

CREATORHaoran Li, Muhao Guo, Yang Weng, Hanghang Tong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01833

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements Haoran Li, Muhao Guo, Yang Weng, Hanghang Tong Abstract . Deep sequence models have achieved notable success in time-series analysis, such as interpolation and forecasting. Recent advances move beyond discrete-time architectures like Recurrent Neural Networks (RNNs) toward continuous-time formulations such as the family of Neural Ordinary Differential Equations (Neural ODEs). Generally, they have shown that capturing the underlying dynamics is beneficial for generic tasks like interpolation, extrapolation, and classification. However, existing methods approximate the dynamics using unconstrained neural networks, which struggle to adapt reliably under distributional shifts. In this paper, we recast time-series problems as the continuous ODE-based optimal control problem. Rather than learning dynamics solely from data, we optimize control actions that steer ODE trajectories toward task objectives, bringing control-theoretical performance guarantees. To achieve this goal, we need to ( 1 ) (1) design the appropriate control actions and ( 2 ) (2) apply effective optimal control algorithms. As the actions should contain rich context information, we propose to employ the discrete-time model to process past sequences and generate actions, leading to a coordinate model to extract long-term temporal features to modulate short-term continuous dynamics . During training, we apply model predictive control to plan multi-step future trajectories, minimize a task-specific cost, and greedily select the optimal current action. We show that, under mild assumptions, this multi-horizon optimization leads to exponential convergence to infinite-horizon solutions, indicating that the coordinate model can gain robust and generalizable performance. Extensive experiments on diverse time-series datasets validate our method’s superior generalization and adaptability compared to state-of-the-art baselines. 1. Introduction Time-series analysis, such as classification, interpolation, and forecasting, has extensive applications in various domains like energy ( Li et al. 2025a ; Li et al. 2025b ) , marketing ( Sarkar and De Bruyn 2021 ) , transportation ( Nguyen et al. 2018 ) , etc. Recently, introducing dynamical modeling to this analysis has been widely recognized. For example, the continuous feature flow brings interpolative capacities at an arbitrary time, causing substantial improvements for scenarios like irregularly-sampled time-series data ( Rubanova et al. 2019 ; Kidger et al. 2020 ) . Additionally, the learned dynamics can naturally extrapolate future states, which is often more accurate than discrete updates in many smooth and continuous systems ( Asikis et al. 2022 ; Li et al. 2025c ) or even in some stochastic systems like the PhysioNet dataset ( Silva et al. 2012 ; Rubanova et al. 2019 ) . However, gaining accurate feature dynamics is challenging. There may exist a smooth dynamical function for many continuous systems, including engineering systems (e.g., power, gas, water, mechanical, and transportation systems) ( Li and Weng 2023 ) , chemical reactions ( Luis and García-Verdugo 2010 ) , biological networks ( Palsson 2011 ) , weather systems ( Krishnamurthy 2019 ) , etc. However, for other time-series datasets, frequent disturbances or events could intermittently change dynamical evolution ( Li et al. 2022 ) , which calls for a highly adaptive dynamical function to different contexts. As contextual information can be extracted from long-term historical patterns, it’s critical to merge both the adaptive short-term dynamics and long-term patterns innovatively. To understand temporal patterns, discrete-time Deep Learning (DL) methods have been widely utilized, such as Recurrent Neural Networks (RNNs) ( Chung et al. 2014 ) or Long Short-Term Memory (LSTM) ( Hochreiter and Schmidhuber 1997 ) and Transformer-based models ( Zhou et al. 2021 ; Wen et al. 2022 ) . They process discrete observations sequentially but ignore the intra-dynamics between adjacent observations. Consequently, many studies demonstrate the model’s insufficiency to tackle data from continuous systems ( Rubanova et al. 2019 ; Kidger et al. 2020 ; Morrill et al. 2021 ; Chen et al. 2024 ; Schirmer et al. 2022 ) . Moreover, without dynamical knowledge, the performance of discrete-time DL degenerates significantly if the data is irregularly sampled ( Rubanova et al. 2019 ) . To incorporate dynamics, existing work can be categorized into the following groups. First, the dynamics between observations can be explicitly learned via methods such as Neural Ordinary Differential Equation (Neural ODE) ( Chen et al. 2018 ) . However, Neural ODE depends on the initial value without adaptation capacities ( Kidger et al. 2020 ) . The dynamics keep changing for complicated time series with disturbances and events. There needs to have a mechanism to adjust the dynamical evolution. Therefore, the second group increases the capacity of the model by adding control actions to the data dynamics. For example, Neural Controlled Differential Equation (Neural CDE) ( Kidger et al. 2020 ) and Neural Rough Differential Equation (Neural RDE) ( Morrill et al. 2021 ) create a rough path based on observed data to control the evolution of the dynamics. Another popular model is a learnable State Space Model (SSM) ( Gu et al. 2021 ; Smith et al. 2022 ; Schirmer et al. 2022 ; Ansari et al. 2023 ; Gu et al. 2022 ) . SSM-based methods linearly combine feature states and control vectors. Generally speaking, these continuous-time models rely on observational data as control actions and overlook the high-level temporal patterns from the past ( Chen et al. 2024 ) . The historical information of time series, however, is critical to providing contextual information and controlling dynamical propagation. There has been limited exploration into integrating discrete- and continuous-time models for time-series tasks. ODE-RNN ( Rubanova et al. 2019 ) and GRU-ODE ( De Brouwer et al. 2019 ) use discrete-time hidden states to modulate continuous dynamics, leveraging RNN architectures to inform ODE evolution. ( Chen et al. 2024 ; Jhin et al. 2024 ) combine Neural ODEs or Neural CDEs with Transformer architectures ( Vaswani et al. 2017 ) , using attention mechanisms to compute control actions. However, from a control-theoretic perspective, these approaches are inherently non-robust. They primarily focus on single-horizon evaluations by optimizing the current action for immediate objectives. This neglects the long-term influence of actions on future feature trajectories. As a result, the induced dynamics may not converge to a stable equilibrium or a desired reference trajectory ( Kouvaritakis and Cannon 2016 ) . In this paper, we cast the Neural ODE-based time-series learning problem as an optimal control problem ( Massaroli et al. 2020 ; Ruiz-Balet and Zuazua 2023 ) . Hence, we show that the model’s performance and adaptation capacity are deeply linked to the convergence of the control problem. For example, (1) Time-series classification . The stable and high-level feature that corresponds to a label can be viewed as an equilibrium point of the feature ODE flow. The perturbations or distributional shift of the time series demand control strategies that always stabilize the ODE flow to the equilibrium. (2) Time-series interpolation/extrapolation . The reference feature flow can correspond to the true time-series dynamics for highly accurate interpolation and extrapolation. Effective control actions can enable converged approximation to these reference trajectories. Therefore, we propose a control-theoretical approach to design efficient actions and control-based training algorithms , providing certain convergence guarantees. Table 1 . Table of Notation Scalars t_{i} Time for the i^{th} observation N Total number of observations for the time-series M Number

Read the complete text