Statistical Efficiency of Single- and Multi-step Models for Forecasting and Control
Anne Somalwar, Bruce D. Lee, George J. Pappas, Nikolai Matni · 2026
Read Statistical Efficiency of Single- and Multi-step Models for Forecasting and Control by Anne Somalwar, Bruce D. Lee, George J. Pappas, Nikolai Matni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23465.txt.
Introduction
Somalwar and three co-authors ask when multi-step predictors beat single-step ones for control. Small forecast errors pile up over time, which pushes many to train multi-step models. The team gives the first numbers on that trade for linear systems. Three classes compete: single-step, multi-step, and single-step with multi-step losses. With a well-matched model class, single-step wins on final error. Under partial observability, multi-step models cut bias and win instead. The same split holds in closed-loop control tests.
Catalog record
| CREATOR | Anne Somalwar, Bruce D. Lee, George J. Pappas, Nikolai Matni |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82440 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.23465
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Statistical Efficiency of Single- and Multi-step Models for Forecasting and Control Anne Somalwar, Bruce D. Lee, George J. Pappas, Nikolai Matni Abstract Compounding error, where small prediction mistakes accumulate over time, presents a major challenge in learning-based control. A common remedy is to train multi-step predictors directly instead of rolling out single-step models. However, it is unclear when the benefits of multi-step predictors outweigh the difficulty of learning a more complex model. We provide the first quantitative analysis of this trade-off for linear dynamical systems. We study three predictor classes: (i) single step models, (ii) multi-step models, and (iii) single step models trained with multi-step losses. We show that when the model class is well-specified and accurately captures the system dynamics, single-step models achieve the lowest asymptotic prediction error. On the other hand, when the model class is misspecified due to partial observability, direct multi-step predictors can significantly reduce bias and improve accuracy. We provide theoretical and empirical evidence that these trade-offs persist when predictors are used in closed-loop control. Introduction A typical approach to time series forecasting is to fit a one-step ahead prediction model and apply it recursively to obtain predictions over multiple time steps. In doing so, small errors may compound over time, leading to poor long-horizon prediction. This issue can make the application of such single-step models to long-term planning and controller design challenging. By directly training multi-step models to predict over longer horizons, the issue of compounding error can be mitigated. The main drawback of doing so is that the number of parameters for a direct multi-step predictor scales with the prediction horizon, thus potentially requiring more data than a single-step predictor to achieve a desired prediction performance. While this tradeoff between prediction horizon accuracy and data requirements is broadly known to exist, it is primarily studied from an empirical perspective [ 14 , 13 ] . We therefore lack principled guidance for exactly when direct multi-step prediction should be preferred over autoregressive rollout of single-step models. Motivated by this challenge, we provide a rigorous comparison of the sample efficiency of learning multi-step predictors with that of learning single-step predictors in the setting of a linear dynamical system. -A Related Work Multi-step Identification The goal of system identification is to use data to learn a model that can be used for forecasting or control [ 16 ] . To this end, one typically wants to select a model from the hypothesis class that minimizes the simulation error, i.e., the cumulative prediction error over all future time steps. Due to the computational challenge of doing so, it is much more common to instead learn a model which minimizes the single-step prediction error and apply it autoregressively [ 16 , 7 ] . However, such approaches tend to generalize poorly if the underlying data generating process does not belong to the hypothesis class. This has motivated the application of algorithms such as Data as Demonstrator (DaD) which use approaches from imitation learning to train a predictor to self-correct its prediction error at each step, leading to improved empirical performance [ 21 , 20 ] . Direct learning of prediction models for each time-step in the prediction horizon partially bypasses the issue of compounding error, and has proven successful for both model predictive control [ 19 , 2 , 11 ] and value approximation in MDPs [ 1 ] . Empirical studies of single-step and multi-step dynamics models learned with various neural network architectures have also been conducted. Namely, [ 13 ] investigates the performance of recursive application of single-step models parameterized by neural networks in a handful of examples and characterize circumstances which such models may worsen the effects of compounding error. In [ 4 ] , the authors give a comparison of various deep learning architectures for predicting multiple steps of a time series and show the efficacy of bidirectional and encoder-decoder LSTM networks. These empirical studies underscore the importance of careful consideration when designing a model for multi-step prediction. Our work studies this question in stylized settings, allowing us to clearly demonstrate the potential drawbacks and benefits of direct multi-step prediction as compared to more traditional single-step approaches. Learning-Enabled Control While the issue of compounding error has long been studied in system identification and control, it has resurfaced as a prominent issue in the learning community, exacerbated by the use of neural networks as function approximators. In model-based reinforcement learning, it has been observed that synthesized controllers may exploit compounding errors of the learned model [ 6 , 15 ] , motivating numerous heuristics for accounting for the model error during policy synthesis [ 9 , 23 , 22 , 10 ] . In [ 14 ] , the authors instead propose learning a direct multi-step predictor parametrized by a low dimensional decision variable which may be optimized online. The issue of a mismatch between the hypothesis class and the underlying data generating process also poses a challenge for behavior cloning. For example, incorrectly assuming that the demonstrator is Markovian can lead to a policy that deviates substantially from the demonstrator [ 5 , 3 ] . This can be remedied in part by replacing the standard behavior cloning objective with an objective that predicts the expert actions for multiple timesteps to maintain temporal consistency, resulting in so-called action-chunking based approaches [ 3 , 24 ] . We draw inspiration from these studies, and consider instances of linear systems with either Markovian or non-Markovian observations to compare direct multi-step prediction and autoregressive evaluation of single-step predictors. -B Contributions Our prior work [ 18 ] provided a quantitative comparison of the multi-step prediction error incurred by a directly learned multi-step predictor and autoregressive evaluation of a single-step predictor. Here, we extend this work by: (i) considering a third class of predictors, specifically a single-step predictor trained by minimizing a multi-step loss, (ii) analyzing the resulting closed-loop control performance, and (iii) providing complete proofs. In particular: • We provide an asymptotic characterization of the multi-step prediction error for the three methods in the setting of a fully observed dynamical system. Our results show that for stable systems with a small spectral radius, the prediction error of autoregressive evaluation for a single-step predictor decays significantly faster with increasing data than that of the other methods. • We characterize the prediction error for the three methods applied to a partially observed dynamical system that is incorrectly assumed to be fully observed by the hypothesis class, thus addressing the issue of trajectory prediction under misspecification due to an unjustified Markovian assumption. These results demonstrate that multi-step predictors may enjoy significantly lower bias in the face of model misspecification. • We analyze predictor performance in a closed loop control setting. Our results show that, in the case of a fully observed dynamical system (well-specified setting), autoregressive evaluation of a single-step predictor fitted with a single step loss often yields lower control cost than autoregressive evaluation of a single step predictor fitted with a multistep loss. • We conduct numerical experiments that exemplify the above results. Code to reproduce these experiments is available. 1 1 1 Code to reproduce experiments: https://github.com/annesomalwar/Multistep-Prediction.git Our results, while limited to stylized settings, capture key properties of