Foundation Model Forecasts: Form and Function
Alvaro Perez-Diaz, James C. Loach, Danielle E. Toutoungi, Lee Middleton · 2025
Read Foundation Model Forecasts: Form and Function by Alvaro Perez-Diaz, James C. Loach, Danielle E. Toutoungi, Lee Middleton (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19345.txt.
Introduction
Alvaro Perez-Diaz and three co-authors argue that the form of a forecast matters as much as its accuracy for time series foundation models. A forecast can be a single point, a range of quantiles, a full distribution, or an ensemble of full trajectories. Each form supports different real decisions.
Surveying recent models, they find two-thirds emit only point or simple distribution forecasts, while many practical tasks need trajectory ensembles that keep time dependence intact. Trajectory ensembles can be reduced to simpler forms freely. But the reverse needs extra assumptions. The authors prove some path-dependent risks cannot be recovered from marginal forecasts at all.
Catalog record
| CREATOR | Alvaro Perez-Diaz, James C. Loach, Danielle E. Toutoungi, Lee Middleton |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19345
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Foundation Model Forecasts: Form and Function Alvaro Perez-Diaz, James C. Loach, Danielle E. Toutoungi, Lee Middleton Abstract Time-series foundation models (TSFMs) achieve strong forecast accuracy, yet accuracy alone does not determine practical value. The form of a forecast—point, quantile, parametric, or trajectory ensemble—fundamentally constrains which operational tasks it can support. We survey recent TSFMs and find that two-thirds produce only point or parametric forecasts, while many operational tasks require trajectory ensembles that preserve temporal dependence. We establish when forecast types can be converted and when they cannot: trajectory ensembles convert to simpler forms via marginalization without additional assumptions, but the reverse requires imposing temporal dependence through copulas or conformal methods. We prove that marginals cannot determine path-dependent event probabilities—infinitely many joint distributions share identical marginals but yield different answers to operational questions. We map six fundamental forecasting tasks to minimal sufficient forecast types and provide a task-aligned evaluation framework. Our analysis clarifies when forecast type, not accuracy, differentiates practical utility. 1 Introduction Time-series foundation models (TSFMs) have emerged as a transformative approach to time-series forecasting, achieving strong zero-shot and few-shot performance across diverse datasets and domains [ 49 , 57 , 96 , 48 , 79 , 93 ] . Recent models demonstrate impressive accuracy on benchmark tasks, matching or exceeding specialized statistical methods and earlier deep-learning architectures. However, forecast accuracy alone does not determine practical utility. The form of a forecast—whether it outputs point forecasts, quantile forecasts, parametric forecasts, or trajectory ensembles—fundamentally constrains which downstream applications it can support. Consider a risk manager evaluating portfolio value-at-risk (VaR) over a five-day horizon. A point forecast of daily returns, no matter how accurate, cannot answer “ what is the probability our cumulative loss exceeds 5%? ”. A quantile forecast trained on levels \{0.1,\ldots,0.9\} can interpolate within this range but cannot reliably estimate tail risk at the 1st or 99th percentile without (risky) extrapolation. A parametric forecast does provide a distribution at each time step, but computing the distribution of the five-day sum requires assumptions about temporal dependence. Knowing the distribution of predicted returns for tomorrow and for the day after is not sufficient to determine whether losses will cluster (high correlation) or cancel out (negative correlation)—yet this temporal structure is exactly what determines cumulative risk. Only a trajectory ensemble—sampled paths from the joint predictive distribution—directly yields the answer through Monte Carlo estimation, because it explicitly represents how returns co-vary over time. This fundamental limitation is not a modeling choice but a mathematical fact: per-step marginal distributions cannot uniquely determine probabilities of path-dependent events without additional assumptions about dependence structure (formalized in Proposition 2 ). Similar constraints arise across domains: predictive maintenance requires first-passage probabilities, capacity planning requires simultaneous forecast bands, and climate loss modeling requires scenario generation with realistic temporal structure. The gap. Existing TSFM surveys [ 49 , 57 , 96 , 48 , 79 , 93 ] comprehensively cover architectural innovations and training strategies. However, they provide limited guidance on which forecast types enable which operational tasks, when conversions between forecast types are valid, and how to select an evaluation metric appropriate for a given task. This gap matters increasingly as TSFMs mature: when multiple models achieve similar accuracy, forecast type becomes the primary differentiator of practical value. Moreover, practitioners may wish to ensemble forecasts from multiple TSFMs to improve robustness—a strategy proven effective across machine learning domains—but must first convert models to a common forecast type, potentially discarding valuable information. Our survey of published TSFMs reveals an important mismatch between model capabilities and application requirements: the majority produce only point forecasts or parametric forecasts, while trajectory ensembles—the most expressive forecast type capable of addressing path-dependent questions like threshold crossing and aggregate risk without post-processing—remain relatively rare. This detailed survey can be found in Appendix A . Two recent studies have examined TSFMs from a lens similar to ours, though with important limitations. Adler et al. 2025 analyze the calibration properties of several existing TSFMs, but restrict their analysis to marginal calibration at individual future time steps without examining operational tasks. Achour et al. 2025 explore conformal prediction methods for TSFMs, yet similarly focus only on marginal coverage without considering downstream applications. To our knowledge, no prior work has systematically examined the interplay between forecast types, operational tasks, forecast convertibility, and evaluation metrics. Our contributions. This paper provides a systematic task-oriented analysis of TSFM forecasts, with formal theory characterizing when different forecast types enable different applications. We make four main contributions: 1. A task-oriented taxonomy. We formalize four forecast types—point forecasts, quantile forecasts, parametric forecasts, and trajectory ensembles—and characterize their expressiveness hierarchy ( Section 2 ). 2. Task-forecast mapping with sufficiency results. We identify six canonical forecasting problems spanning operational domains and derive the minimal forecast type that suffices for each. We prove when simpler forecast types do not suffice for path-dependent questions without additional assumptions ( Section 3 ). 3. Convertibility theory with impossibility results. We formalize conversions between forecast types through a directed graph, proving when transformations require no additional assumptions (trajectory ensembles to any other form via marginalization), when they require structural assumptions (marginals to joint distributions via copulas), and establishing formal impossibility results for path-dependent questions from marginal forecast types (Propositions 1-3, Section 4 ). 4. Task-aligned evaluation framework. We provide a systematic mapping of proper scoring rules to forecast types and operational tasks, clarifying when marginal metrics ( e.g. , CRPS) versus joint metrics ( e.g. , Energy Score) are required ( Section 5 ). Our analysis targets both TSFM developers choosing which forecast types to implement and practitioners selecting models for specific application contexts. We show that trajectory ensembles are strictly most expressive—convertible to all other forms through marginalization without additional assumptions—but that simpler forecast types suffice for many tasks. Conversely, attempting to answer path-dependent questions with marginal forecast types requires explicit dependence modeling and validation that is often overlooked in practice. Organization. Section 2 defines the four forecast types. Section 3 maps six fundamental forecasting tasks to minimally-sufficient forecast types. Section 4 formalizes convertibility between forecast types. Section 5 presents task-aligned evaluation methodology. Section 6 concludes with implications for research and practice. 2 Form We formalize four forecast types that TSFMs can produce. These differ fundamentally in what downstream questions they can answer. This taxonomy is not exhaustive—other forecast types are conceivable—but it encompasses all types observed in published TSFMs to date. For each type, we provide its mathematical definition, key properties, and operational implications. Throughout, we consider univariate forecasting: given history \mathbf{y}_{1:T}=(y_{1},\dots,y_{T}) with y_{t}\in\mathbb{R} , forecast the next h time steps. The analysis extends naturally to multivariate series and to models incorporating time or exogenous covariates. Figure 1 illustrates all four forecast types for the same underlying forecast. The full review of published TSFMs and the output type of each can be found in Appendix A . Figure 1: Four forecast types derived from the same underlying predictive distribution. Point shows per-step medians or means—note the smooth line is not a sampled trajectory but a sequence of coordinate-wise summaries. Quantile and Parametric display per-step marginal distributions; uncertainty bands at each time step do not imply joint coverage over the horizon. Trajectory shows sampled paths from the joint distribution, preserving temporal dependence.