Diffusion-Based Scenario Tree Generation for Multivariate Time Series Prediction and Multistage Stochastic Optimization
Stelios Zarifis, Ioannis Kordonis, Petros Maragos · 2025
Read Diffusion-Based Scenario Tree Generation for Multivariate Time Series Prediction and Multistage Stochastic Optimization by Stelios Zarifis, Ioannis Kordonis, Petros Maragos (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14832.txt.
Introduction
Stelios Zarifis, Ioannis Kordonis, and Petros Maragos generate future scenarios as trees using diffusion models in a 2025 forecasting paper. Good decisions under uncertainty, in energy markets or finance, need the full spread of possible futures, not just one forecast. Their framework, Diffusion Scenario Tree, builds that spread in a structured form suited to step-by-step control.
The method samples future paths again and again and groups them into a tree by clustering. The tree respects a key rule: each decision can depend only on what has been observed so far. Plugged into model predictive control, the trees were tested on electricity price arbitrage in New York State's day-ahead market. The approach beat the same optimizers fed with trees from conventional models, and it used energy storage more efficiently.
Catalog record
| CREATOR | Stelios Zarifis, Ioannis Kordonis, Petros Maragos |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-14832
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Diffusion-Based Scenario Tree Generation for Multivariate Time Series Prediction and Multistage Stochastic Optimization Stelios Zarifis, Ioannis Kordonis, Petros Maragos Abstract Stochastic forecasting is critical for efficient decision-making in uncertain systems, such as energy markets and finance, where estimating the full distribution of future scenarios is essential. We propose Diffusion Scenario Tree (DST), a general framework for constructing scenario trees for multivariate prediction tasks using diffusion-based probabilistic forecasting models. DST recursively samples future trajectories and organizes them into a tree via clustering, ensuring non-anticipativity (decisions depending only on observed history) at each stage. We evaluate the framework on the optimization task of energy arbitrage in New York State’s day-ahead electricity market. Experimental results show that our approach consistently outperforms the same optimization algorithms that use scenario trees from more conventional models and Model-Free Reinforcement Learning baselines. Furthermore, using DST for stochastic optimization yields more efficient decision policies, achieving higher performance by better handling uncertainty than deterministic and stochastic MPC variants using the same diffusion-based forecaster [ 1 ] . † † address: 1 Robotics Institute, Athena Research Center, 15125 Maroussi, Greece 2 HERON - Hellenic Robotics Center of Excellence, Athens, Greece 3 School of Electrical & Computer Engineering, National Technical University of Athens, Greece [email protected], [email protected], [email protected] 1 Introduction Robust decision-making under uncertainty requires forecasts that capture not only the most likely outcome but also the full distribution of future evolution. Scenario trees, a classical tool in stochastic optimization, model time-evolving uncertainty while enforcing non-anticipativity, ensuring decisions at each node depend only on information revealed up to that point [ 2 , 3 ] . Traditional methods like VAR and LSTM are widely used but struggle with complex, multimodal dynamics, typically offering point forecasts rather than distributions, which carry richer information for decision-making. In contrast, diffusion forecasters like TimeGrad [ 4 ] , can effectively guide multistage stochastic optimization by learning the full conditional distribution of future observations. Other diffusion-based models for time series, such as those designed for financial denoising [ 5 ] or integrated with foundation models [ 6 ] , can similarly capture complex, temporal, multimodal dependencies. Diffusion-based methods have been applied to scenario generation in energy domains. For example, Li et al. [ 7 ] use a multi‐resolution diffusion model with time-series decomposition for renewable energy outputs, and Zhao et al. [ 8 ] propose a conditional diffusion model to jointly handle source-load uncertainties with spatio-temporal fusion, controllability and noise estimation. However, these works generate scenario sets rather than structured scenario trees, and do not explicitly integrate scenario trees into multistage decision optimization. In this paper, we introduce the Diffusion Scenario Tree (DST) framework, a generic methodology for constructing scenario trees using a diffusion-based probabilistic forecaster. Each node represents a potential future state along with its associated realization probability, recursively generated from the learned distribution. This structure can be integrated naturally in optimization frameworks, providing the decision-maker with a rich representation of the forecast uncertainty. We demonstrate the effectiveness of our approach by applying it to a multistage stochastic optimization problem for forecasting electricity prices in the New York power grid. We compare the performance of DST against scenario trees generated from VAR and LSTM models, our prior diffusion-based methods which showcased powerful capabilities, and Model-Free Reinforcement Learning (RL) baselines, showing superior behavior in optimizing decisions under uncertainty. Our previous work [ 1 ] introduced Diffusion-Informed MPC , a framework that integrates diffusion forecasts into MPC algorithms. The present work advances our research by proposing a fundamentally new algorithm that generates diffusion-based scenario trees for multivariate prediction, tested on the same problem setup to enable direct comparison with standard MPC, and showcase the benefits of using DST . 2 Background Decision-making in applications like energy markets, finance, and robotics requires precise modeling of time-evolving uncertainty to optimize actions. Scenario trees, a standard tool used in multistage stochastic optimization, represent uncertainty through nodes for possible future states and branches with associated probabilities [ 2 , 3 ] . These trees respect non-anticipativity so that decisions at each stage depend only on observed information up to that point, and they discretize continuous distributions, enabling tractable optimization. Early methods for scenario tree generation use sampling and scenario reduction [ 2 , 9 ] , while more recent approaches rely on Markov chain approximations or moment-matching to capture multivariate dynamics [ 3 , 10 ] . Forecasting models are often used to generate scenarios across stages. Time series models like ARIMA or GARCH generate scenarios from historical data, followed by recursive reduction or bundling [ 11 , 12 ] . Data-driven methods align scenarios with statistical properties such as mean and variance through optimization and clustering [ 13 ] . Non-parametric density estimation, like kernel methods, samples trajectories without fixed forms, capturing complex patterns [ 14 ] , while parametric models such as SDEs for price dynamics assume structured distributions [ 15 ] . Beyond these, recent applications include learning-based adaptive scenario-tree MPC with Bayesian neural networks [ 16 ] , scenario-tree MPC-based RL for autonomous vehicles [ 17 ] , scenario-tree MPC for highway interactions [ 18 ] , microgrid sizing with scenario trees [ 19 ] . However, these methods face challenges: statistical forecasters assume normal distributions for the errors, limiting their ability to model complex patterns; traditional forecasting models do not have the required inherent complexity to capture multimodal dynamics, and scenario reduction can compromise tree robustness by discarding useful scenarios. In contrast, we propose to use diffusion-based forecasters like TimeGrad [ 4 ] to acquire accurate, probabilistic predictions. TimeGrad, is an autoregressive model that guides the diffusion processes of a Denoising Diffusion Probabilistic Model (DDPM) [ 20 ] using a Recurrent Neural Network to encode the time series history, learning the conditional distribution of future multivariate time series: p_{\theta}(\mathbf{x}_{k_{0}:N}|\mathbf{x}_{1:k_{0}-1})\approx q(\mathbf{x}_{k_{0}:N}|\mathbf{x}_{1:k_{0}-1}),\vskip-5.0pt where \mathbf{x}_{k}\in\mathbb{R}^{D} is the multivariate time series vector at time k . TimeGrad has showcased impressive ability to capture long-range dependencies and multimodal patterns, making it ideal for sampling trajectories to construct scenario trees. Our framework integrates TimeGrad’s probabilistic forecasts into scenario tree construction, using clustering to organize trajectories. This enables more efficient optimization, achieving greater accuracy and robustness compared to using VAR and LSTM, and over standard deterministic and stochastic MPC using the exact same TimeGrad model. 3 Methodology 3.1 Problem Definition We present a method for a class of partially observable stochastic systems, where dynamics are separable into a deterministic component, influenced by actions, and a stochastic one, driven by external factors. This class of problems with separable state is common across many real-world applications such as energy market trading, finance, inventory management, and robotics. We model the system as a Partially Observable Markov Decision Process (POMDP), defined by (S,A,T,R,\Omega,O,\gamma) , where S is the state space, A the action space, T the transition function, R the reward function, \Omega the observation space, O the observation function, and \gamma\in[0,1) the discount factor, consistent with our previous work [ 1 ] . At time step k , the environment is in a hidden state s_{k}\in\mathcal{S} . The agent selects an action a_{k}\in\mathcal{A} , causing the environment to transition to state s_{k+1} , yielding observation o_{k+1}\sim O(o_{k+1}|s_{k+1},a_{k}) and reward r_{k}=R(o_{k},a_{k}) . The observation is o_{k}=(o_{k}^{d},o_{k}^{s})\in\Omega , where