Horizon-Constrained Rashomon Sets for Chaotic Forecasting
Gauri Kale, Rahul Vishwakarma, Holly Diamond, Ava Hedayatipour*, Amin Rezaei · 2026
Read Horizon-Constrained Rashomon Sets for Chaotic Forecasting by Gauri Kale, Rahul Vishwakarma, Holly Diamond, Ava Hedayatipour*, Amin Rezaei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05218.txt.
Introduction
Gauri Kale and four co-authors connect two ideas that grew up apart: the Rashomon set, the family of near-equally-good models for one task, and chaos, where small differences explode over time. For forecasting chaotic systems, near-identical models diverge exponentially with lead time, so the set of still-equivalent models cannot stay fixed. Their framework makes that shrinking precise and measurable.
They prove the effective Rashomon set contracts at a rate set by the largest Lyapunov exponent and build weighted metrics giving tighter bounds on disagreement. Selection algorithms then choose among near-best models by downstream usefulness, not accuracy alone. Experiments on synthetic chaos and on wind, traffic, and weather data improved decision quality while keeping forecasts competitive.
Catalog record
| CREATOR | Gauri Kale, Rahul Vishwakarma, Holly Diamond, Ava Hedayatipour*, Amin Rezaei |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05218
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Horizon-Constrained Rashomon Sets for Chaotic Forecasting Gauri Kale, Rahul Vishwakarma, Holly Diamond, Ava Hedayatipour*, Amin Rezaei Abstract Predictive multiplicity and chaotic dynamics represent two fundamental challenges in machine learning that have evolved independently despite their conceptual connections. We bridge this gap by introducing horizon-constrained Rashomon sets, a theoretical framework that characterizes how model multiplicity evolves with prediction horizon in chaotic systems. Unlike static prediction tasks where the Rashomon set remains fixed, chaos induces exponential divergence among initially similar models, fundamentally transforming the nature of predictive equivalence. We prove that the effective Rashomon set contracts exponentially with lead time at a rate determined by the maximum Lyapunov exponent and introduce Lyapunov-weighted metrics that provide tighter bounds on predictive disagreement. Leveraging these insights, we develop decision-aligned selection algorithms that choose among near-optimal models based on downstream utility rather than forecast accuracy alone. Extensive experiments on synthetic chaotic systems (Lorenz-96, Kuramoto-Sivashinsky) and real-world applications (wind power, traffic, weather) demonstrate that our framework improves decision quality by 18-34% while maintaining competitive predictive performance. This work establishes the first rigorous connection between chaos theory and predictive multiplicity, providing principled guidance for deploying machine learning in safety-critical chaotic domains. I Introduction Recommender systems, financial markets, weather prediction, and traffic management share a fundamental challenge: they operate in chaotic domains where small differences in initial conditions lead to exponentially diverging outcomes 16 ; 24 . Simultaneously, the machine learning community has recognized that multiple models can achieve equivalent predictive accuracy while making conflicting individual predictions, a phenomenon known as the Rashomon effect 4 . Despite their conceptual similarity, these two While these two established research areas share conceptual similarities, they have developed independently over time. have evolved in isolation. The predictive multiplicity literature has established rigorous frameworks for characterizing the space of equally good models 18 ; 23 ; 22 ; 7 ; 10 ; 11 . However, this work focuses exclusively on static prediction tasks without considering temporal dynamics. Conversely, the chaos forecasting community has achieved remarkable success in predicting chaotic systems 2 ; 5 Lyapunov times ahead using reservoir computing and neural operators 19 ; 25 , yet consistently optimizes for single "best" models without characterizing the multiplicity of equally accurate alternatives. This disconnect has practical consequences. Consider wind power forecasting: multiple neural architectures may achieve identical 6-hour ahead accuracy, 7 yet their 24-hour predictions diverge substantially due to chaos-induced sensitivity. Which model should guide grid dispatch decisions? Current frameworks provide no principled answer, as they fail to account for how chaos transforms predictive multiplicity over time. The stakes are particularly high in safety-critical applications where incorrect model selection can lead to blackouts, traffic congestion, or failed emergency responses. Moreover, as machine learning systems are increasingly deployed for climate adaptation, epidemic forecasting, and autonomous systems operating in turbulent environments, understanding the interplay between chaos and model multiplicity becomes essential for reliable real-world deployment. Existing approaches that ignore temporal dynamics risk systematic errors in model selection, potentially favoring models that excel at short-term prediction but fail catastrophically at decision-relevant horizons. Recent work has established an effective early-warning index for extreme events by integrating Rényi entropy production with Lyapunov exponents, demonstrating its predictive capability in systems like the Lorenz, FitzHugh–Nagumo, and Ikeda map. The theoretical foundations of both fields suggest this integration is a natural and necessary next step. Chaos theory has established that deterministic systems exhibit finite predictability horizons, beyond which forecasts become effectively random regardless of model sophistication 12 . Simultaneously, the Rashomon effect demonstrates that optimization landscapes in machine learning are fundamentally non-convex, admitting multiple global optima with distinct behaviors. Yet no existing work has examined how these phenomena interact: does chaos amplify or constrain predictive multiplicity? How should decision-makers navigate model selection when both forecast accuracy and downstream utility matter? What algorithmic principles can guide practitioners facing these dual uncertainties? These questions remain unanswered despite their critical importance for trustworthy AI deployment in dynamic environments. We address this gap by introducing horizon-constrained Rashomon sets , a theoretical framework that captures the time-varying nature of model multiplicity in chaotic systems. Our key insight is that chaos fundamentally transforms predictive equivalence where models that agree perfectly on short-term forecasts diverge exponentially as they approach the system’s predictability horizon. This time-varying multiplicity necessitates new theoretical tools and algorithmic approaches for model selection in chaotic domains. The main contributions of this paper are as below: • We formalize horizon-constrained Rashomon sets for chaotic dynamics and prove that the effective set contracts exponentially with lead time at a rate determined by the maximum Lyapunov exponent (Theorem 1). • We introduce Lyapunov-weighted Rashomon ratios that account for chaos-induced sensitivity, providing substantially tighter bounds on predictive disagreement than classical metrics (Theorem 2). • We develop decision-aligned selection algorithms that efficiently choose among near-optimal forecasting models based on downstream utility functions, with convergence guarantees for convex objectives (Theorem 3). • We validate our framework across three real-world chaotic forecasting tasks, demonstrating 18-34% improvement in decision quality while maintaining competitive predictive accuracy. II Related Work II.1 Predictive Multiplicity and Rashomon Sets The Rashomon effect in machine learning refers to the existence of multiple models with equivalent predictive performance but different individual predictions 4 . D’Amour et al. 8 demonstrated widespread underspecification across ML pipelines, showing that standard practices often fail to uniquely determine model behavior. Marx et al. 18 formalized predictive multiplicity and introduced metrics to quantify disagreement among equally accurate models. Recent work has explored the implications of Rashomon sets for fairness and interpretability. Black et al. 3 showed that equally accurate models can differ substantially in their fairness properties, while Rudin et al. 22 argue for leveraging multiplicity to find simpler, more interpretable models without sacrificing accuracy. Xin et al. 27 developed efficient algorithms for exploring the entire Rashomon set of sparse decision trees. Despite these advances, existing work on predictive multiplicity focuses exclusively on static prediction tasks. No prior work has considered how temporal dynamics, particularly chaos, affects the evolution and structure of Rashomon sets over time. 1 II.2 Machine Learning for Chaotic Systems Reservoir computing has emerged as a powerful approach for forecasting chaotic systems 14 ; 13 . Pathak et al. 19 demonstrated that reservoir computers can predict chaotic dynamics for 5-8 Lyapunov times, substantially outperforming traditional methods. Vlachas et al. 25 combined backpropagation with reservoir computing to extend prediction horizons further. Physics-informed neural networks (PINNs) incorporate known governing equations as constraints, improving generalization for chaotic PDEs 21 . Recent work on neural operators has overcome fundamental limitations of traditional closure models 6 . Large-scale weather models like FourCastNet 20 and GraphCast 15 have achieved state-of-the-art performance on operational forecasting tasks. However, this extensive literature consistently focuses on finding single optimal models. The multiplicity of equally accurate forecasting models and its implications for decision-making remain unexplored. II.3 Decision-Focused Learning Decision-focused learning optimizes predictive models for downstream decision quality rather than forecast accuracy alone 26 . This paradigm has been extended to various settings including online optimization 9 and fairness-aware prediction 29 . Mandi et al. 17 provide a comprehensive survey of the field. While decision-focused learning provides tools for optimizing predictions toward specific objectives, existing work does not address the unique challenges posed by chaotic dynamics or