What if Tomorrow is the World Cup Final? Counterfactual Time Series Forecasting with Textual Conditions

Shuqi Gu, Yongxiang Zhao, Baoyu Jing, Kan Ren · 2026

Read What if Tomorrow is the World Cup Final? Counterfactual Time Series Forecasting with Textual Conditions by Shuqi Gu, Yongxiang Zhao, Baoyu Jing, Kan Ren (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14422.txt.

Introduction

Gu and colleagues present counterfactual time series forecasting with text settings, tuning future series to coming events, not just history. Older methods rely on past data or factual future settings, handling only tidy settings. Their task lets future series adapt to complex, stochastic future settings given in text. They provide an evaluation framework spanning factual and what-if settings even without ground-truth series. A text mechanism telling mutable from immutable factors lifts scores under tricky, random text settings.

Catalog record

CREATORShuqi Gu, Yongxiang Zhao, Baoyu Jing, Kan Ren
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75068
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14422

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What if Tomorrow is the World Cup Final? Counterfactual Time Series Forecasting with Textual Conditions Shuqi Gu, Yongxiang Zhao, Baoyu Jing, Kan Ren Abstract Time series forecasting has become increasingly critical in real-world scenarios, where future sequences are influenced not only by historical patterns but also by forthcoming events. In this context, forecasting must dynamically adapt to complex and stochastic future conditions, which introduces fundamental challenges in both forecasting and evaluation. Traditional methods typically rely on historical data or factual future conditions, while overlooking counterfactual scenarios. Furthermore, many existing approaches are restricted to simple structured conditions, limiting their ability to generalize to the real-world complexities. To address these gaps, we introduce the task of counterfactual time series forecasting with textual conditions, enabling more flexible and condition-aware forecasting. We propose a comprehensive evaluation framework that encompasses both factual and counterfactual settings, even in the absence of ground truth time series. Additionally, we present a novel text-attribution mechanism that distinguishes mutable from immutable factors, thereby improving forecast accuracy under sophisticated and stochastic textual conditions. The project page is at https://seqml.github.io/TADiff/ . 1 Introduction Time series forecasting plays a critical role in many real-world domains, including energy ( 14 ) , climate ( 13 ; 12 ) , healthcare ( 9 ; 4 ) , and finance ( 6 ) . Recent advances span from innovations in model architectures ( 39 ; 35 ; 24 ; 38 ) to paradigm shifts enabled by large-scale learning with increasingly powerful models ( 2 ; 33 ) . Nevertheless, despite larger model sizes and access to vast datasets, gains in forecasting performance have begun to plateau ( 37 ) . A fundamental limitation of existing approaches is their exclusive reliance on historical observations, overlooking that information encoded in past trajectories is inherently limited and thus insufficient to generate reliable forecasts in hypothetical scenarios. Figure 1 : Two paradigms of time series forecasting in traffic volume with multimodal information are illustrated. Texts in the solid-line box describe the intrinsic features of the time series, whereas texts in the dashed-line box correspond to extrinsic conditions. 1 denotes forecasting based on factual conditions, including the deterministic historical and future information. 2 denotes forecasting under stochastic counterfactual conditions. Time series are shaped by extrinsic conditions beyond historical sequences. Motivated by this, recent studies incorporate multimodal information, such as domain knowledge ( 10 ) , contemporaneous news ( 20 ) , or expert annotations ( 19 ; 15 ) to enrich forecasting. While these extrinsic signals provide valuable supplementary context, they are still tied to historical states and thus cannot anticipate the influence of future conditions. When future dynamics deviate significantly from historical patterns, the forecasting of such models deteriorates. To mitigate this, 37 proposes leveraging deterministic future interventions for improved forecasting. However, the future is inherently uncertain and can unfold differently under diverse conditions. Considering this uncertainty, 22 and 23 model forecasts under counterfactual treatments, but these treatments are restricted to simple fixed event types, such as 0/1 to indicate whether treatments are applied, which limits the flexibility to represent the real-world complexities that cannot be well formulated through categories. To move beyond these constraints, we aim to answer a broader “ what if ” question: how might time series evolve dynamically under complex and stochastic future conditions, even when the conditions are not actually realized in the real world? We formalize this as counterfactual conditional time series forecasting , where future conditions are expressed through textual descriptions. Texts are more flexible to capture subtle details beyond categorical attributes ( 8 ) and align more naturally with human communication, thereby reducing the burden of manual categorical variable design. As shown in Fig. 1 , the evolution of future traffic time series depends jointly on historical data and stochastic future events. This formulation introduces several key challenges. First, historical dynamics and future conditions may exhibit distinct or even conflicting patterns, which can lead to imbalanced forecasting that fails to account for their combined influence. Second, models trained solely on real-world data often struggle to adapt to counterfactual conditions, resulting in homogenized forecasts. Third, the lack of ground-truth for counterfactual settings presents a fundamental obstacle to evaluate forecasting quality. To tackle these challenges, we propose the Text-Attributive time series Diffusion model ( TADiff ), a multimodal diffusion model built upon a novel text-attribution mechanism for counterfactual time series forecasting. Specifically, since future sequences are jointly guided by future conditions and historical patterns, TADiff first attributes historical sequences to intrinsic features that are independent of the historical and future conditions. These intrinsic features provide a foundation for integrating future conditions, enabling more accurate and condition-aware forecasting. To further improve adaptability, we introduce counterfactual data augmentation by synthesizing diverse counterfactual training samples. For evaluation, we design a novel semantic metric that measures the consistency of forecasts with both the textual conditions and the historical sequences, allowing comprehensive assessment even in counterfactual settings. Our main contributions are: (i) We introduce a novel task, counterfactual time series forecasting with textual conditions, enabling accurate, flexible forecasting under stochastic assumptions. (ii) We propose a comprehensive evaluation framework that combines numerical accuracy and semantic alignment measures, allowing systematic benchmarking in both factual and counterfactual settings. (iii) We develop a text-attributive time series diffusion model ( TADiff ) that disentangles intrinsic historical patterns from textual context, along with a training strategy that improves the model’s adaptability to diverse counterfactual conditions through the constructed counterfactual data. 2 Conflict of Interest Disclosure The authors declare that this work has no financial conflict of interest as described in the ICML 2026 Peer‑review Ethics. Specifically, no author is employed by, has received funding from, or holds equity or patents in any organization that could gain or lose financially from the results presented in this paper. All experiments were conducted using publicly available datasets and open‑source tools with no external financial involvement. 3 Related Work 3.1 Unimodal and Multimodal Time Series Forecasting Time series forecasting typically involves predicting future values based on historical data. Research has focused on improving this by developing model architectures that better capture temporal patterns, including linear models ( 39 ) , CNNs ( 34 ) , and transformer-based approaches ( 35 ; 24 ) . Recently, foundation models ( 2 ; 33 ) have emerged to learn universal time series representations from large datasets and model capacity. However, these methods still mainly rely on numerical historical sequences, overlooking the crucial impact of extrinsic conditions. To address this limitation, recent studies have explored incorporating multimodal extrinsic information into forecasting. Among various modalities, text has become the most prevalent, appearing as domain knowledge ( 10 ) , news ( 20 ; 31 ) , or expert annotations ( 19 ) , providing complementary signals for prediction. Other approaches transform time series into alternative modalities, such as frequencies ( 18 ) or images ( 41 ) , to enhance model expressiveness. Nonetheless, these methods predominantly derive multimodal inputs from historical data, limiting their capacity to address scenarios where future dynamics diverge substantially from past observations. More recent works ( 37 ; 3 ) have begun to incorporate future interventions into forecasting, with 32 introducing a benchmark for evaluating time series forecasting conditioned on

Read the complete text