ForecastCompass: Guiding Agentic Forecasting with Adaptive Factor Memory
Yurui Chang, Yongkang Du, Yuanpu Cao, Jinghui Chen, Lu Lin · 2026
Read ForecastCompass: Guiding Agentic Forecasting with Adaptive Factor Memory by Yurui Chang, Yongkang Du, Yuanpu Cao, Jinghui Chen, Lu Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30858.txt.
Introduction
Chang and colleagues build a memory aid for agents that must forecast before outcomes are known, working from patchy clues. Old agent memories store chats, notes, or facts, but not forecast drivers or calibration rules. Their ForecastCompass sorts forecast tasks in a taxonomy and keeps two stores: factor memory for reusable drivers, and reasoning memory for odds updates, doubt handling, and calibration. Past forecasts are re-read to revise both stores. Tests on two forecast arenas with two models show better odds accuracy and calibration.
Catalog record
| CREATOR | Yurui Chang, Yongkang Du, Yuanpu Cao, Jinghui Chen, Lu Lin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84620 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30858
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ForecastCompass: Guiding Agentic Forecasting with Adaptive Factor Memory Yurui Chang, Yongkang Du, Yuanpu Cao, Jinghui Chen, Lu Lin Abstract Agentic forecasting is important for decision-making in dynamic environments, but it remains challenging because agents must reason from incomplete, time-limited evidence and produce calibrated probabilities before outcomes are resolved. Memory provides a natural mechanism for transferring experience from resolved forecasts to future prediction tasks. However, existing agent-memory methods are not tailored to forecasting, as they typically store past interactions, reflections, or factual associations without explicitly representing reusable predictive factors or calibration knowledge. We propose Fo recast Co mpass ( FoCo ), an adaptive factor-based memory framework for agentic forecasting. FoCo organizes forecasting experience with a hierarchical forecasting-task taxonomy, enabling retrieval task-relevant forecasting knowledge. It maintains two complementary memory components: factor memory, which captures reusable predictive dimensions, and reasoning memory, which encodes probability updating, uncertainty handling, and calibration principles. Using retrospective analyses as learning signals, FoCo iteratively revises memory through a verbalized memory-revision procedure, enabling the agent to accumulate transferable forecasting knowledge over time. Experiments on Prophet Arena and FutureX with GPT-5-mini and Gemini-2.5-Flash show that FoCo improves both probabilistic accuracy and calibration. 1 Introduction Large language model based agents have emerged as a promising framework for complex real-world tasks that require information seeking ( 18 ) , tool using ( 21 ; 23 ) , multi-step reasoning ( 34 ; 29 ) , and decision-making under uncertainty ( 28 ) . Forecasting is a natural and important instance of this setting, since many high-stakes decisions require anticipating uncertain future events, such as market movements ( 2 ; 9 ) , policy changes ( 27 ) , and geopolitical developments ( 26 ) . As LLM-based agents become capable of searching the web, using tools, synthesizing evidence, and reasoning over dynamic information, they provide a promising foundation for agentic forecasting ( 35 ) . Building on this perspective, agentic forecasting can be viewed as a more flexible alternative to classical forecasting pipelines ( 15 ; 18 ; 35 ) . Classical forecasting methods in statistics, machine learning, and decision science typically identify the predictive factors, model their temporal dynamics, and update predictions as new observations become available ( 14 ; 13 ; 31 ) . However, their modeling process is often constrained by predefined features, structured inputs, and domain-specific assumptions. This limits their flexibility in open-world settings, where relevant evidence may be unstructured, heterogeneous, and distributed across many sources. In contrast, agentic forecasting provides a more flexible paradigm by enabling agents to actively seek information, synthesize diverse evidence, and adapt their reasoning to the forecasting task ( 36 ; 33 ; 4 ) . Given that forecasting fundamentally depends on identifying and modeling the predictive factors, one natural question is: can agentic forecasters also be guided to reason in a factor-centric manner? Instead of relying only on generic experiences or event-level forecast outputs, an agent should learn factor-level knowledge from past events and reuse it for future forecasting. Memory provides a natural mechanism for this by storing factor-granular information that can guide factor selection and probability calibration in the future tasks. Figure 1 : Generic memory v.s. FoCo memory on an example forecasting task. However, existing memory mechanisms for LLM agents are largely designed for question-answering or problem-solving settings, where memory helps recover an answer, reuse reasoning traces, or avoid past mistakes ( 16 ; 1 ; 7 ) . Forecasting requires memory beyond that used for question answering. While QA often relies on retrieving or verifying existing answers, forecasting requires calibrated probabilities for unresolved events under partial and evolving evidence. Useful forecasting memory should therefore abstract predictive factors, filter misleading signals, and calibrate uncertainty before outcomes are known. For example, in an app-ranking forecast in Figure 1 , a generic memory may imply improved ranking based on stored trace such as “ the app has strong brand recognition, many downloads, and positive reviews. ” While useful, this trace does not identify which signals are informative for short-horizon rank changes. A forecasting-specific memory should instead guide the agent toward dynamic predictive factors such as recent rank momentum, platform featuring, advertising bursts, and competitor movement, while discouraging overconfidence when only static popularity evidence is available. This motivates a forecasting-specific memory design that abstracts reusable predictive factors, misleading signals, and calibration principles to guide the future probabilistic predictions. To address these challenges, we propose FoCo ( Fo recast Co mpass), the first forecasting-specific memory framework that organizes past forecasting experience into hierarchical structured memory for future probabilistic prediction. Rather than storing full trajectories or instance-level conclusions, FoCo maintains two complementary memory components at the subcategory level: predictive-factor memory , which captures reusable signals, misleading evidence patterns, and factor-level lessons, and calibration-oriented reasoning memory , which captures how confidence should be adjusted under different evidence conditions. At inference time, the agent retrieves relevant memory to guide evidence search, factor selection, and probability estimation for new unresolved questions. To construct and update this memory, FoCo performs contrastive memory revision over resolved forecasting tasks. It contrasts forecasting trajectories with retrospective trajectories, uses their discrepancies as diagnostic signals, and revises the hierarchical memory into reusable predictive factors and calibration principles while avoiding event-level hindsight. Experiments on dynamic forecasting benchmarks show that FoCo improves both accuracy and calibration, with learned memory transferring across time periods and model backbones. Our main contributions are summarized as follows: • We formulate factor-centric memory for agentic forecasting, where memory is organized as subcategory-level predictive factors and calibration-oriented reasoning patterns, rather than event-level trajectories or generic reflections. • We develop verbalized factor-memory revision , an iterative diagnose–aggregate–revise procedure that treats retrospective analyses as learning signals for revising memory into transferable predictive-factor and calibration-oriented abstractions, while excluding event-specific hindsight. • We conduct experiments on dynamic forecasting benchmarks including Prophet Arena and FutureX, showing that FoCo improves both forecasting accuracy and calibration. We further analyze its transferability across time and models, demonstrating that forecasting memory provides reusable guidance for future unresolved questions. 2 Preliminaries Agentic forecasting. We consider a chronological forecasting setting where a language-model agent A_{\theta} makes probabilistic predictions about future events by acquiring evidence and reasoning over it. For a question q_{t} with K_{t} possible outcomes, the agent observes a time-valid evidence pool E_{t} and produces (z_{t},p_{t})=A_{\theta}(q_{t},E_{t}),\qquad p_{t}\in\Delta^{K_{t}-1}, (1) where z_{t} is the generation trajectory and p_{t} is the forecast distribution over the K_{t} outcomes. Information regimes. We distinguish two regimes. In the forecasting regime, the agent can only use pre-resolution evidence E_{t} and produces a deployable forecast. After the outcome is resolved, the retrospective regime provides post-resolution evidence E_{t}^{\mathrm{retro}} , from which the agent generates a retrospective trajectory z_{t}^{\mathrm{retro}} . This trajectory is not used for deployment; it serves as a learning signal that exposes the strengths and failures of the original forecast. Figure 2 : Framework overview. A : the hierarchical forecasting memory organizes subcategory-level factor memory and reasoning memory. B : a new question is classified into a subcategory, relevant memory is retrieved, and the agent produces a calibrated forecast. C : the memory is updated by contrasting original trajectories with retrospective trajectories and iteratively revised. 3 Method We introduce FoCo , a framework that builds forecasting memory from retrospective revisions