Mechanism Learning: Prototype-Anchored Mechanism Inference for Scientific Forecasting

Qian Jiang, Liping Sun · 2026

Read Mechanism Learning: Prototype-Anchored Mechanism Inference for Scientific Forecasting by Qian Jiang, Liping Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17091.txt.

Introduction

Jiang and Sun build a forecasting method that guesses the local rule driving a system, rather than its next state directly. Their system squeezes short space-time snippets into rule summaries, then anchors those summaries to a small set of sample rules. Tests on a fluid equation, weather data, and a simplified atmosphere model show steadier results when data are scarce or dynamics shift. The gains trace to the anchored samples, not to sheer model size.

Catalog record

CREATORQian Jiang, Liping Sun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57488
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17091

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mechanism Learning: Prototype-Anchored Mechanism Inference for Scientific Forecasting Qian Jiang, Liping Sun Abstract Scientific forecasting typically relies on direct state prediction, an approach that grows brittle under data scarcity, extended horizons, non-stationary dynamics, or high-dimensional complexity. While raw state trajectories are highly sensitive in these regimes, underlying local evolution rules often exhibit robust reusability. We introduce mechanism learning , a framework that forecasts future states by estimating the currently active local mechanism. Our method compresses local spatiotemporal fragments into mechanism descriptors, forming a data-driven, structured mechanism space where proximity reflects similar local evolution rules. To ground these estimates in observed data, we utilize prototype anchors, a set of representative mechanisms that sparsely cover the space of local rules. We evaluate this approach on Burgers dynamics, WeatherBench2, and Lorenz96. Empirically, the learned mechanism spaces resist collapse and maintain strong local consistency. Compared to direct prediction and other models including FNO, NODE, LSTM, and reservoir-family methods, our framework demonstrates predictive gains in fragile regimes: it significantly improves switching stability in Burgers dynamics and achieves state-of-the-art performance both under the scarce-data fixed-horizon WeatherBench2 protocol and in intermediate-complexity Lorenz96. Ablation studies and drift diagnostics confirm that these improvements are driven by finite prototype anchoring rather than sheer latent capacity. Together, these results establish mechanism learning as a principled, robust alternative to direct state prediction in forecasting complex systems. 1 Introduction Scientific forecasting can be organized by the predictive coordinate through which an observed history is mapped to the future. In direct state prediction, the map is H_{t}\mapsto x_{t+\Delta} : recent states are mapped directly to future states. Operator-learning and latent-dynamics approaches instead map histories into learned operators, latent states, or lifted coordinates before prediction [ 9 , 11 , 7 , 6 ] . In this paper we study a different intermediate coordinate: local spatiotemporal fragments are mapped to mechanism descriptors, these descriptors populate an empirical mechanism space, and the current history is forecast through the inferred active local mechanism. Existing structured forecasting methods address these difficulties from several directions. Some models impose or exploit known dynamical structure, such as continuous-time dynamics or equation-aware weather models [ 3 , 5 ] . Others learn operators, latent state-space models, or lifted dynamical coordinates [ 9 , 11 , 7 , 6 ] . A complementary line extracts data-driven dynamical structure through modal decompositions or sparse equation discovery [ 17 , 2 ] . Prototype and memory-based methods provide reusable supports for prediction or classification [ 20 , 18 ] . These directions introduce structure beyond raw state regression, but they typically do not treat the currently active local mechanism as the online object of inference, nor as an explicit pipeline from observed history to inferred mechanism to future state. We introduce mechanism-space forecasting : instead of learning only a map from observed histories to future states, the model first infers a local mechanism descriptor \hat{\theta}_{t} , locates it in an empirical mechanism space, and forecasts through that inferred coordinate. Here, local refers to how descriptors are estimated from short spatiotemporal fragments or neighborhoods, while short-term refers to the finite forecast window over which the descriptor is used. The resulting mechanism space is empirical: it is a predictive geometry constructed and diagnosed from data, not an assertion that the learned coordinates are a complete chart of true physical degrees of freedom. Our contribution is to make this missing object explicit. We study whether empirical mechanism spaces are non-degenerate, locally coherent, and sparsely coverable; whether mechanism-space inference improves stability under switching dynamics and longer leads; and whether the advantage depends on anchored mechanism support rather than an arbitrary latent bottleneck. The central question is when the local mechanism provides a more stable predictive coordinate than the observed state trajectory. Contributions. We make four contributions. Mechanism-space forecasting: we formulate scientific forecasting as online inference of the currently active local mechanism, rather than only direct state prediction. Operational diagnostics: we provide testable diagnostics for non-collapse, local coherence, and sparse coverability across Burgers dynamics, WeatherBench2, and Lorenz96. Predictive gains in fragile regimes: we show that the Full model improves switching stability in Burgers dynamics, achieves state-of-the-art performance under the scarce-data fixed-horizon WeatherBench2 protocol, and supports the intermediate-complexity picture in Lorenz96. Evidence for prototype anchoring: NoBank ablations and drift diagnostics show that the gains are tied to finite prototype anchoring rather than merely inserting a generic latent pathway. Our empirical study spans three systems with complementary roles (Table 1). WeatherBench2 is the primary real-world benchmark and the primary external (FNO) testbed. Burgers provides sparse coverability, switching, and internal mechanism-space evidence. Lorenz96 provides a controlled chaotic system for sweet-spot sweeps, with LSTM and NODE baselines. A fuller comparison to direct forecasting, latent dynamics and operator learning, prototype/retrieval methods, and benchmark settings [ 15 , 19 , 10 ] is provided in Appendix D (Related Work). Figure 1 : Mechanism learning forecasts by inferring the active local mechanism. Observed histories are decomposed into local spatiotemporal fragments and converted into mechanism descriptors \theta_{i} , which populate an empirical mechanism space \Theta of local evolution rules. At inference time, the current history produces a query z_{t} that locates the active mechanism \hat{\theta}_{t} within this space; forecasting then proceeds through a mechanism-conditioned predictor. Prototype anchors p_{k} provide finite support inside the empirical geometry rather than serving as the main conceptual object. The Direct, NoBank, and Full variants test whether predictive gains arise from forecasting through an anchored mechanism coordinate rather than from a generic intermediate latent pathway. 2 Method 2.1 Problem Setup We consider forecasting in dynamical systems from partial or full observations of a time-evolving state. Let x_{t}\in\mathbb{R}^{d_{s}} denote the observed system state at time t , and let the forecasting task be to predict a future state x_{t+\Delta} from recent history. The standard forecasting paradigm is direct state prediction , which learns a mapping f_{\mathrm{dir}}:\;(x_{t-h+1},\dots,x_{t})\mapsto x_{t+\Delta}. This approach treats the forecasting problem as direct regression in state space. In contrast, mechanism-space forecasting introduces an intermediate predictive coordinate, \theta_{t}\in\mathbb{R}^{d_{m}} , intended to summarize the local evolution rule active around time t . Forecasting then proceeds in two stages: (x_{t-h+1},\ldots,x_{t})\mapsto\hat{\theta}_{t}\mapsto\hat{x}_{t+\Delta}. The first arrow is mechanism inference: it locates the current dynamics within an empirical mechanism space. The second arrow is mechanism-conditioned prediction. The distinction is therefore not simply architectural. In the direct paradigm, forecasting is performed in state space; in the mechanism-space paradigm, forecasting is routed through a structured geometry of local evolution rules. Operational mechanism-space objects. Let H_{t}=(x_{t-h+1},\ldots,x_{t}) denote the recent observed history, and let W_{i} denote a local spatiotemporal fragment or neighborhood extracted from the training system. A system-specific extraction map \psi produces a local mechanism descriptor \theta_{i}=\psi(W_{i})\in\mathbb{R}^{d_{m}}, whose role is to summarize the local evolution rule used for prediction over the finite lead \Delta . The empirical mechanism space is the sampled geometry \Theta=\{\theta_{i}\}_{i=1}^{N}\subset\mathbb{R}^{d_{m}}. We use \Theta in a task-level predictive sense: nearby points are intended to represent reusable local dynamics, not necessarily distinct true physical degrees of freedom. At inference time, the current history is encoded into a query z_{t}=E(H_{t}) . Finite support points P=\{p_{k}\}_{k=1}^{K}\subset\mathbb{R}^{d_{m}} anchor inference within this empirical geometry, producing \alpha_{t}=\mathrm{Attn}(z_{t},P),\qquad\hat{\theta}_{t}=\sum_{k=1}^{K}\alpha_{t,k}p_{k},\qquad\sum_{k=1}^{K}\alpha_{t,k}=1. The forecast is then generated by a mechanism-conditioned predictor \hat{x}_{t+\Delta}=G(z_{t},\hat{\theta}_{t}). Our motivating hypothesis is that there are scientific forecasting

Read the complete text