Improving Spatio-Temporal Residual Error Propagation by Mitigating Over-Squashing
Seyed Mohamad Moghadas, Esther Rodrigo Bonet, Bruno Cornelis, Adrian Munteanu · 2026
Read Improving Spatio-Temporal Residual Error Propagation by Mitigating Over-Squashing by Seyed Mohamad Moghadas, Esther Rodrigo Bonet, Bruno Cornelis, Adrian Munteanu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18068.txt.
Introduction
Seyed Mohamad Moghadas and three colleagues present TEGER, a residual covariance model keeping a traffic forecaster's joint uncertainty current at test time. A fixed sensor graph gives a spatial precision factor showing which sensors' errors move together. At inference, Gaussian adjustment corrects the next forecast's mean and covariance from the latest errors, while a moving-average term rescales marginal spread to track local drift. The updates leave the backbone untouched, so the same fix turns a frozen foundation model into one with fresh, linked risk at tiny added cost.
Catalog record
| CREATOR | Seyed Mohamad Moghadas, Esther Rodrigo Bonet, Bruno Cornelis, Adrian Munteanu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67402 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18068
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Spatio-Temporal Residual Error Propagation by Mitigating Over-Squashing Seyed Mohamad Moghadas, Esther Rodrigo Bonet, Bruno Cornelis, Adrian Munteanu Abstract Residual error propagation remains a fundamental problem in recurrent models, where small prediction inaccuracies compound over time and degrade long-horizon performance. Accurately modeling the correlation structure of such residuals is critical for reliable uncertainty quantification in probabilistic multivariate time-series forecasting. While recent time-series deep models efficiently parametrize time-varying contemporaneous correlations, they often assume temporal independence of errors and neglect spatial correlation across the observed network. In this paper, we introduce Teger, a structured uncertainty module that overcomes the spatial and temporal limitations of error-correlated autoregressive forecasting. Teger proposes a spatial curvature-aware graph rewiring mechanism explicitly strengthening information-bottleneck edges identified by discrete Forman curvature. The component is integrated into a low-rank-plus-diagonal covariance head, preserving tractable inference via the Woodbury identity. Teger is backbone-agnostic, requiring only the latent state produced by any autoregressive encoder. We provide theoretical evidence of Teger, and experimentally evaluate it on LSTM, Transformer, and xLSTM backbones across four real-world spatio-temporal datasets, showing consistent improvement in Continuous Ranked Probability Score (CRPS). We further provide a formal theoretical analysis connecting curvature-aware rewiring to (i) oversquashing alleviation, (ii) improved spectral connectivity, (iii) reduced effective resistance, and (iv) improved covariance calibration bounds. Repo 1 Introduction With the rapid development of Intelligent Transportation Systems (ITS), traffic forecasting has become a fundamental component of modern urban infrastructure. Accurate forecasting enables informed traffic management, congestion mitigation, and route planning 10 . Recent advances in deep learning have significantly improved the modeling of complex spatio-temporal dependencies in ITS, particularly through graph neural networks (GNNs). Yet, most approaches focus primarily on predicting point estimates 5 ; 21 ; 27 ; 28 ; 19 ; 20 ; 16 , while modeling uncertainty remains comparatively underexplored. In practice, empirical evidence reveals pronounced spatiotemporal covariance patterns in traffic residuals: predictions at one sensor can be strongly influenced by upstream and downstream conditions, leading to correlated residuals across the network (Figure 5(b) ). Despite this, existing methods rarely capture such structure. And even when covariance is modeled, it is typically restricted to the temporal dimension, thereby failing to fully capture their spatial interaction. For instance, TCVAR 29 explicitly models the temporal covariance, but does not extend this modeling across space. Beyond covariance structure, these models also struggle to explicitly capture volatility, leading to miss-calibrated uncertainty estimates 18 . On top, most methods are restricted to specific autoregressive backbones, limiting in flexibility and applicability. The inability to capture spatio-temporal covariance is intrinsically linked to the over-squashing phenomenon in GNNs, where long-range dependencies are excessively compressed into bounded representations, degrading information propagation across the traffic graph. In recent years, OQ has received increasing attention in the graph learning community 22 ; 1 , with works focusing on classical tasks such as node classification and edge prediction. Two families of remedies, both operating inside the message-passing layer of GNNs, are now well-established. Curvature-based rewiring , introduced by SDRF 22 and subsequently refined, identifies bottleneck edges through discrete Ricci-style curvature and adds or removes edges to relieve them. Alternatively, sequential structural rewiring , exemplified by LASER 3 , constructs a sequence of augmented graph snapshots that add long-range shortcuts while explicitly trading off connectivity, locality, and sparsity. 13 extends the notion to spatio-temporal networks and establishes a theoretical foundation. Counterintuitively, their analysis shows that convolutional spatiotemporal graph neural networks (STGNNs) favor information propagation from temporally distant nodes over closer ones. However, they do not formalize the effect of OQ mitigation on predictive performance, and neither their work nor prior work explores it in the context of dynamic graphs, to the best of our knowledge. However, we argue that spatio-temporal forecast errors do not occur in isolation: they propagate across the network’s dynamic structure following its underlying topology, and this propagation is both time-varying and influenced by latent system states (Fig. 5 ). Capturing this structure is, at heart, a covariance-modeling problem on a dynamic graph, and the same bottlenecks that distort message passing also distort the spatial covariance of residuals—concentrating dependence along thin chains and underestimating cross-region correlation. In this work, we address these gaps through a backbone-agnostic, parametric, probabilistic framework for spatio-temporal networks such as road graphs. We provide a theoretical analysis linking OQ alleviation to improved spectral connectivity and reduced effective resistance, and show how these properties lead to enhanced predictive performance by mitigating residual error propagation. We propose Teger , a backbone-agnostic probabilistic framework for spatio-temporal forecasting on dynamic graphs that places a curvature-aware spatial covariance inside a low-rank-plus-diagonal noise head. In contrast to LASER 3 , which adds edges via a sequence of augmented snapshots, and to SDRF 22 , which adds and removes edges based on Balanced Forman curvature, Teger keeps the input topology fixed and only reweights existing edges using the same Balanced Forman signal. This is, deliberately, a weaker structural intervention: it cannot create long-range pathways where none exist, but it preserves locality and sparsity by construction, sidesteps the connectivity-locality-sparsity trade-off that motivates LASER’s sequential design, and—most importantly for our setting—admits a closed-form low-rank projection that integrates cleanly into a Woodbury-style covariance update. The contribution of Teger is therefore a new curvature-aware reweighting algorithm and at the same time a probabilistic-forecasting counterpart to the existing OQ-mitigation literature. Our contributions are four-fold: (1) A dynamic low-rank-plus-diagonal covariance model for spatio-temporal residuals, capturing spatial dependence through graph-aware latent factors and temporal dependence through an autoregressive structure on the residual process. (2) A curvature-based spatial correlation mechanism modeling error diffusion on the dynamic graph, with state-aware dynamics and volatility adaptation. (3) A curvature-aware edge-reweighting step embedded inside the covariance head, together with a learnable low-rank projection that maps the rewired Laplacian into an R -dimensional factor space at \mathcal{O}(R^{3}) rather than \mathcal{O}(N^{3}) cost. To our knowledge, this is the first integration of curvature-based rewiring into a probabilistic spatio-temporal forecaster. (4) Integration of these components into a unified probabilistic autoregressive framework that preserves computational tractability while materially expanding the expressiveness of spatio-temporal uncertainty modeling. We are explicit about the scope of the OQ-mitigation claim: edge reweighting is a strictly weaker tool than the structural rewirings of LASER and SDRF, and it can relieve over-squashing only in regimes where bottleneck edges are present but underweighted—a regime we argue is well-matched to road-network forecasting, where the physical road graph is essentially fixed but edge importances vary in time. We discuss when this regime applies in Section 4.3 . The paper is structured as follows. Section 2 overviews the related work. Section 3 presents the proposed methodology and performance figures used to compare the proposed spatial curvature-aware graph reweighting mechanism against the state of the art. Section 4 reports and analyses the experimental results. Section 5 draws the conclusions. 2 Related Work Neural time-series forecasting. Traffic forecasting with deep learning is a rapidly developing research area 5 . While spatial (CNN-based) 21 ; 27 and recurrent (RNN-based 28 and LSTM-based models 19 ; 20 ) models have been proposed, we review transformer-based models due to their powerful ability in extracting spatio-temporal features and their effectiveness in few-shot learning scenarios. Inspired by the vanilla transformer mechanism introduced in 23 , PatchTST 16 highlights the importance of extracting