Learning to Defer in Non-Stationary Time Series via Switching State-Space Models

Yannis Montreuil, Letian Yu, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi · 2026

Read Learning to Defer in Non-Stationary Time Series via Switching State-Space Models by Yannis Montreuil, Letian Yu, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22538.txt.

Introduction

Yannis Montreuil and four co-authors study when a forecaster should hand a call to a human expert as conditions drift. Their 2026 preprint works on non-stationary time series, where the pattern shifts over time. Feedback is partial: the router sees only the picked expert's call, and the pool of experts changes.

They model signed expert errors with a switching state-space model. That model tracks who is hot as regimes change. Smart hand-offs can lift accuracy while saving expert time. The work fits streams like energy, health, and finance. That saving can be large at scale.

Catalog record

CREATORYannis Montreuil, Letian Yu, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE101 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22538

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning to Defer in Non-Stationary Time Series via Switching State-Space Models Yannis Montreuil, Letian Yu, Axel Carlier, Lai Xing Ng, Wei Tsang Ooi Abstract We study Learning to Defer for non-stationary time series with partial feedback and time-varying expert availability. At each time step, the router selects an available expert, observes the target, and sees only the queried expert’s prediction. We model signed expert residuals using L2D-SLDS, a factorized switching linear-Gaussian state-space model with context-dependent regime transitions, a shared global factor enabling cross-expert information transfer, and per-expert idiosyncratic states. The model supports expert entry and pruning via a dynamic registry. Using one-step-ahead predictive beliefs, we propose an IDS-inspired routing rule that trades off predicted cost against information gained about the latent regime and shared factor. Experiments show improvements over contextual-bandit baselines and a no-shared-factor ablation. 1 Introduction Learning-to-defer (L2D) studies decision systems that route each query to one of several experts and incur expert-dependent consultation costs ( Madras et al. 2018 ; Mozannar & Sontag 2020 ; Narasimhan et al. 2022 ; Mao et al. 2023 ; Montreuil et al. 2025a ) . Most L2D work is offline: a router is trained on a fixed dataset (often under i.i.d. assumptions) using supervision that is typically unavailable online, such as access to all experts’ predictions or losses for the same input. In sequential settings, decisions and observations are interleaved over time, making the offline assumptions above unrealistic. Such regimes arise, for instance, in streaming forecasting or triage pipelines where one must route each incoming instance to a single expert under limited and time-varying capacity. At round t , the router observes a context \mathbf{x}_{t} and the currently available expert set \mathcal{E}_{t} , selects I_{t}\in\mathcal{E}_{t} , and then observes the outcome \mathbf{y}_{t} along with the queried prediction \widehat{\mathbf{y}}_{t,I_{t}} . Feedback is partial : predictions from j\neq I_{t} are never revealed. The process is typically non-i.i.d. and often non-stationary ( Hamilton 2020 ; Sezer et al. 2020 ) , so expert quality and cross-expert dependencies may drift or switch across regimes. In addition, \mathcal{E}_{t} itself can evolve as experts arrive, depart, or become temporarily unavailable, and querying can consume scarce resources subject to operational constraints. Altogether, partial feedback, distribution shift, and a time-varying expert pool render standard offline L2D formulations inadequate and motivate online methods that explicitly track uncertainty over time. To address these challenges, we develop a probabilistic routing framework for non-stationary time series under partial feedback and a dynamic expert pool. We model expert residuals with a switching linear-Gaussian state-space ( Ghahramani & Hinton 2000 ; Linderman et al. 2016 ; Hu et al. 2024 ) model that couples a shared global factor with expert-specific idiosyncratic states and a discrete regime process, enabling time-varying cross-expert dependence. Faithful to practical settings, we support adding or removing experts without affecting the maintained marginals of retained experts. We also propose an information-directed sampling (IDS)-inspired exploration rule ( Russo & Van Roy 2014 ) that trades off predicted cost against information gained about the latent regime and shared factor. Contributions. Our main contributions are: • We formalize online expert routing for non-stationary time series with bandit feedback and time-varying expert availability (Section 4.1 ). • We propose L2D-SLDS , a factorized switching linear-Gaussian state-space model for expert residuals with context-dependent regime transitions, a shared global factor enabling cross-expert information transfer, and per-expert idiosyncratic dynamics (Section 4.2 ). • We derive an efficient Interacting Multiple Model (IMM)-style ( Johnston & Krishnamurthy 2002 ) filtering recursion under censoring together with dynamic registry management for expert entry and pruning; we show pruning leaves retained marginals unchanged (Sections 4.2 and 4.2.4 ; Proposition 3 ). • We introduce an IDS-inspired routing rule ( Russo & Van Roy 2014 ) that trades off predicted cost against mutual information about the latent regime and shared factor, with a closed-form shared-factor term and a lightweight Monte Carlo mode-identification term (Section 4.2.3 ; Appendix E ). • We empirically evaluate on a synthetic correlated-regime simulator and on Temperature in Melbourne ( Brabban 2023 ) (plus FRED DGS10 in the appendix), comparing against contextual bandit baselines and a no-shared-factor ablation (Section 5 ; Appendix G ). 2 Related Work L2D extends selective prediction ( Chow 1970 ; Bartlett & Wegkamp 2008 ; Cortes et al. 2016 ; Geifman & El-Yaniv 2017 ; Cao et al. 2022 ; Cortes et al. 2024 ) by allowing a learner to defer uncertain inputs to external experts ( Madras et al. 2018 ; Mozannar & Sontag 2020 ; Verma et al. 2022 ) . An important line of work develops surrogate losses and statistical guarantees ( Mozannar & Sontag 2020 ; Verma et al. 2022 ; Cao et al. 2024 ; Mozannar et al. 2023 ; Mao et al. 2024b ; Mao et al. 2025 ; Charusaie et al. 2022 ; Mao et al. 2024a ; Wei et al. 2024 ) . L2D has also been extended to regression and multi-task settings and applied in real systems ( Mao et al. 2024c ; Strong et al. 2024 ; Palomba et al. 2025 ; Montreuil et al. 2025b ; Montreuil et al. 2025c ) . Missing expert predictions have been studied in offline/batch learning ( Nguyen et al. 2025 ) . Sequential L2D has been studied in a different setting: Joshi et al. 2021 formulate deferral in a non-stationary MDP and learn a pre-emptive deferral policy by comparing the long-term value of deferring now versus delaying deferral. In contrast, we study time-series expert routing where the router selects among available experts online under partial (bandit-style) feedback, with potentially non-stationary data and a time-varying expert pool. This setting is also related to contextual bandits under partial feedback ( Li et al. 2010 ; Neu et al. 2010 ) . Our focus differs from standard bandit formulations in that we use a latent-state time-series model to exploit cross-expert dependence : observing one residual updates predictive beliefs for unqueried experts through a shared factor. To the best of our knowledge, our work is the first that addresses bandit feedback, latent-state non-stationarity, input dependency, and a dynamic expert registry. 3 Background 3.1 Offline Learning-to-Defer We briefly recall the standard offline learning-to-defer (L2D) setup ( Madras et al. 2018 ; Mozannar & Sontag 2020 ; Narasimhan et al. 2022 ; Mao et al. 2024c ) . In its simplest form, one observes i.i.d. samples (\mathbf{x},\mathbf{y})\sim\mathcal{D} , where \mathbf{x}\in\mathcal{X}\subseteq\mathbb{R}^{d} and \mathbf{y}\in\mathcal{Y}\subseteq\mathbb{R}^{d_{y}} . There is a fixed registry \mathcal{K}=\{1,\dots,K\} of experts (or predictors), each providing a prediction \widehat{\mathbf{y}}_{k}(\mathbf{x})\in\mathcal{Y} when queried. Given a per-expert consultation fee \beta_{k}\geq 0 and a loss on the prediction error \psi:\mathbb{R}^{d_{y}}\to\mathbb{R}_{\geq 0} , the incurred cost of routing (\mathbf{x},\mathbf{y}) to expert k is C_{k}(\mathbf{x},\mathbf{y})\coloneqq\psi\big(\widehat{\mathbf{y}}_{k}(\mathbf{x})-\mathbf{y}\big)+\beta_{k}. (1) A router is a policy \pi:\mathcal{X}\to\Delta^{K-1} mapping each input to a distribution over experts. Its population objective is the expected routing cost \mathcal{R}(\pi)\coloneqq\mathbb{E}_{(\mathbf{x},\mathbf{y})\sim\mathcal{D}}\left[\sum_{k=1}^{K}\pi(k\mid\mathbf{x})\,C_{k}(\mathbf{x},\mathbf{y})\right]. (2) Conditioned on \mathbf{x} , the Bayes-optimal deterministic router selects k^{\star}(\mathbf{x})\in\arg\min_{k\in\mathcal{K}}\ \mathbb{E}\left[C_{k}(\mathbf{x},\mathbf{y})\mid\mathbf{x}\right]. (3) If the router selects expert I\in\mathcal{K} on input \mathbf{x} with outcome \mathbf{y} , the incurred cost is C_{I}(\mathbf{x},\mathbf{y}) . Thus, conditioned on \mathbf{x} , the Bayes-optimal deterministic router chooses the expert with the smallest conditional expected cost, as in ( 3 ). Most prior works learn \pi from a fixed dataset

Read the complete text