Regime-Arrival Uncertainty in Generalization Bounds under Distribution Shift
Prince Poudel · 2026
Read Regime-Arrival Uncertainty in Generalization Bounds under Distribution Shift by Prince Poudel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02657.txt.
Introduction
Poudel studies learning bounds when the world switches between calm and crisis regimes. Standard generalization bounds assume train and test data match. Regime-switching environments break that assumption. The mix of calm and crisis states can differ at deployment. His framework quantifies the extra risk from that mismatch. Distribution shifts are modeled as Markov-switching.
An exact decomposition splits the risk. Regime mismatch separates from regime sensitivity. The bound extends to beta-mixing data with a spectral-gap correction. A minimax lower bound is shown on synthetic data and on 25 years of global equity indices. The penalty is an ex post realized gap. A training-only estimator shows no significant correlation with it. Crisis geometry can be detected in features. Crisis timing cannot. The framework, Poudel stresses, is not a forecast machine.
Catalog record
| CREATOR | Prince Poudel |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02657
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Regime-Arrival Uncertainty in Generalization Bounds under Distribution Shift Prince Poudel Abstract The standard generalization bounds assume that the training and deployment distributions are the same, or are static, and don’t consider regime switching environments where the ratio of calm vs crisis states is different. This paper proposes a framework that generalizes regime-aware models by quantifying the extra risk due to regime composition mismatch, when distribution shifts are Markov-switching. We obtain an exact decomposition, separating regime mismatch from regime sensitivity; we extend the bound to beta-mixing data using the effective sample size corrected for the spectral gap; and we show a minimax lower bound for synthetic data and on 25 years of global equity indices. The proposed penalty is an ex post realized generalization gap, whereas the training-only estimator does not show significant correlation: the feature geometry of crises can be detected, but not the temporal arrival. Thus, the framework is not a forecast machine. Forecasting the composition of the future regime is an open question in the rare cases of regime change. 1 Introduction A predictive model that performs well during the training period is often assumed to perform equally well after deployment. In practice, this assumption is frequently violated because the environment generating the data changes over time. Statistical learning theory traditionally studies generalization under the assumption that training and deployment data are generated from the same distribution ( 18 ; 5 ) . This assumption is mathematically convenient and works reasonably well in many classical settings. It becomes much harder to justify when the underlying system itself evolves through time. Many real-world applications operate in environments where structural change is unavoidable. Clinical risk models face changing patient populations because of disease cycles, evolving treatment practices, and changing hospital conditions. Intrusion detection systems operate in environments that alternate between normal behavior and active attacks. Autonomous systems must function across changing weather conditions, traffic patterns, and lighting environments. In these situations, the difference between training performance and deployment performance is often not simply the result of overfitting. Instead, it arises because the model is deployed under conditions that differ systematically from those observed during training ( 10 ; 14 ) . This paper develops a theoretical framework for studying this problem through latent regime dynamics. We model the environment as a two-state Markov process consisting of a calm regime and a crisis regime. The training distribution is represented as a mixture of regime-conditional distributions with composition parameter \pi , while the one-step-ahead deployment distribution depends on the transition probability p_{01} of entering the crisis regime. Whenever \pi\neq p_{01} , the composition of training and deployment environments differs. We show that this mismatch directly increases future deployment risk, with the magnitude determined by both the severity of the mismatch and the distinguishability of regimes under the hypothesis class. The analysis develops several theoretical results that together characterize how regime mismatch affects future deployment risk. We derive an exact decomposition connecting future risk directly to differences in regime composition (Lemma 4.1 ), establish a finite-sample high-probability upper bound on deployment risk (Theorem 4.13 ), and construct a matching minimax lower bound demonstrating that the mismatch penalty represents a fundamental limitation rather than an artifact of analysis (Theorem 4.15 ). Our approach combines ideas from domain adaptation, dependent learning theory, and regime-switching models ( 4 ; 20 ; 8 ) . The framework also introduces several features that distinguish it from existing approaches to distribution shift. Regime discrepancy is quantified using the \mathcal{H}\Delta\mathcal{H} -divergence ( 4 ) , which provides a tighter characterization than total variation distance and can be estimated from finite unlabeled samples through domain classification. The analysis is further developed under geometric \beta -mixing dependence, with explicit mixing coefficients derived from the transition structure using the blocking methodology of 20 . This naturally introduces an effective sample size n_{\mathrm{eff}} , which decreases as regime persistence increases. We also establish an irreducibility result showing that any valid certificate for future deployment risk must contain a regime mismatch penalty as an additive component, independent of the particular learning algorithm employed. Empirical validation on synthetic data confirms the theoretical structure. On real equity index data, we show that the penalty computed using the realized future crisis fraction tracks actual train-to-deployment gaps with Spearman \rho=0.729 . However, further analysis reveals that estimating the penalty before deployment is not reliable with standard training window lengths because it would require forecasting future regime composition. The framework thus provides a diagnostic tool for understanding deployment failures rather than a deployable forecasting system, and highlights the need for better forecasts of future regime composition as an open problem for future work. 2 Related Study 2.1 Domain adaptation and generalization under distribution shift The main issues in statistical learning theory for a long time is whether a model trained in one distribution will be effective in another. The influential work of 4 demonstrated that training performance and model complexity are not the only factors that influence target-domain risk; a distributional discrepancy term, quantified by the \mathcal{H}\Delta\mathcal{H} -divergence, also plays a role. One of the key benefits of this difference is that it can be estimated from a finite number of unlabeled samples, whereas total variation distance is hard to estimate directly in practice. Because the \mathcal{H}\Delta\mathcal{H} -divergence is upper bounded by total variation (Lemma 4.2 ), using the \mathcal{H}\Delta\mathcal{H} -divergence instead of total variation yields a tighter and more practical characterization of distribution shift. Current theory is largely based on static source and target distributions and independent sampling. However, our setting is different, as the distribution of the deployments changes dynamically via latent regime transitions. The work by 12 extended domain adaptation to multiple source distributions and emphasized the role of the mixture weights in controlling the adaptation performance. The same mixture structure occurs naturally in our framework due to the training observations P_{\mathrm{mix}}=(1-\pi)P_{0}+\pi P_{1} . The key difference is that the mixing proportion is not chosen by the learner but it is based on the historical regime dynamics and can vary from the future deployment composition. 2.2 Generalization under dependent data and mixing processes In most classical generalization theory, it is assumed that observations are independent. In serial dependence this assumption is not true as observations are not independent and the effective sample size is less than the nominal sample size. The extension of learning theory to dependent sequences was initiated by 20 who developed a blocking framework to get uniform convergence results for \beta -mixing dependent sequences. The idea is to divide the observations into nearly independent blocks and use the number of effective blocks as the sample size. We take this construction for granted and get explicit effective sample sizes as functions of the underlying Markov transition structure (Theorem 4.7 ). Mixing behavior for Markov chains has been studied extensively, including the work of 7 , who established exponential decay rates under standard ergodicity conditions. Under our assumptions, this produces mixing coefficients of the form \beta(k)\leq C_{\mu}|\lambda_{2}|^{k} , where \lambda_{2} denotes the non-unit eigenvalue of the transition matrix. We further build upon the learning-theoretic treatment of mixing processes developed by 13 , while explicitly retaining all mixing constants in the final bound so that the resulting