End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systems

Carles Balsells-Rodas, Zhengrui Xiang, Xavier Sumba, Yingzhen Li · 2026

Read End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systems by Carles Balsells-Rodas, Zhengrui Xiang, Xavier Sumba, Yingzhen Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06315.txt.

Introduction

Carles Balsells-Rodas and three co-authors learn recurrent switching dynamical systems whose latent structure is provably identifiable. Ordered data often switch between regimes, and deep generative models can recover that hidden structure only under narrow assumptions like stationarity. VAE estimators add approximation gaps that further blur what the latents mean. That weakening hits both science and forecasting built on them, the authors argue. Their work attacks the theory and the estimator together.

First they prove identifiability for a broad class of such switching systems under flexible conditions. Then they introduce a flow based estimator that optimizes exact likelihood through expectation maximization, avoiding the VAE gap. On synthetic and real data it separated latent factors better than VAE rivals. Forecasts of the hidden dynamics also came out more accurate.

Catalog record

CREATORCarles Balsells-Rodas, Zhengrui Xiang, Xavier Sumba, Yingzhen Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE125 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06315

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systems Carles Balsells-Rodas, Zhengrui Xiang, Xavier Sumba, Yingzhen Li Abstract Learning identifiable representations in deep generative models remains a fundamental challenge, particularly for sequential data with regime-switching dynamics. Existing approaches establish identifiability under restrictive assumptions, such as stationarity or limited emission models, and typically rely on variational autoencoder (VAE) estimators, which introduce approximation gaps that limit the recovery of the latent structure. In this work, we address both the theoretical and practical limitations of this setting. First, we establish identifiability of a broad class of recurrent nonlinear switching dynamical systems under flexible assumptions, significantly extending prior results. Second, we introduce Ω \Omega SDS, a flow-based estimator that enables exact likelihood optimization using expectation-maximisation. Through empirical validation on both synthetic and real-world data, our results demonstrate that Ω \Omega SDS achieves improved disentanglement compared to VAE-based estimators and more accurate forecasting of underlying dynamics. 1 Introduction Many real-world time series exhibit nonstationary dynamics, where the underlying temporal mechanisms change over time. Examples include seasonal patterns in climate data ( 37 ) , or behavioural modes in human motion ( 41 ) . Regime-switching state-space models, including switching dynamical systems (SDSs; ( 17 ) ) and Markov switching models (MSMs; ( 31 ; 35 ) ), target these scenarios by introducing discrete regimes (or switches) which explicitly model dynamical changes. Recent sequential latent variable models incorporate regime-switching as structured priors ( 30 ; 11 ; 2 ; 32 ; 16 ) , improving flexibility while preserving interpretable continuous states and discrete switches. Interpretability of deep generative models relies on identifiability, which ensures that the data distribution determines the latent structure up to acceptable equivalences, such as permutations of switches or latent variables. Without identifiability, observationally equivalent model solutions may represent contradictory latent dynamics, and therefore interpretability may reflect arbitrary parametrisations rather than the underlying data-generating mechanisms. For flexible nonlinear latent variable models, identifiability fails without additional structure ( 23 ) . Existing results impose such structures either on the latent distribution, for example through auxiliary variables or temporal dependence ( 25 ; 19 ; 29 ; 34 ; 45 ) , or the emission map ( 28 ) . Switching dynamical systems introduce additional complexity, since the latent prior is a mixture over regime-dependent dynamics. Existing SDS identifiability results reflect this “no free lunch” principle between restricting emissions or latent dynamics: piece-wise linear emissions allow flexible nonlinear mixture transitions ( 4 ) , while general invertible emissions require more restrictive latent dynamics, such as stationary linear transitions ( 20 ) . In this work, we push the above trade-off by establishing identifiability and estimation for recurrent switching dynamical systems (rSDS) with nonlinear transition dynamics and invertible emissions. • We show that (i) temporal latents are identifiable up to affine transformations, (ii) recurrent Markov switching dynamics are identifiable up to regime permutations, and (iii) regime-dependent covariances reduce affine ambiguity to permutation and scaling. These results provide an end-to-end identifiability framework for recurrent deep SDSs. • Motivated by the theory, we propose \Omega SDS, a likelihood-based estimator that extracts temporal features using a flow-based emission and learns prior dynamics using expectation-maximisation. Unlike VAE-based estimators, \Omega SDS optimises the exact likelihood, yielding consistency up to the identifiable equivalence class under standard MLE conditions for recurrent MSMs. • Empirically, exact likelihood improves latent disentanglement on synthetic data, while recurrent switches support interpretable dynamics and strong forecasting performance on controlled physical systems and real-world dancing videos. Related work SDSs are flexible models, but inference is generally challenging due to the interaction between continuous and discrete states ( 17 ) . Recent works develop inference for switching linear dynamical systems ( 30 ) , Gumbel-softmax relaxations ( 5 ) , and infinite switching processes ( 16 ) . Current nonlinear SDSs are mostly trained with variational objectives, including collapsed-switching inference ( 11 ) , recurrent explicit-duration models ( 2 ) , and graph-based switching dynamics ( 32 ) . Flow-based likelihood estimation remains less explored ( 9 ) . Identifiability for regime-switching latent variable models builds on nonlinear ICA and finite-mixture theory ( 25 ; 44 ; 1 ) . HMM-ICA uses finite-state HMM identifiability to establish nonlinear ICA ( 15 ; 19 ) , while SNICA proves disentanglement under stationary temporal dependencies without identifying the mixture components ( 20 ) . Identifying latent transitions is harder, as temporal dependencies prevent a direct extension of 1 . Recently, classical finite mixture model results ( 44 ) have been extended to non-recurrent MSMs, yielding identifiability under Gaussian observations ( 39 ) and piecewise linear emissions ( 4 ) . Alternatively, 38 establishes results by assuming knowledge of the number of states K and observation-dependent regimes. Related causal-discovery methods allow recurrent switching but identify graph structures 3 rather than the switching process. Table 1 summarises these distinctions. Table 1 : Comparison with identifiable regime-switching latent variable models. Full ident. excludes identifying K and denotes recovery of the latent representation, transitions, and switching process. Method Emission Switching Nonlin. dyn. Identifies K Full ident. Exact LL HMM-ICA ( 19 ) Bijective Autonomous ✗ ✗ ✗ ✓ SNICA ( 20 ) Invertible Autonomous ✗ ✗ ✗ ✗ NCTRL ( 39 ) Gaussian / obs. Autonomous ✓ ✓ ✓ ✗ iSDS ( 4 ) PWL Autonomous ✓ ✓ ✓ ✗ CtrlNS ( 38 ) Invertible Obs. dependant ✓ ✗ ✓ ✗ SDCI ( 3 ) N/A Recurrent ✓ ✓ ✗ N/A \Omega SDS (ours) Invertible Recurrent ✓ ✓ ✓ ✓ 2 Recurrent Switching Dynamical Systems A recurrent Switching Dynamical System (rSDS), exemplified in Figure 1 , models sequential data by introducing continuous latent states \bm{z}_{1:T} and discrete switching variables \bm{s}_{1:T} . At each time step t , the observation \bm{x}_{t}\in\mathbb{R}^{n} is generated through a (noisy) transformation of the continuous latent variable \bm{z}_{t}\in\mathbb{R}^{m} . While recent nonlinear SDS approaches use additive-noise emissions ( 11 ; 2 ) , we assume a flow-based emission similarly used in 40 : Assumption A1 (Emission model) . Observations \bm{x}_{t}\in\mathbb{R}^{n} are generated via an invertible transformation f_{\bm{\theta}_{f}} of latent variables \bm{z}_{t}\in\mathbb{R}^{m} and i.i.d. noise \bm{\varepsilon}_{t}\in\mathbb{R}^{d} , with d=n-m . \bm{x}_{t}=f_{\bm{\theta}_{f}}(\bm{z}_{t},\bm{\varepsilon}_{t}),\quad\bm{\varepsilon}_{t}\sim\mathcal{N}(0,\sigma_{\bm{\varepsilon}}^{2}I_{d}). (1) Figure 1 : The considered rSDS model. Observations are generated through an invertible mapping of recurrent switching features and exogenous noises. The latent dynamics \bm{z}_{1:T} follow a recurrent Markov Switching Model (rMSM) ( 12 ) . Therefore at time t , the discrete switch s_{t}\in\{1,\dots,K\} determines the transition dynamics of \bm{z}_{t} , while the switching process receives feedback from past latent variables \bm{z}_{t-1} . Under first-order Markov assumptions, the joint distribution of (\bm{z}_{1:T},\bm{s}_{1:T}) factorises as follows: p_{\bm{\theta}_{\bm{z}},\bm{\theta}_{\bm{s}}}(\bm{z}_{1:T},\bm{s}_{1:T})=p_{\bm{\theta}_{\bm{s}}}(s_{1})p_{\bm{\theta}_{\bm{z}}}(\bm{z}_{1}|s_{1})\\ \prod_{t=2}^{T}p_{\bm{\theta}_{\bm{z}}}(\bm{z}_{t}\mid\bm{z}_{t-1},s_{t})p_{\bm{\theta}_{\bm{s}}}(s_{t}\mid s_{t-1},\bm{z}_{t-1}). (2) We make the following assumption on the latent transition dynamics p_{\bm{\theta}_{\bm{z}}}(\bm{z}_{t}\mid\bm{z}_{t-1},s_{t}) . Assumption A2 (Analytic Gaussian autoregressive dynamics) . The latent variables \bm{z}_{t}\in\mathbb{R}^{m} follow a regime-dependent Gaussian autoregressive process: \bm{z}_{t}\mid s_{t},\bm{z}_{t-1}\sim\mathcal{N}\Big(\bm{z}_{t}\mid\bm{m}_{s_{t}}(\bm{z}_{t-1}),\Sigma_{s_{t}}\Big),\quad\Sigma_{s_{t}}=\mathrm{diag}(\bm{\sigma}^{2}_{s_{t}}) where each mean function \bm{m}_{k}:\mathbb{R}^{m}\to\mathbb{R}^{m} is analytic, each covariance \Sigma_{k}\succ 0 is diagonal with \bm{\sigma}^{2}_{k} denoting the diagonal, and both means \bm{m}_{k} and/or covariances \Sigma_{k} are distinct across regimes. This assumption is in the same format as in 4 , where results are established for non-recurrent-switching, i.e., p_{\bm{\theta}_{\bm{s}}}(s_{t}\mid s_{t-1},\bm{z}_{t-1})=p_{\bm{\theta}_{\bm{s}}}(s_{t}\mid s_{t-1}) . In contrast, we consider a common recurrent formulation in rSDS ( 30 ; 11 ; 2 ) to increase the

Read the complete text