Inspectable Neural Markov Models for Non-Stationary Time Series

Jan Rovirosa   Jesse Schmolze · 2026

Read Inspectable Neural Markov Models for Non-Stationary Time Series by Jan Rovirosa   Jesse Schmolze (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30943.txt.

Introduction

Rovirosa and Schmolze build clear neural Markov models for non-stationary time series. Frequency estimates for transition matrices collapse at high resolution, where data grow sparse. Their hybrid approach lets a neural network parameterize the space of stochastic tables, allowing changing chains to be estimated from sparse data. Using financial markets as a testbed, they find conditioning on volatility gives a more consistent Markov structure than return-based states. Unlike black-box sequence models, their method yields explicit tables open to geometric study.

Catalog record

CREATORJan Rovirosa   Jesse Schmolze
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36175
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30943

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inspectable Neural Markov Models for Non-Stationary Time Series Jan Rovirosa Jesse Schmolze Abstract Abstract Modeling non-stationary stochastic systems requires balancing the representational capacity of deep learning with the structural transparency of classical probabilistic models. Markov transition matrices provide such a framework, but traditional frequency-based estimation collapses at high resolutions due to data sparsity. We propose a hybrid approach that parameterizes the manifold of stochastic matrices through a neural network, enabling estimation of time-inhomogeneous Markov chains in sparse-data regimes, and use financial markets as a testbed to investigate the Markov state variable as a critical inductive bias. We show that conditioning on realized volatility produces a more internally consistent Markovian structure than return-based states, achieving a 5.6\% reduction in Chapman-Kolmogorov discrepancy and superior held-out likelihood in 9 of 10 assets. Unlike black-box sequence models, our approach generates explicit matrices amenable to direct geometric analysis, surfacing structural findings such as the universal homogenization of transition probabilities under high-volatility regimes. 1 Introduction The rise of deep generative modeling has provided unprecedented predictive power, yet these models often operate as “black boxes”, lacking the structural constraints necessary for rigorous analysis in high-stakes domains. In contrast, classical Markov transition matrices provide a transparent, structured framework where system evolution is represented as an explicit stochastic law. However, these matrices are notoriously difficult to estimate in high-dimensional or sparse data regimes. Discretizing a continuous process into n states creates n^{2} possible transitions; at high resolutions, empirical frequency-based estimators collapse into sparse, unreliable matrices. We propose a hybrid framework that integrates deep learning with classical Markovian structure, yielding explicit transition matrices that expose the model’s internal logic. By replacing traditional frequency-based counting with neural parameterization, we maintain structural transparency without sacrificing the representational power of deep neural networks. We treat the transition matrix as a function of observable features, using a neural network to map the current context to the manifold of valid stochastic matrices. This approach allows the model to “fill in” the gaps of the state space by learning the underlying functional form of the transitions. For portfolio managers holding k assets, this provides a granular k\times N matrix (where N is the number of bins) of transition probabilities across the portfolio, offering a direct view of the predictive distribution which can be key for risk management and asset allocation. A critical design choice in this structured framework is the definition of the Markov state. We demonstrate that the mathematical consistency of the model depends heavily on this choice. While returns are a common state variable, they are often serially uncorrelated. We show that conditioning the framework on realized volatility produces a more internally consistent Markovian structure. Specifically, the volatility-state model achieves a significant reduction in Chapman-Kolmogorov discrepancy, suggesting that it better satisfies the structural assumptions of the Markov property than traditional return-based approaches. Contributions. • We develop a hybrid generative framework that integrates the flexibility of deep neural networks with the structural constraints of time-inhomogeneous Markov chains. By parameterizing the manifold of stochastic matrices directly, we maintain high-dimensional representational power while enabling the use of rigorous, interpretable diagnostics that are typically unavailable in black-box sequence models. • We demonstrate that the choice of state variable acts as a critical inductive bias within this structured framework. Specifically, we show that conditioning on realized volatility rather than returns results in a more internally consistent Markovian structure, evidenced by a \sim 5.6\% lower average Chapman-Kolmogorov discrepancy (Section 5.2 ). • We validate our framework on a 24-year sample of ten US bank stocks, showing that the volatility-state model achieves superior held-out likelihood in 9 of 10 assets and uncovers universal structural insights (such as the homogenization of transition probabilities during high-volatility regimes) directly from the model’s internal geometry. 2 Related Work Markov Modeling in Finance. Markov transition matrices have a long history as transparent models for regime shifts in economic systems. 7 demonstrated that non-stationary macroeconomic dynamics can be captured through regime-dependent evolution governed by a discrete-state Markov law. In financial settings, 9 applied these tools to credit rating migrations, while 11 used time-inhomogeneous chains to model exchange rate volatility. While our work shares this motivation, it departs from classical approaches by replacing frequency-based estimation (counting) with neural parameterization. This allows the model to remain robust in high-resolution settings where empirical counts typically collapse due to data sparsity. Neural Time-Series Forecasting. From an estimation perspective, our task is a conditional density estimation problem. Early neural approaches used Mixture Density Networks (MDNs) ( 3 ) to parameterize output distributions. Modern architectures like DeepAR 12 and other neural sequence models 10 have become the standard for probabilistic forecasting. However, these models are structurally different from our approach: they typically represent dynamics through latent recurrent states or parameters at the observation level. They do not produce an explicit stochastic matrix on a fixed state space, meaning they cannot be subjected to the classical Markovian diagnostics (like entropy or consistency checks) that we utilize here. Operator-First Models. Our framework is a “Deep Markov” ( 8 ) extension that bridges classical theory with deep learning. A key precursor is the Input-Output HMM 2 , which conditions latent-state transitions on observed sequences. Our approach differs because our state variable is an explicit discretization of an observed process (returns or volatility) rather than a latent one. Our primary object of study is the transition matrix itself. This “operator-first” perspective is compatible with the views expressed in distributional reinforcement learning 1 , which treats probability distributions as primary objects. By using a network to parameterize the manifold of stochastic matrices, we maintain structural rigor while gaining the representational power of deep learning. 3 Framework 3.1 State Space and Discretization Let \{P_{t}\}_{t\geq 0} denote daily prices and define the log-return as r_{t}:=\log P_{t}-\log P_{t-1} . To analyze the system’s dynamics, we map these continuous values into a discrete state space \mathcal{S}=\{s_{1},\ldots,s_{n}\} using quantile-based bins calculated from the training data. The primary design choice is the state variable X_{t}\in\mathcal{S} . We compare two approaches: • Return-state: X_{t}=\varphi(r_{t}) . This defines the state based on the asset’s immediate performance (the return). • Volatility-state: X_{t}=\varphi(\sigma_{t}) , where \sigma_{t} is a rolling estimate of realized volatility. This defines the state based on the current level of market uncertainty. We use a high resolution ( N=35,45,55 bins) to capture the nuances of the distributions. However, this creates a major sparsity problem: there are n^{2}=3,025 possible state-to-state transitions. In our dataset, over 99\% of these potential transitions have fewer than five observations in the training set, making traditional counting methods unreliable. We resolve this using the neural parameterization described below. 3.2 Feature-Conditioned Transition Matrices Let \mathbf{F}_{t}\in\mathbb{R}^{d} be a vector of observable features available at time t (e.g., macro indicators and lagged returns). We model the system as a time-inhomogeneous Markov chain where the transition laws change based on \mathbf{F}_{t} . For a prediction horizon h\geq 1 , the transition matrix A_{t}^{(h)} is an n\times n stochastic matrix: A_{t}^{(h)}(i,j):=P(X_{t+h}=s_{j}\mid X_{t}=s_{i},\mathbf{F}_{t}). (1) Each row of this matrix is a valid probability distribution. Because these matrices share a consistent state space \mathcal{S} , we can compose them over time to check for mathematical consistency. 3.3 Neural Parameterization (Deep Markov Construction) To overcome data sparsity, we use

Read the complete text