Stable and practical semi-Markov modelling of intermittently-observed data
Christopher Jackson · 2025
Read Stable and practical semi-Markov modelling of intermittently-observed data by Christopher Jackson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20949.txt.
Introduction
Christopher Jackson, writing alone in 2025, makes a flexible kind of disease progression model practical for the first time. Multi-state models track patients moving between health states, but the usual version assumes the risk of moving does not depend on how long a patient has sat in a state. Real illness often breaks that rule, and past fixes were narrow or lacked software.
Jackson's trick rewrites the waiting time in each state as a chain of hidden phases, which turns the model into a hidden Markov model that standard tools can fit. A moment-matching step keeps the chain short by mimicking simple waiting shapes such as the gamma or Weibull forms. The method ships in a new R package called msmbayes, which fits such models by Bayesian or likelihood methods. Tests by simulation check out, and a study of thinking decline shows the workflow.
Catalog record
| CREATOR | Christopher Jackson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-20949
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stable and practical semi-Markov modelling of intermittently-observed data Christopher Jackson Abstract Multi-state models are commonly used for intermittent observations of a state over time, but these are generally based on the Markov assumption, that transition rates are independent of the time spent in current and previous states. In a semi-Markov model, the rates can depend on the time spent in the current state, though available methods for this are either restricted to specific state structures or lack general software. This paper develops the approach of using a “phase-type" distribution for the sojourn time in a state, which expresses a semi-Markov model as a hidden Markov model, allowing the likelihood to be calculated easily for any state structure. While this approach involves a proliferation of latent parameters, identifiability can be improved by restricting the phase-type family to one with similar properties to a simpler distribution such as the Gamma or Weibull. This paper proposes a moment-matching method to obtain this family, making general semi-Markov models for intermittent data accessible in software for the first time. The method is implemented in a new R package, msmbayes , which implements Bayesian or maximum likelihood estimation for multi-state models with general state structures and covariates. The software is tested through simulation-based calibration, and an application to cognitive function decline illustrates the use of the method in a typical modelling workflow. 1 Introduction Many scientific analyses involve studying how a categorical variable changes over time. This can be done with a multi-state model , a continuous-time stochastic process on a finite set of states. In biomedical and other application areas, it is common that the state of an individual is only observed at a finite set of times, giving “intermittently-observed” or “panel” data. Unlike multistate models for conventional time-to-event data [ 23 ] , times of entry to and exit from states, and which transitions may have occured between observations, are unknown in general. Such data are generally modelled with Markov models, using the maximum likelihood method introduced by [ 16 ] and its various extensions. The msm R package [ 13 ] is widely used for this. See, e.g. [ 32 ] or [ 8 ] for broad reviews. In these models, it is particularly challenging to relax the Markov assumption, that is, to allow an individual’s transition rates to depend on the previous states they have visited and their transition times. This is inherently difficult with intermittent observations, since this history is only partially known. A related challenge of multi-state modelling of intermittent observations is the disconnection between the model parameters (transition rates in continuous time) and the observed data. This is because the pathway taken through the states between the observation times, and the times of the transitions on that pathway, are unknown in general, so it is hard to determine what parameters might be feasible to estimate from the data without attempting to fit the model. It is common (in my experience as the maintainer of the msm package) for users to fit over-parameterised models, where the parameters are weakly identifiable. This typically results in failure of the optimisation algorithm. Here we focus on semi-Markov models, in which transition rates depend on the time since entry to the current state. This time is unknown, since the time of entry is unknown. A range of approaches for semi-Markov modelling of panel data have been suggested for general transition structures. One general approach is based on integrating over the latent transition times [ 1 , 34 , 18 ] , though the computational cost of doing this increases substantially with the number of unobserved transitions. A nonparametric estimator was also devised by [ 12 ] , but only for transition structures without cycles. An alternative approach which avoids explicit integration, and allows any transition structure, is to iteratively simulate pathways consistent with the data, as part of a custom MCMC scheme [ 4 ] or a stochastic EM algorithm [ 2 ] , though software for this is not available. Another approach general to any structure, is the “phase-type” model proposed by [ 31 ] . As this uses standard maximum likelihood rather than a specialised fitting algorithm, it is more amenable to a software implementation. This approach replaces the exponentially-distributed sojourn in a state by a sequence of exponential sojourns in latent “phases”. This expresses a semi-Markov model as a hidden Markov model, which allows likelihoods to be evaluated easily. However it introduces many extra parameters, which can lead to poor identifiability, particularly for intermittent observations. To address this problem, [ 28 ] developed a method that uses the phase-type structure to approximate simpler time-to-event distributions, specifically the Weibull and Gamma, however the “variational optimization” used to determine the approximation relied on an intensive numerical search and ad-hoc choices of spline functions, and code was not published. This paper describes a new computational procedure that makes stable semi-Markov modelling of intermittent data, with general transition structures, accessible in general software for the first time. This uses phase-type families inspired by standard distributions, similar to [ 28 ] , but instead of using numerical optimization to obtain an approximating distribution family, a fast analytic procedure is used. This involves finding the unique phase-type distribution of a particular family whose first three moments agree with those of the Gamma or Weibull. The model from that paper is also extended here to include covariates. The method is implemented in a new R package, msmbayes , which also allows general multi-state models for intermittently-observed data to be fitted by either Bayesian estimation or maximum likelihood. An advantage of a Bayesian approach is that background information can be used to stabilise computation in the situation where maximum likelihood fails due to weak identifiability. Section 2 gives an overview of the current framework for multi-state modelling of intermittently-observed data. Section 3 describes phase-type semi-Markov models, their use to approximate simpler distributions, and the novel method introduced to implement this approximation. The computational methods and software are introduced in Section 4 . Section 5 presents a simulation-based calibration study to demonstrate that the software produces the correct posterior for a wide range of model classes. Section 6 demonstrates how the models might be used in a realistically-complex example based on a dataset measuring transitions between states of cognitive function and death. 2 Overview of multi-state models In a multi-state model, an individual moves between a set of states 1,\ldots,R in continuous time according to transition intensities (or rates) q_{rs}(t,\mathcal{F}_{t}) , defined as lim_{\delta t\rightarrow 0}\frac{P(S(t+\delta t)=s|S(t)=r,\mathcal{F}_{t})}{\delta t} where the state at time t since the beginning of the process is S(t) . If an individual cannot move to s immediately on exiting r , then q_{rs}=0 . The transition intensity matrix Q is defined to have (r,s) entry q_{rs} for r\neq s , and r th diagonal entry -\sum_{s\neq r}q_{rs} . \mathcal{F}_{t} represents the history of the process up to time t , that is, the states previously occupied by the individual and the times of transition between them. This paper is only concerned with Markov and semi-Markov models. In a Markov model, the transition rates are independent of the history \mathcal{F}_{t} . In a time-homogeneous Markov model, the