A Continuous-Time Markov Chain Framework for Population Size Estimation from Multi-List Data: Accounting for Absorbing Lists and Asymmetric Interactions

Ophélie Schaller, Andrew Titman, Rachel McCrea · 2026

Read A Continuous-Time Markov Chain Framework for Population Size Estimation from Multi-List Data: Accounting for Absorbing Lists and Asymmetric Interactions by Ophélie Schaller, Andrew Titman, Rachel McCrea (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21283.txt.

Introduction

Ophélie Schaller, Andrew Titman, and Rachel McCrea offer a continuous-time Markov chain framework for estimating population size from multi-list data. The framework allows directional interactions between lists and can handle absorbing lists, such as death records. When lists are independent, it matches the standard log-linear model, and the two give similar results even with dependencies. Simulations show that ignoring an absorbing list biases population estimates. The authors motivate the work with first-stroke cases in North-West England, where one list is a death record.

Catalog record

CREATOROphélie Schaller, Andrew Titman, Rachel McCrea
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59552
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21283

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Continuous-Time Markov Chain Framework for Population Size Estimation from Multi-List Data: Accounting for Absorbing Lists and Asymmetric Interactions Ophélie Schaller, Andrew Titman, Rachel McCrea Abstract 1 School of Mathematical Sciences, Lancaster University, United Kingdom ∗ Corresponding author: [email protected] Abstract We introduce a continuous-time Markov chain framework for estimating population size from multi-list data, which allows directional interactions to be modelled and can accommodate absorbing lists, such as death records, or more general data collection processes. The standard model of the continuous-time Markov chain framework and the log-linear model for multi-list data are equivalent when lists are independent and we show empirically that they give similar results in the presence of dependencies between lists. Through a simulation study, we highlight the need to account for an absorbing list by using the Markov model or the log-linear model with forced absorbing interactions, observing biased estimates of the population size otherwise. We motivate our approach with an epidemiological dataset concerning individuals suffering from a first ever stroke in North-West England, in which one of the lists is a death record. We illustrate a further use of our approach considering a case of ordered lists on drug use data from the City of London. Keywords : hidden population; multiple systems estimation; population size; continuous-time Markov chain; absorbing list. 1 Introduction Estimating the size of hard-to-reach populations is of high interest to inform public policy ( 5 ) . When multiple partial observations of a population are combined through a record linkage procedure, multiple systems estimation (MSE) or capture-recapture methods can be used to estimate the number of hidden individuals. While capture-recapture tends to be applied to wildlife populations, MSE has been used in epidemiology ( 13 ) , on populations of drug users ( 18 ; 10 ) , victims of modern slavery or human trafficking ( 1 ) , casualties in a war ( 3 ) or homeless individuals admitted to the hospital ( 20 ) . Both approaches originated from the same models, however the literature diverged to account for different data collection types. In an ecological context, the partial observations tend to be of the same nature, conducted repeatedly at precise points in time, originally in the form of captures, release, and recaptures. In this case, models have been developed for open populations to account for death, emigration and birth ( 16 ; 27 ; 9 ; 28 ) and to include temporal, behavioural or individual heterogeneity ( 24 ) . Note that in some situations human data takes a form similar to ecological data and can be analyzed using a capture-recapture analysis ( 6 ) . For a review of capture-recapture techniques, see for example 19 . Most often, within a social context, data sources are administrative lists from independent organisations collecting data in no known order over the same period of time. The resulting accessible dataset can be displayed in an incomplete 2^{k} contingency table with k being the number of lists, where each binary category represents whether individuals have been recorded on a corresponding list at some unknown point during the recording period. The value of one table cell is missing: individuals observed nowhere. Most often, a log-linear model is fitted to multi-list data ( 12 ) and values of the cells of the contingency table are assumed to result from a Poisson distribution ( 26 ) . When using this model, it is assumed that the target population is closed, that the probability of being recorded on a list is homogeneous over individuals, that individuals are perfectly matched between lists and that there is no highest order interaction between lists. In their review of applications of MSE in epidemiology, 13 state the closure assumption as one of its main limitations. 29 encouraged further development of MSE through a comparison with ecological capture-recapture methods, highlighting the necessity to model open populations as one of the main areas of MSE which could be improved. To our knowledge, open population models have not yet been proposed within the MSE context and the primary reason for this is the lack of temporal information in the data. In some cases, the target population is known to be at least partially open, which clearly violates the closure assumption. This is the case when one of the lists is absorbing, i.e. the list records individuals as they leave the population, such as an emigration or death record. We will show in Section 3 that in that case not accounting for an absorbing list will lead to an overestimation of the total population size. Additionally, this situation does not respect the homogeneity assumption, as not all individuals stay observable for the same amount of time. Death records are for example frequent in epidemiological applications (e.g., 14 ; 4 ; 10 ). Motivated in particular by a dataset on individuals suffering from their first ever stroke from 14 , which we introduce below, we propose a new framework for MSE. Even though we only have access to data at one point in time, we model the continuous process of the collection of data using Markov chains. This allows us to take into account the particular nature of absorbing lists, as well as to more generally model effects in the collection of data. We give an additional example on data on drug use in the City of London where some of the lists are ordered over time. In Section 2 , we describe the continuous-time Markov chain model for multi-list data, demonstrating how the framework can be used to account for an absorbing list and its adaptability to other scenarios. In Section 3 , we present a simulation study comparing estimates obtained between the proposed Markov model and the standard log-linear model on multi-list data, both in a general case and in the presence of an absorbing list. In Section 4 , we present results of our analysis on the datasets introduced below. Finally, we discuss results and further research avenues for this new Markov framework in Section 5 . First ever stroke in Northwest England 1994-1995 Our main motivating dataset concerns individuals suffering from their first ever stroke in Northwest England between July 1994 and June 1995 ( 11 ) and is displayed in Table 1 . This particular example has been cross-classified from five lists: general practice reports; hospital records; death registers; other groups such as rehabilitation services, nursing homes and support services. 11 only take into consideration cases recorded in at least one of those lists to estimate the total number of strokes in the designated practices. In 14 , the data is used for an internal validity study where a MSE log-linear model is used on a subset of those lists and compared with the known value. This analysis does not consider the absorbing properties of the death list, which as we will show in Section 3 , could lead to an underestimation of the population size. L_{1} L_{2} L_{3} L_{4} L_{5} counts 0 0 0 0 0 ? 1 0 0 0 0 158 0 1 0 0 0 68 0 0 1 0 0 65 0 0 0 1 0 25 0 0 0 0 1 15 1 1 0

Read the complete text