Dynamic Prediction of Alternating Recurrent Events via Neural Network Volume: 16
Abigail Loe 1,∗, Susan Murray 2, and Zhenke Wu 2 1 Department of Mathematics, Statistics and Computer Science, Macalester College, Saint Paul, Minnesota, U.S.A. 2 Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, U.S.A · 2026
Read Dynamic Prediction of Alternating Recurrent Events via Neural Network Volume: 16 by Abigail Loe 1,∗, Susan Murray 2, and Zhenke Wu 2 1 Department of Mathematics, Statistics and Computer Science, Macalester College, Saint Paul, Minnesota, U.S.A. 2 Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, U.S.A (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30889.txt.
Introduction
Abigail Loe, Susan Murray and Zhenke Wu build a predictor for events that alternate with a forced pause. An alternating recurrent event, such as a hospital admission, triggers a refractory period, such as the hospital stay itself, during which the event cannot recur. Predicting the next event-free stretch is statistically delicate: observations are correlated, outcomes repeat, and follow-up can be cut short. The trio combine neural network methods, presented for a statistics audience, with weighted pseudo-observations to update predictions as new information arrives.
Simulations showed good performance. The real application predicted periods of low mood in first-year medical residents, alternating with baseline mood, and performed very well there. The framework suits any field, from health to criminal justice, where episodes and gaps both matter.
Catalog record
| CREATOR | Abigail Loe 1,∗, Susan Murray 2, and Zhenke Wu 2 1 Department of Mathematics, Statistics and Computer Science, Macalester College, Saint Paul, Minnesota, U.S.A. 2 Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, U.S.A |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30889
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Prediction of Alternating Recurrent Events via Neural Network Volume: 16 Abigail Loe 1,∗, Susan Murray 2, and Zhenke Wu 2 1 Department of Mathematics, Statistics and Computer Science, Macalester College, Saint Paul, Minnesota, U.S.A. 2 Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, U.S.A Abstract Alternating recurrent events– event-times of a specific nature that trigger a secondary refractory period – occur in a wide-range of fields, including behavioral science, criminal justice, and biostatistics. Analysis of these events requires careful attention to the statistical nuance, including correlated observations and repeated outcomes subject to potential censoring. We develop an online dynamic prediction framework appropriate for predicting subsequent alternating recurrent events, by developing neural network theory for a statistical audiences and applying inverse probability weighted pseudo-observations. The proposed model is applied to dynamically predict alternating recurrent event-free time, showing good performance in simulation, and outstanding capability in application to predicting periods of low mood for first-year medical residents. We close with a discussion. \pagerange Dynamic Prediction of Alternating Recurrent Events via Neural Network – References \artmonth October keywords Alternating recurrent events; Censored data; Dynamic prediction; Inverse probability weighting; Neural networks; Pseudo-observations. 1 Introduction Alternating recurrent events are common outcomes in biomedical, sociological, political and behavioral disciplines. For example, periods of hospitalization alternate with periods of discharge. Broadly, an alternating recurrent event may be defined as a time-to-event outcome of interest (or primary event ), which immediately triggers a refractory period (or secondary event ), wherein an individual is not at-risk for the primary event. Examples may include hospitalization and discharge times as in 15 , periods of depressive mood and baseline mood as in 19 , or recurrent dengue infections, as in 31 . Accurate and well-calibrated predictions of the next primary alternating recurrent event provide subjects and practitioners with a tool to understand the current health trajectory, as well as informing daily decision making. However, analysis is complicated by the two mutually exclusive event types; for example, when considering time-to next period of depressed mood for medical residents, time spent in a depressed episode competes with time not in a depressed mood. Analyses that fail to account for the time spent in the depressed state, risk biasing the analysis of the time-to the initialization of the next depressed period. There are broadly two schools of thought when approaching recurrent event analysis: (1) state-based modeling using partially observed Markov processes, such as the S(E)IR models in time-series analysis and dynamical systems, where the transition probabilities between states are of interest ( 16 ; 8 , e.g.,) , and (2) semiparametric intensity-based models, where an analyst obtains estimates of covariate effect on relative hazard. This paper focuses on extensions of the semiparametric alternating recurrent events modeling framework to dynamic prediction. To that end, 15 extended the Cox-based partial likelihood by modeling hazards of events to obtain interpretable parameter estimates of the intensity of recurrent events. However, their approach does not address potential dependence between recurrent event times, and the resultant, well-known dependent gap-time issue. 17 and 18 chose to model dependent events with a copula approach. 19 explored a random forest inverse probability weight to de-bias a semiparametric model for alternating recurrent events, handling potential censoring via pseudo-observations. Each of the latter type of model provides, on some level, interpretable parameter estimates, and can inform an analyst of population level dynamics, but requires the specification of a moment-based relationship between covariates and an outcome. Simultaneously, with the advent of modern computing methods, there has been an increased interest in black-box methods for individual dynamic predictions, which do not require an analyst to specify the any parametric relationship between an outcome and covariates. In the recurrent events case, 34 relied on the presence of smoothers within a semiparametric context to provide updated survival probabilities, while 36 and 37 constructed a neural network and a random forest, respectively, for dynamic predictions of a single time-to-event. To date, we are unaware of any authors who have proposed dynamic prediction models for alternating recurrent events, particularly in the case of “online” or real-time predictions, where predictions for an individual are updated based on newly observed experience. In this paper, we present a neural network assisted approach to dynamically predict the time to the primary recurrent event over a \tau -length period of follow-up at prespecified check-in time points, borrowing from 29 to transform the alternating recurrent events into a structure known as a censored longitudinal dataset. This data structure then allows for construction of pseudo-observations to address independent censoring mechanisms ( 3 ; 2 ) . To model these pseudo-observations, we utilize a long short-term memory neural network (LSTM). LSTMs were introduced by 14 as a solution to the well-documented vanishing gradient problem that plagues recurrent neural networks that use previous outcomes for predictions (for more detail on vanishing gradients, see 14 ; 13 or 6 ). LSTMs use a gating structure to elegantly incorporate previous observed behavior into fitted values at a time (or times) of interest, and can accommodate many different input and output data types. As a subtype of deep learning, LSTMs are widely recognized to excel in settings where there are many covariates with a possibly unknown relationship with an outcome, and prediction, rather than interpretation of coefficients, is of interest. By including an inverse probability weight (IPW) in the LSTM loss function, our proposed network accounts for the alternating nature of the data. Rather than providing retrospective (offline), de-biased analysis of a cohort, this paper proposes an online dynamic prediction tool for (primary) alternating recurrent events. We use inverse probability weights (IPW) to correct potential bias, as in 19 , but compare results in cases where the IPW weight is constructed based on a random forest or an LSTM. Our weight is then applied to novel dynamic prediction framework using LSTM; however, the field of machine learning and prediction modeling evolves at a fast pace. While our framework is demonstrated by LSTM, it is appropriate for use with the more advanced ML methods plugged-in. The rest of this paper is organized as follows. In Section 2 we describe the censored longitudinal data structure designed for analyzing alternating recurrent events. In Section 3 , we create pseudo-observations for addressing independent censoring mechanisms. Sections 4 and 5 propose two different dynamic prediction models, the former based on a neural network and the latter based on a semiparametric model. The weights used to fit both dynamic prediction models are described in Section 6 , while the performance of all models is examined via simulations in Section 7 . The proposed methods are applied to data arising from the Intern Health Study (IHS) in Section 8 to predict the start times of periods of low mood. The paper concludes with a discussion of limitations and future directions in Section 9 . 2 Censored Longitudinal Data Structure For individual i , let the alternating recurrent event times T_{i,0}^{(1)}<T_{i,0}^{(2)}<T_{i,1}^{(1)}<T_{i,1}^{(2)}<\ldots be potentially censored by the random variable C_{i} , where C_{i} is independent of T_{i,j}^{(1)},T_{i,j}^{(2)} , i=1,...,n , and j\geq 0 . Here, j indexes the event pairings, i indexes subjects, and the superscript k\in\{1,2\} indexes the alternating primary ( k=1 ) and secondary ( k=2 ) events.