Rethinking Individual Risk and Aggregation in Survival Analysis: A Latent Mechanism Framework
Xijia Liu · 2026
Read Rethinking Individual Risk and Aggregation in Survival Analysis: A Latent Mechanism Framework by Xijia Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24276.txt.
Introduction
Liu rethinks how individual risk should be read from survival analysis. Hazard and survival functions are defined at population level, yet applied work often treats them as personal risk. Liu models event times as coming from hidden, person-specific hazard paths. Population curves are then averages over varied hidden paths. He shows those paths cannot be identified from survival data, even when population curves are fully known. Classic survival models can be sorted by how they handle this hidden spread. The framework sets clear limits for inference.
Catalog record
| CREATOR | Xijia Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91477 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24276
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Rethinking Individual Risk and Aggregation in Survival Analysis: A Latent Mechanism Framework Xijia Liu Abstract Survival analysis provides a well-established framework for modeling time-to-event data, with hazard and survival functions formally defined as population-level quantities. In applied work, however, these quantities are often interpreted as representing individual-level risk, despite the absence of a clear generative account linking individual risk mechanisms to observed survival data. This paper develops a latent hazard framework that makes this relationship explicit by modeling event times as arising from unobserved, individual-specific hazard mechanisms and viewing population-level survival quantities as aggregates over heterogeneous mechanisms. Within this framework, we show that individual hazard trajectories are not identifiable from survival data under partial information. More generally, the conditional distribution of latent hazard mechanisms given covariates is structurally non-identifiable, even when population-level survival functions are fully known. This non-identifiability arises from the aggregation inherent in survival data and persists independently of model flexibility or estimation strategy. Finally, we show that classical survival models can be systematically reinterpreted according to how they handle this unresolved conditional mechanism distribution. This paper provides a unified framework for understanding heterogeneity, identifiability, and interpretation in survival analysis, and clarifies how population-level survival models should be interpreted when individual risk mechanisms are only partially observed, thereby establishing explicit information constraints for principled modeling and inference. Keywords— Survival analysis; hazard function; heterogeneity; identifiability; latent mechanisms; population versus individual risk 1 Introduction Survival analysis has achieved remarkable empirical success over the past five decades and has become a central tool in biomedical research, epidemiology, and reliability studies. Its fundamental quantities, the hazard function and the survival function, are defined with mathematical rigor and stability, and have supported extensive methodological development and applied practice. However, alongside this success, a persistent interpretational tension has remained present but has never been systematically clarified. Within the classical theoretical framework, hazard and survival functions are defined as population-level statistical objects, characterizing failure rates and survival probabilities within hypothetical cohorts sharing the same observed covariates. In applied settings, however, these same quantities are often naturally endowed with individual-level interpretations and are used to describe individual risk states, latent biological processes, or uncertainty about future outcomes. This issue becomes particularly salient as the focus of survival analysis has increasingly shifted from inference-oriented to prediction-oriented objectives, and has become difficult to avoid in contexts such as individualized prediction, risk stratification, and decision support. More importantly, this tension is not confined to any particular class of models or methods, but reflects a structural information constraint: survival data inherently aggregate over heterogeneous, unobserved hazard mechanisms, and this aggregation induces a many-to-one mapping from individual-level risk processes to observable population-level quantities. Clarifying this issue is therefore of foundational importance for understanding the interpretational boundaries of survival models, the meaning of prediction, the feasibility of heterogeneity characterization, and for providing principled guidance for the design of future predictive models. 1.1 Motivating Challenges in Survival Analysis The source of the interpretational tension outlined above is not immediately apparent at the level of formal definitions. In classical survival theory, hazard and survival functions are rigorously defined as population-level quantities. In particular, the standard hazard h(t|X)=\lim_{\Delta t\to 0}\frac{\Pr(t\leq T<t+\Delta t|T\geq t,X)}{\Delta t}, characterizes the instantaneous failure rate among individuals who have survived up to time t within a hypothetical cohort sharing the same observed covariates. By construction, this quantity is conditional on membership in the risk set and is defined only at the level of such populations, rather than as an intrinsic property of a single subject. Nevertheless, in applied contexts, both classical and modern survival models are often discussed, reported, or informally interpreted in ways that suggest an individual-level notion of risk, even though h(t|X) and S(t|X) are formally defined as population-level quantities. This interpretational shift is closely tied to unobserved heterogeneity. Individuals who share the same observed covariates may differ substantially in their underlying risk processes. Therefore, population-level hazards represent averages over heterogeneous individuals rather than intrinsic individual properties. Unless heterogeneity vanishes, a condition rarely met in biomedical settings, population hazards cannot be directly equated with individual risks. However, this distinction is often blurred in practice, complicating interpretation, prediction, and causal reasoning. Classical regression-based survival models adopt specific functional forms for population-level quantities. For example, Cox’s proportional hazards model 5 and accelerated failure time (AFT) 3 formulations describe structured relationships between covariates and hazards or survival times. These models are highly effective descriptive tools, but they do not explicitly specify the individual-level processes that would give rise to the assumed population structures. As a result, the connection between model assumptions and underlying individual risk dynamics remains implicit. Recent machine learning approaches to survival analysis intensify this issue. By learning flexible mappings from covariates to time-dependent hazards or survival probabilities, such models can further blur the distinction between population-level quantities and individual-level interpretations, even though these quantities remain formally defined at the population level. Without a generative framework that distinguishes individual risk mechanisms from their population aggregates, the interpretation of model outputs remains ambiguous. Taken together, these considerations highlight the absence of an explicit mechanism-based foundation that links individual-level risk processes to observed population-level survival patterns. 1.2 Existing Perspectives on Survival Modeling The distinction between individual-level and population-level notions of hazard has long been implicit in the survival analysis literature. In Cox’s original formulation ( 5 ) , the hazard function is introduced as a regression object describing cohort-level failure rates, with the baseline hazard treated as an arbitrary population function of time. The model itself does not attribute ontological status to individual hazards, nor does it attempt to specify individual risk processes. However, the absence of an explicit generative interpretation has left room for divergent readings in subsequent methodological and applied work. A number of authors have emphasized interpretational subtleties associated with hazard-based quantities. Hazard contrasts compare failure rates among individuals who have survived up to a given time rather than individual risks ( 1 ; 16 ; 7 ) , and unobserved heterogeneity can distort hazard-based interpretations even in randomized studies ( 6 ) . These contributions provide important clarification regarding the limitations of hazard ratios and related summaries, but they do not offer a general framework for linking population hazards to underlying individual risk processes. Parallel developments have sought to address heterogeneity through extensions such as frailty models 19 ; 8 , accelerated failure time formulations, and latent class survival analysis 15 ; 17 . Each of these approaches introduces additional structure to account for variability beyond observed covariates, whether through random effects, discrete subpopulations, or time-scaling mechanisms. More recently, machine learning based survival models have emphasized predictive performance by learning flexible mappings from covariates to observable risk or survival quantities ( 9 ; 12 ; 13 ) ; see 20 ; 21 for reviews. While these methods differ substantially in form and intent, they share a common feature: the underlying relationship between individual-level risk mechanisms and population-level survival quantities remains implicit, particularly in predictive settings where individual risk estimates are difficult to validate or calibrate ( 18 ; 2 ) . What is currently missing is a unifying perspective that makes this relationship explicit. In particular, there is a need for a framework that (i) defines individual risk