The underlap coefficient as a measure of a biomarker’s discriminatory ability
Zhaoxi Zhang, Vanda Inácio, Miguel de Carvalho · 2025
Read The underlap coefficient as a measure of a biomarker’s discriminatory ability by Zhaoxi Zhang, Vanda Inácio, Miguel de Carvalho (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12288.txt.
Introduction
Zhaoxi Zhang, Vanda Inácio, and Miguel de Carvalho published a statistics paper in 2025 on judging medical biomarkers. A biomarker should separate patients into disease groups cleanly. For three groups, common summary measures already exist. Those measures assume the groups fall in a tidy order, which often fails.
The authors propose a new measure called the underlap coefficient. It rates how well a biomarker distinguishes three or more groups. It does not need the ordering assumption. They also build Bayesian estimators for the measure. One version adjusts for patient traits like age. The tools aim to rank candidate biomarkers more honestly in discovery studies.
Catalog record
| CREATOR | Zhaoxi Zhang, Vanda Inácio, Miguel de Carvalho |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-12288
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The underlap coefficient as a measure of a biomarker’s discriminatory ability Zhaoxi Zhang, Vanda Inácio, Miguel de Carvalho Abstract The first step in evaluating a potent ial diagnostic biomarker is to examine the variation in its values across different disease groups. In a three-class disease setting, the volume under the receiver operating characteristic surface and the three-class Youden index are commonly used summary measures of a biomarker’s discriminatory ability. However, these measures rely on a stochastic ordering assumption for the distributions of biomarker outcomes across the three groups. This assumption can be restrictive, particularly when covariates are involved, and its violation may lead to incorrect conclusions about a biomarker’s ability to distinguish between the three disease classes. Even when a stochastic ordering exists, the order may vary across different biomarkers in discovery studies involving dozens or even thousands of candidate biomarkers, complicating automated ranking. To address these challenges and complement existing measures, we propose the underlap coefficient, a novel summary index of a biomarker’s ability to distinguish between three (or more) disease groups, and study its properties. Additionally, we introduce Bayesian nonparametric estimators for both the unconditional underlap coefficient and its covariate-specific counterpart. These estimators are broadly applicable to a wide range of biomarkers and populations. A simulation study reveals a good performance of the proposed estimators across a range of conceivable scenarios. We illustrate the proposed approach through an application to an Alzheimer’s disease (AD) dataset aimed to assess how four potential AD biomarkers distinguish between individuals with normal cognition, mild impairment, and dementia, and how and if age and gender impact this discriminatory ability. key words: Alzheimer’s disease; Bayesian nonparametrics; covariates; diagnostic biomarkers; stochastic ordering; underlap coefficient. † † footnotetext: Zhaoxi Zhang, School of Mathematics, University of Edinburgh, Scotland, UK ( [email protected] ).Vanda Inácio, School of Mathematics, University of Edinburgh, Scotland, UK ( [email protected] ). Miguel de Carvalho, School of Mathematics, University of Edinburgh, Scotland, UK ( [email protected] ). Data used in preparation of this article were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in the analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf 1 INTRODUCTION Assessing the discriminatory ability of a continuous biomarker for diagnostic purposes is a common task in clinical research. The first fundamental step toward this goal is to evaluate how biomarker outcomes vary across different disease stages or groups. In this article, we investigate how potential biomarker of Alzheimer’s disease (AD) simultaneously distinguish between individuals with normal cognition, mild cognitive impairment, and severe impairment or AD. As highlighted in Zhang et al., 2016 , suitable biomarkers that track the stages of AD progression could markedly accelerate drug development by providing earlier indications of drug efficacy. Thus, it is critical to develop proper statistical methods to evaluate how potential biomarkers can distinguish between the three aforementioned stages. As a direct generalisation of receiver operating characteristic (ROC) curves, ROC surfaces have been developed to assess discriminatory ability in ordered three-class problems ( Nakas and Yiannoutsos, 2004 ) . In this setting, the area under the ROC curve and the Youden index extend to the volume under the ROC surface (VUS) and the three-class Youden index ( \text{YI}_{3} ), respectively ( Nakas, 2014 ) . ROC surfaces, and consequently their summary indices, rely on a stochastic ordering assumption for the distributions of biomarker outcomes. When this assumption is strongly violated, using the VUS and \text{YI}_{3} may be highly misleading. Such violations often reflect differences in scale, in addition to differences in location, for biomarker outcomes across the three groups. For many diseases or conditions, promising biomarkers may not follow a stochastic ordering. Even when the stochastic ordering holds, if the densities of biomarker outcomes cross more than twice, this may render both \text{YI}_{3} and the VUS suboptimal as measures of discriminatory ability. As a result, when the VUS and \text{YI}_{3} are blindly applied to large panels of candidate biomarkers, those with good discriminatory ability but without a monotonic ordering may be overlooked. Moreover, even when a monotonic order exists but it is not the anticipated one (e.g., lower biomarker values indicate more severe disease stages), the biomarker may still be disregarded. While this issue can be manually corrected when dealing with a small number of biomarkers, it becomes impractical when evaluating dozens. The challenge of non-monotonic biomarkers has been quite extensively studied in the two-class disease setting (see, among many others, Martínez-Camblor et al., 2017 ; Samawi et al., 2017 ; de Carvalho et al., 2020 ; Bantis et al., 2021 ; Lindner et al., 2023 ). However, the literature on the three-class setting, and beyond, remains sparse, and methods or adjustments from the two-class setting do not generalise easily to three (or more) classes. To the best of our knowledge, the only existing work is by Yang et al., 2020 , which proposes a non-monotonic transformation of biomarker outcomes to improve VUS values. As acknowledged by the authors, the assumption of normally distributed biomarker outcomes is crucial for the methodology to work. We should also mention that, although not specifically tailored to non-monotonic biomarkers, Nakas and Alonzo, 2007 proposed the construction of ROC graphs and a corresponding summary measure to assess the overlap of three groups under an umbrella ordering, i.e., for assessing the ability of a biomarker to differentiate one disease class from two others without requiring a specific ordering between the two latter classes. In this article, we propose the underlap coefficient to address a gap in the literature and to complement existing summary measures of discriminatory ability for three or more disease classes. The UNL is not based on any classification rule and directly quantifies differences in biomarker outcome distributions across three or more groups, without assuming a specific ordering of biomarker values among the groups. As a result, it is widely applicable in the biomarker field and can be reliably used with panels of candidate biomarkers that include: (i) biomarkers following the conventional monotonic ordering (where higher values correspond to more severe disease stages), (ii) biomarkers with a reverse ordering (where lower values indicate greater disease severity), and (iii) biomarkers exhibiting a non-monotonic ordering. The UNL is further geometrically appealing, has an intuitive interpretation as the ‘effective’ number biomarker outcomes groups, and can be easily generalised to settings with more than three disease classes. Furthermore, as discussed in Section 2 , the UNL is computationally more efficient to estimate than existing ROC summary based measures, especially when the number of disease-classes increases. We further introduce the covariate-specific underlap coefficient to account for patient heterogeneity in evaluating a biomarker’s ability to simultaneously distinguish between three or more classes. Ignoring such heterogeneity can lead to biased estimates of a biomarker’s discriminatory ability ( Janes and Pepe, 2008 ; Inácio et al., 2021 ) . In the presence of covariates, assuming a specific ordering of biomarker outcomes across groups becomes an even more stringent assumption. Notably, To et al., 2022 is the only study that adjusts for covariates in the case of more than two disease classes, specifically in the