Maximum smoothed likelihood method for the combination of multiple diagnostic tests, with application to the ROC estimation

Fangyong Zheng 1 , Pengfei Li 2 , and Tao Yu 3 · 2026

Read Maximum smoothed likelihood method for the combination of multiple diagnostic tests, with application to the ROC estimation by Fangyong Zheng 1 , Pengfei Li 2 , and Tao Yu 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03675.txt.

Introduction

Fangyong Zheng, Pengfei Li, and Tao Yu work on combining several medical biomarkers into one stronger diagnostic test. Using multiple markers usually beats any single one, but common modeling assumptions can be too rigid for real data. Their approach uses a flexible semiparametric model linking the density ratio between diseased and healthy groups to a monotone transformation of a linear marker combination.

On top of that model they build a maximum smoothed likelihood method, which exploits smoothness in the densities and the transformation. They supply an effective computing algorithm, prove how the estimators behave in large samples, and construct the receiver operating characteristic curve, the standard plot of diagnostic trade-offs, plus its summary area. Better combined tests can sharpen screening decisions in clinics.

Catalog record

CREATORFangyong Zheng 1 , Pengfei Li 2 , and Tao Yu 3
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-03675

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Maximum smoothed likelihood method for the combination of multiple diagnostic tests, with application to the ROC estimation Fangyong Zheng 1 , Pengfei Li 2 , and Tao Yu 3 Abstract In medical diagnostics, leveraging multiple biomarkers can significantly improve classification accuracy compared to using a single biomarker. While existing methods based on exponential tilting or density ratio models have shown promise, their assumptions may be overly restrictive in practice. In this paper, we adopt a flexible semiparametric model that relates the density ratio of diseased to healthy subjects through an unknown monotone transformation of a linear combination of biomarkers. To enhance estimation efficiency, we propose a smoothed likelihood framework that exploits the smoothness in the underlying densities and transformation function. Building on the maximum smoothed likelihood methodology, we construct estimators for the model parameters and the associated probability density functions. We develop an effective computational algorithm for implementation, derive asymptotic properties of the proposed estimators, and establish procedures for estimating the receiver operating characteristic (ROC) curve and the area under the curve (AUC). Through simulation studies and a real-data application, we demonstrate that the proposed method yields more accurate and efficient estimates than existing approaches. 1 Fangyong Zheng is PhD Candidate, Department of Statistics and Data Science, National University of Singapore, Singapore, 117546 (Email: [email protected] ) 2 Pengfei Li is Professor, Department of Statistics and Actuarial Sciences, University of Waterloo, Waterloo, ON, Canada, N2L 3G1 (Email: [email protected] ) 3 Tao Yu is Associate Professor, Department of Statistics and Data Science, National University of Singapore, Singapore, 117546 (Email: [email protected] ) Keywords: Optimal combination of biomarkers; Receiver operating characteristic; Smoothed likelihood; Shape-restricted inference; Weighted isotonic regression 1 Introduction In medical diagnosis, multiple biomarkers are often collected for each subject. Each biomarker may carry partial and complementary information about the presence, severity, or progression of a disease. Relying on a single biomarker may lead to incomplete or inaccurate assessments, particularly when the disease is heterogeneous or affects multiple physiological pathways. Therefore, appropriately incorporating and combining multiple biomarkers has become increasingly important for improving diagnostic accuracy, enhancing risk stratification, and enabling more personalized medical decisions ( 18 ; 17 ) . Effective combination strategies can exploit the joint distribution of biomarkers to construct powerful diagnostic tools, such as composite scores or multivariate ROC curves, that better distinguish between diseased and non-diseased individuals; see 11 and the references therein. Proposing the appropriate combination methods, establishing effective numerical algorithms, and exploring the underline theoretical properties have been popular research topics in the statistical community for decades. Assuming that the biomarkers follow a multivariate normal distribution, 25 established the best linear combination approach. Based on the Neyman–Pearson lemma, 22 showed that the density ratio between the diseased and healthy subjects maximizes the true positive rate at any fixed false positive rate, making it the gold standard for combining multiple biomarkers; see also 10 ; 4 . Methods for combining biomarkers, established on the density ratio model, are available in the literature. 24 considered an exponential tilting model, where they assumed that the log density ratio between the diseased and non-diseased populations is a combination of multiple diagnostic tests; specifically, the model is given by \frac{f(x)}{g(x)}=\exp\left\{\alpha+\beta^{\tau}\xi(x)\right\}, (1) where \alpha is a scalar parameter, x\in\mathbb{R}^{d} , \beta is a p dimensional parameter, \xi(\cdot) is a known p\times 1 smooth vector function of x , f(\cdot) and g(\cdot) respectively denote the joint probability density functions (p.d.f.s) of the biomarker measurements from the diseased and healthy subjects. 3 observed that the exponential function form assumed by ( 1 ) could be restrictive and may not be well satisfied in practice; see Section 6 for examples. They proposed the semiparameteric model: \frac{f(x)}{g(x)}=\phi(\beta^{\tau}\xi(x)), (2) where \phi(\cdot) is an unknown nondecreasing function, and an empirical likelihood based method for estimating the model parameters. More developments of methods for combining the biomarkers can be found in 21 , 2 , 20 , 16 , 15 , among others. Model ( 2 ) is less restrictive than the exponential tilting model ( 1 ), and can yield more accurate estimation of \beta when the assumption underlying ( 1 ) is violated. Therefore, we adopt model ( 2 ) in this paper. While the empirical likelihood method proposed in 3 is compatible with this model, it does not exploit potential smoothness in the underlying densities f(x) and g(x) , or in the monotonic transformation function \phi(\cdot) . In many practical applications, however, these functions are indeed smooth, and failing to leverage this property may lead to efficiency loss and suboptimal estimation. To address this issue, we propose a method under model ( 2 ) that incorporates smoothness to enhance estimation accuracy of f(\cdot) , g(\cdot) , and \beta . Specifically, we adopt a smoothed likelihood approach, building on the maximum smoothed likelihood method introduced by 6 . This technique parallels maximum likelihood estimation in parametric settings but is designed for nonparametric density estimation, preserving many desirable properties such as consistency and efficiency. The smoothed likelihood method has proven effective in a variety of challenging statistical problems, including inverse convolution 8 , smooth monotone and unimodal density estimation 9 , estimation of hazard rates and event-time distributions 13 , density estimation in mixture models 19 ; 28 , interval-censored data 14 , and two-sample problems with likelihood ratio ordering 27 . We build on these developments and incorporate the smoothed likelihood framework into our estimation procedure. In this paper, assuming model ( 2 ), we propose the smoothed likelihood and, based on it, define estimators \widehat{\beta} , \widehat{g}(\cdot) , and \widehat{f}(\cdot) for the parameters \beta , g(\cdot) , and f(\cdot) , respectively. We also establish and implement an efficient computational algorithm for estimating these parameters. Using these estimators, we further estimate the ROC curve and AUC. We rigorously derive the asymptotic properties of our parameter estimators, as well as those of the ROC and AUC estimators. Through extensive simulation studies, we demonstrate that our method achieves superior estimation accuracy compared to competing approaches. Finally, we illustrate the practical utility of our method by applying it to a real-data example. The rest of the paper is organized as follows. Section 2 introduces the proposed maximum smoothed likelihood approach and defines the corresponding parameter estimators. Section 3 presents the computational algorithm for parameter estimation. Section 4 establishes the asymptotic properties of the proposed estimators. Section 5 describes the estimation of the ROC curve and AUC, and investigates their asymptotic behavior. Section 6 reports the results of simulation studies, and Section 7 illustrates the proposed method using a pancreatic cancer dataset. Section 8 concludes the paper with a discussion. The technical conditions are given in the Appendix, while detailed technical derivations supporting the theoretical results in Sections 2 , 4 , and 5 are included in the supplementary material. 2 Maximum Smoothed Likelihood Estimation Let \{X_{1},\ldots,X_{n}\} and \{Y_{1},\ldots,Y_{m}\} be the d -dimensional test results from diseased and healthy subjects, respectively. Assume that X_{1},\ldots,X_{n} are independent and identically distributed (i.i.d.) as a random vector X , and Y_{1},\ldots,Y_{m} are i.i.d. as Y . Denote by F(x) and f(x) the cumulative distribution function (c.d.f.) and p.d.f. of X , respectively; likewise, let G(x) and g(x) denote the c.d.f. and p.d.f. of Y .

Read the complete text