A proposal for PU classification under Non-SCAR using clustering and logistic model
Konrad Furmańczyk, Kacper Paczutkowski · 2026
Read A proposal for PU classification under Non-SCAR using clustering and logistic model by Konrad Furmańczyk, Kacper Paczutkowski (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17130.txt.
Introduction
Furmanczyk and Paczutkowski tackle PU classification when the SCAR condition, which says labeled positives are a random sample of all positives, fails to hold. Their cluster-cleaning method first draws cleaning labels from two-means clustering, then runs logistic regression on the cleaned data with extra true positives added. Tested on eleven real datasets plus a synthetic set, it works where SCAR is violated, and the LassoJoint method proves fairly robust to SCAR perturbations.
Catalog record
| CREATOR | Konrad Furmańczyk, Kacper Paczutkowski |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23544 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17130
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A proposal for PU classification under Non-SCAR using clustering and logistic model Konrad Furmańczyk, Kacper Paczutkowski Abstract The present study aims to investigate a cluster cleaning algorithm that is both computationally simple and capable of solving the PU classification when the SCAR condition is unsatisfied. A secondary objective of this study is to determine the robustness of the LassoJoint method to perturbations of the SCAR condition. In the first step of our algorithm, we obtain cleaning labels from 2-means clustering. Subsequently, we perform logistic regression on the cleaned data, assigning positive labels from the cleaning algorithm with additional true positive observations. The remaining observations are assigned the negative label. The proposed algorithm is evaluated by comparing 11 real data sets from machine learning repositories and a synthetic set. The findings obtained from this study demonstrate the efficacy of the clustering algorithm in scenarios where the SCAR condition is violated and further underscore the moderate robustness of the LassoJoint algorithm in this context. 1 Introduction Learning from positive and unlabeled data (PU) is an approach in which a dataset has only positive examples and unlabeled data. In the PU setting, the training data contains positive and unlabeled examples, which means that the true labels Y\in\left\{0,1\right\} are not observed directly in the data. We only observe the surrogate variable S\in\left\{0,1\right\} , which indicates whether an example is labeled (and consequently positive, S=1 ) or not ( S=0 ). For example, consider the problem of predicting disease based on patient characteristics. Some patients are properly diagnosed (the surrogate variable S=1 and consequently, the true label Y=1 in this case), there also exists a group of patients without diagnosed disease (we put S=0 then). The second group includes both patients who have not actually been diagnosed with the disease but have the disease (in this case, we have Y = 1 and S = 0) and patients who do not actually have the disease (in this case, we have Y = 0 and S = 0). PU learning has been successfully applied in vision tasks [ 15 ] , text classifications [ 16 , 17 ] , recommendation systems [ 27 ] and medical diagnosis predictions [ 3 , 21 ] . In particular, the PU learning methods can be applied in the case when under-reporting is present in survey data [ 1 ] . Some other interesting examples where the under-reporting is present may be found in the paper by Bekker and Davis [ 1 ] . Now, suppose that X is a feature vector and, as previously, Y\in\left\{0,1\right\} stands for a true class label and S\in\left\{0,1\right\} denotes the surrogate variable that indicates whether an example is labeled ( S=1 ) or not ( S=0 ). We consider a single sample scenario, where it is assumed that there is a certain unknown distribution P of (Y,X,S) , such that (Y_{i},X_{i},S_{i}),i=1,\ldots,n, form an iid sample from this distribution. We do not have a traditional sample (X_{i},Y_{i}) , which is considered in standard classification problems. We only observe a sample (X_{i},S_{i}) , where S_{i} are the observations of variable S\in\left\{0,1\right\} (since S is a surrogate of the true label Y , then each S_{i} depends on (X_{i},Y_{i}) ). In the considered concept only positive examples (i.e., examples for which Y=1 ) may be labeled, which means that P(S=1|X,Y=0)=0. It should be emphasized that in the PU design, the true class labels Y are only partially observed, which means that if S=1 , then we know that Y=1 , but if S=0 , then Y may be either 1 or 0 . First, we consider the Selected Completely At Random (SCAR) condition, where is assumed P(S=1|Y=1,X)=P(S=1|Y=1). The SCAR assumption implies that X and S are independent given Y, since P(S=1|Y=0,X)=P(S=1|Y=0)=0. Let c=P(S=1|Y=1). The parameter c is called the label frequency and plays a key role in the PU learning scheme. The SCAR assumption significantly simplifies the estimation of the posterior probability P(Y=1|X=x) , where, as previously, Y\in\{0,1\} denotes a true class label and X stands for the feature vector. Under this assumption, we have P(Y=1|X=x)=c^{-1}P(S=1|X=x). The label frequency c can be estimated using the observed PU data [ 19 ] . In many practical applications the SCAR assumption does not hold. For example, some factors X may affect the label frequency process. In this paper, we consider the SAR (Selected at Random) assumption, which means P(S=1|Y=1,X=x)=e(x), where e is some unknown function of feature vector X=x . The quantity e(x) is called the propensity score. Recently, a few methods were invented for the SAR condition, especially based on the Expectation-Maximization (EM) algorithm [ 2 , 12 ] and using joint maximum likelihood for the double logistic model for e(x) and y(x)=P(Y=1|X=x) [ 10 ] . Based on the logistic model, three basic methods of this estimation have been proposed so far. They minimize the empirical risk of the logistic loss function and are known as the naive method, the weighted method, and the joint method (the latter has been introduced in Teisseyre et. al. [ 23 ] ). In [ 7 ] - [ 9 ] was proposed a new method under the SCAR assumption called the LassoJoint. This method is based on the logistic model (joint method) and thresholded Lasso selection. The present study focuses on the logistic regression approach, which is closely associated with the concept of easy interoperability. However, for the problem of PU, generative adversarial networks (GANs) have also been employed in the works of Hou et al. [ 14 ] and Guo et al. [ 13 ] . The objective of this study is to investigate a computationally efficient cluster cleaning algorithm that can address the PU problem when the SCAR condition is not satisfied. The second goal of the paper is to check how the LassoJoint method is robust to such a perturbation of the SCAR condition. The remainder of our paper is structured as follows. In Section 2 we introduce our aims and methods, in Section 3 we present our numerical experiments together with the obtained results, in Section 4 we summarize and conclude our study. Comprehensive results of our study are available in Supplement 1 1 1 https://github.com/kapacc/mdai25-clusters-scripts . This supplement also includes all codes in R that are fully reproducible. In order to execute our simulations, we employed the RStudio server module from the ICM UW Topola server 2 2 2 This research was carried out with the support of the Interdisciplinary Centre for Mathematical and Computational Modelling (ICM) at the University of Warsaw, under computational allocation No. g99-2175. . We applied the following libraries: glmnet [ 5 , 6 ] , caret [ 11 ] , stringr [ 25 ] , dplyr [ 26 ] , pROC [ 20 ] , and MLmetrics [ 22 ] . 2 Objectives and Methods In this section, we describe our methods and objectives. First, we present the LassoJoint method and the naive method. Next, we show our proposed cluster cleaning method. Finally, we recall the basic classification metrics that we will use. Our main goal is to investigate a computationally efficient cluster cleaning algorithm that can be helpful in solving the PU classification problem when the SCAR condition is