Focused PU learning from imbalanced data
Elias Zavitsanos, Georgios Paliouras · 2026
Read Focused PU learning from imbalanced data by Elias Zavitsanos, Georgios Paliouras (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14467.txt.
Introduction
Zavitsanos and Paliouras, in their 2026 paper, propose a focused method for learning from known-good and unlabeled cases in skewed data sets. Many real problems, from disease gene finding and fraud spotting to recommender systems, suffer limited labelled data, with unlabeled cases mostly negative but including some positives. Few PU methods handle skew or hard-to-spot positives resembling negatives. Their focused risk estimator trains binary classifiers from both known-good and unlabeled cases. Tests show top scores under two labelling rules, and value for financial misstatement detection.
Catalog record
| CREATOR | Elias Zavitsanos, Georgios Paliouras |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57495 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14467
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Focused PU learning from imbalanced data Elias Zavitsanos, Georgios Paliouras Abstract We propose a new method of learning from positive and unlabeled (PU) examples in highly imbalanced datasets. Many real-world problems, such as disease gene identification, targeted marketing, fraud detection, and recommender systems, are hard to address with machine learning methods, due to limited labeled data. Often, training data comprises positive and unlabeled instances, the latter typically being dominated by negative, but including also several positive instances. While PU learning is well-studied, few methods address imbalanced settings or hard-to-detect positive examples that resemble negative ones. Our approach uses a focused empirical risk estimator, incorporating both positive and unlabeled examples to train binary classifiers. Empirical evaluations demonstrate state-of-the-art performance on imbalanced datasets under two labeling mechanisms - selecting positives completely at random (SCAR) and selecting at random (SAR). Beyond these controlled experiments, we demonstrate the value of the proposed method in the real-world application of financial misstatement detection. keywords PU learning, Imbalanced classification, Weakly supervised learning, Learning with noisy labels 1 Introduction In machine learning, classification tasks involve identifying instances that belong to one or more distinct classes. Binary classification, in particular, aims at a classifier that separates positive and negative instances, also known as positive-negative (PN) classification. This task is among the most widely studied problems in machine learning. A PN machine learning algorithm typically has access to a fully labeled training dataset that consists of representative positive and negative examples. However, there are cases where the training data contain labeled examples of only the positive class, accompanied by a large pool of unlabeled examples. This is known as the positive-unlabeled (PU) learning setting. The assumption is that unlabeled data contain examples from both the positive and the negative class, and the task is the same as binary classification; namely, the algorithm needs to learn to separate positive from negative examples. This setting poses significant hurdles for traditional supervised learning algorithms, which rely heavily on labeled data to establish a clear distinction between classes. PU learning has gained much attention in various practical scenarios since positive and unlabeled data arise naturally for several reasons 18 ; 61 ; 3 . For instance, in medical diagnosis, it may be impractical to label all patients as either healthy or diseased 11 ; 10 . Moreover, in fraud detection, the labels are usually sparse, since the corresponding authority may delay the investigation of all possible cases, due to time and resource limitations 49 ; 1 ; 5 ; 59 . The above are illustrative examples where PU learning is required. However, many more real-world applications require learning from PU data, such as under-reporting (e.g., survey data), recommender systems, disease gene identification, targeted advertising, and more 20 ; 53 ; 62 ; 39 ; 40 . Although PU learning has been widely studied in the literature 3 , most of the work assumes that the labeled examples are selected completely at random from the positive examples and that the underlying distribution of positive and negative examples is mostly balanced. Such assumptions simplify the problem and allow PU learning to be addressed as a binary classification task with slight modifications. However, the simplifying assumptions do not hold in many practical applications. In particular, class imbalance naturally arises for several reasons, resulting in a biased subset of labeled examples that are not selected completely at random. Class imbalance can be an intrinsic property of the data or result from limitations to obtain labeled data, such as cost, privacy, and significant human effort. There is evidence that if both classes are well represented and come from non-overlapping distributions, it is possible to obtain good results regardless of class disproportion 23 ; 28 . If, on the other hand, the positive class is under-represented and overlaps with the negative one, class imbalance becomes more of a challenge in the PU learning setting. This paper proposes a new PU learning method, relaxing the traditional assumptions as much as possible. We derive a new risk estimator that incorporates both the positive and the unlabeled examples in the learning process, focusing on the few positive examples that are hard to separate from the negative ones. This approach elegantly supports end-to-end training of binary classifiers without manipulating the original data. We compare the proposed approach with other state-of-the-art methods using 14 publicly available datasets and we also experiment with the real-world task of financial misstatement detection where PU data naturally arises. The experiments provide evidence that the proposed method achieves state-of-the-art results. The rest of the paper is structured as follows. Section 2 provides an overview of the background in PU learning and the related work. Section 3 presents the steps for deriving the new risk estimator. In section 4 , we describe the experimental setup and the datasets, while section 5 presents the empirical results. In Section 6 , we demonstrate the performance of the method in the real-world application of financial misstatement detection, and finally, in Section 7 , we conclude the paper and suggest future research directions. 2 Background and related work This section provides preliminary information regarding PU learning and its relation to other types of learning. Then, we present an overview of PU learning approaches, based on a commonly used categorization schema. 2.1 Preliminaries Being a specialization of binary classification, PU learning inherits the assumptions usually made to enable machine learning, such as that the samples are identically and independently distributed and constitute a representative sample of the real population. Moreover, being a variant of weak supervision, it may also inherit related assumptions, such as the smoothness assumption, the cluster assumption, and the manifold assumption. The first assumes that examples close to each other in the feature space are more likely to share the same label. The cluster assumption is a specialization of the smoothness assumption and hypothesizes that the data tend to form discrete clusters. Therefore, data points in the same cluster are more likely to share the same label. The manifold assumption states that the data lie on a manifold of a lower dimension than that of the original feature space and enables the application of distance-based and density-based methods defined on that manifold for learning classifiers. Additional assumptions can be made regarding the observation of the labeled examples and the underlying labeling mechanism. Most PU learning methods are based on the Selected Completely At Random (SCAR) assumption, which assumes that the (positive) labeled examples constitute a randomly selected subset of the pool of positives, and each positive example has the same probability of being selected to be labeled 17 . This is a strong assumption and is usually not realistic in practice. A more realistic assumption is the Selected At Random (SAR) 4 one. In SAR, we assume that the labeled examples are a biased sample from the positive distribution, where the selection bias depends on the feature vector representation of the data points. SAR is a loose assumption for most PU learning applications and can be specialized in the case of the Probabilistic Gap (PG) assumption, which states that positive examples that resemble negative ones are less likely to be labeled. In this work, we evaluate the proposed method using both the SCAR