Locality-aware Private Class Identification for Domain Adaptation with Extreme Label Shift
Chuan-Xian Ren, Cheng-Jun Guo, and Hong Yan · 2026
Read Locality-aware Private Class Identification for Domain Adaptation with Extreme Label Shift by Chuan-Xian Ren, Cheng-Jun Guo, and Hong Yan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05567.txt.
Introduction
A classifier moved to a new domain may meet classes it never saw in training. Chuan-Xian Ren, Cheng-Jun Guo, and Hong Yan tackle those private classes under extreme label shift. Older methods assume private classes look like obvious outliers, but a shared class can vary internally more than a private class differs from it.
Their score, built on local transport mass from optimal transport theory, separates shared from private samples. A full method, ReOT, then learns while keeping the two groups apart, avoiding bad matches. They prove a target-risk bound and validate the approach on benchmark experiments.
Catalog record
| CREATOR | Chuan-Xian Ren, Cheng-Jun Guo, and Hong Yan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05567
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Locality-aware Private Class Identification for Domain Adaptation with Extreme Label Shift Chuan-Xian Ren, Cheng-Jun Guo, and Hong Yan Abstract Domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain with different distributions. In real-world scenarios, the label spaces of the two domains often have an inclusion relationship, where some classes exist only in one domain but not the other. These non-overlapping classes are referred to as private classes. Identifying private class samples and mitigating their adverse effects is critical in the literature. Existing methods rely on the assumption that shifts in private classes are large enough to be considered outliers. However, the variance within a single shared class can be significantly larger than the difference between a private class and another shared class, challenging this assumption. Consequently, private classes substantially increase the difficulty of cross-domain classification. To address these issues, based on local transportation and metric properties of optimal transport (OT), a locality-aware private class identification approach is proposed in the form of a score function on transport mass. The effectiveness of the proposed approach is theoretically proven, highlighting the score function’s strong ability to distinguish between shared and private class samples. Building on this, we introduce a reliable OT-based method (ReOT) for domain adaptation under severe label shift. ReOT minimizes classification risk while learning the separated cluster structure between the identified shared classes and private classes, effectively avoiding mismatch between shared-private sample pairs, thus ensuring that important knowledge is reliably transported intra-class to mitigate class-conditional discrepancy. Furthermore, a generalization upper bound of the target risk is provided for extreme label shift scenarios, which can be minimized by ReOT. Extensive experiments on benchmarks validate the effectiveness of ReOT. I Introduction It is well-known that a model with strong generalization performance requires large-scale datasets with sufficient label annotations. However, data collected from real world are often unlabeled, and labeling large-scale datasets typically involves excessive costs. In particular, the collected datasets may have different data distributions, resulting in a severe degradation of the model performance. To solve these issues, unsupervised domain adaptation (UDA) [ 1 , 2 , 3 ] has recieved wide attention to transfer knowledge from a labeled domain (i.e., source domain) to an unlabeled domain with different data distribution (i.e., target domain), notably saving time and labor consuming to collect labels for target domain. However, most existing UDA works [ 4 , 5 , 6 ] follow a closed set assumption, i.e., the two domains share identical label space. This severely limits their applications to real-world scenarios since the label spaces of source and target domains are usually heterogeneous or extremely shifted. Specifically, the heterogeneous scenarios can be roughly divided into two categories: 1) source label space is a subset of the target label space; 2) source label space includes the target label space. To address these two realistic challenges, open set domain adaptation (OSDA) [ 7 , 8 , 9 ] and partial domain adaptation (PDA) [ 10 , 11 , 12 ] are proposed, respectively. These two scenarios can be viewed as cases of extreme label shift DA. Generally, OSDA assumes the private classes exist in the target domain, and it requires the model to recognize them. PDA shows a similar scenario while the private classes exist in the source domain. Therefore, both OSDA and PDA face two primary challenges: 1) Domain gap on shared classes: The data distribution for shared classes differs between the source and target domains, reducing classification accuracy on these classes. 2) Category gap: The absence of private classes in one domain (either source or target) leads to a significant drop in model performance in the target domain, even if the model performs well in the source domain. In these two challenges, the category gap is the core issue. It is not only inherently challenging to be addressed but also complicates the resolution of domain discrepancies using well-studied domain alignment techniques, as the absence of private classes can lead to misalignment between private and shared classes. Therefore, it is crucial to mitigate the adverse effects of the category gap. Most current works [ 13 , 14 , 15 ] addressed these challenges by the following two steps: 1) Identifying and then separating the private class samples to eliminate label shift; 2) Implementing domain alignment approach to alleviate domain discrepancy. Following this strategy, these works can recognize some target/source private samples and achieve a degree of domain alignment, thereby obtaining good model performance. While achieving great success, it is worth noting that mainstream methods always focus on only one scenario, ignoring the connection between OSDA and PDA. In fact, OSDA and PDA are symmetric in some sense, as the biggest difference is in which domain the private classes exist. Although OSDA may be more challenging since the private class data are unlabeled while in PDA the private class data are labeled, we would emphasize that a proper method should be able to address both scenarios. Meanwhile, it is important to recognize that even when considering only one scenario, previous methods have significant limitations, as they often rely on unrealistic strong assumptions to identify private class samples. Specifically, private class identification in previous works mainly includes importance weighting-based approaches [ 10 , 16 ] and threshold-based approaches [ 8 , 17 , 15 ] . Importance weighting-based approaches are widely used in PDA. However, they involve assigning very small weights for the private class samples, while learning high-quality weights generally relies on the strong assumption that domain discrepancy is negligible. Threshold-based methods use a metric to determine the likelihood that a sample belongs to a private class. If the metric value exceeds a certain threshold, the sample is classified as private. To ensure effectiveness, these approaches often assume that the gap within a shared class is consistently smaller than the gap between private and shared classes. While this assumption may be less strict than negligible domain discrepancy, it remains difficult to satisfy in practice. As presented in Figure 1 , in real-world scenarios, the gap within a single shared class can significantly exceed the gap between a private class and another shared class. This contradicts the foundational assumptions of many existing methods. Therefore, it is necessary to explore a reliable method, which ensures effectiveness under realistic conditions, for private class identification. (a) Open Set Domain Adaptation (OSDA) (b) Partial Domain Adaptation (PDA) Fig. 1: Two typical extreme label shifts in unsupervised domain adaptation, i.e., (a) OSDA; (b) PDA. To achieve successful private class identification, existing methods often assume that the semantic shift of the private class is consistently larger than the domain shift of shared classes. However, the variance for a specific shared class can be larger than the gap between a private class and another shared class. Better view in color. . In the following, we explore the reliability of the private class identification approach for extreme label shift scenarios. We observe that although the shift of shared classes is not always smaller than that of private classes across the entire data manifold, it generally holds true in local regions. Specifically, in a local neighborhood of a shared class cluster, the semantic shift of private class samples is