ProCal: Probability Calibration for Neighborhood-Guided Source-Free Domain Adaptation PubID: pubid: 0000–0000/00$00.00 © 2026 IEEE
Ying Zheng, Yiyi Zhang, Yi Wang, Lap-Pui Chau · 2026
Read ProCal: Probability Calibration for Neighborhood-Guided Source-Free Domain Adaptation PubID: pubid: 0000–0000/00$00.00 © 2026 IEEE by Ying Zheng, Yiyi Zhang, Yi Wang, Lap-Pui Chau (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18764.txt.
Introduction
Zheng, Zhang, Wang, and Chau present ProCal for source-free domain adaptation. Such methods adapt a trained model to a new domain with no source data. Neighbor-based methods can over-trust look-alike predictions, which erodes source knowledge. ProCal pairs the frozen source model's first guesses with the live model's outputs. Their blend calibrates neighbor probabilities step by step. A joint loss adds soft supervision plus a diversity term. Theory shows the method settles where source and target knowledge fuse. Tests span 31 cross-domain tasks on four datasets.
Catalog record
| CREATOR | Ying Zheng, Yiyi Zhang, Yi Wang, Lap-Pui Chau |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53366 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.18764
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ProCal: Probability Calibration for Neighborhood-Guided Source-Free Domain Adaptation PubID: pubid: 0000–0000/00$00.00 © 2026 IEEE Ying Zheng, Yiyi Zhang, Yi Wang, Lap-Pui Chau Abstract Source-Free Domain Adaptation (SFDA) adapts pre-trained models to unlabeled target domains without requiring access to source data. Although state-of-the-art methods leveraging local neighborhood structures show promise for SFDA, they tend to over-rely on prediction similarity among neighbors. This over-reliance accelerates the forgetting of source knowledge and increases susceptibility to local noise overfitting. To address these issues, we introduce ProCal, a probability calibration method that dynamically calibrates neighborhood-based predictions through a dual-model collaborative prediction mechanism. ProCal integrates the source model’s initial predictions with the current model’s online outputs to effectively calibrate neighbor probabilities. This strategy not only mitigates the interference of local noise but also preserves the discriminative information from the source model, thereby achieving a balance between knowledge retention and domain adaptation. Furthermore, we design a joint optimization objective that combines a soft supervision loss with a diversity loss to guide the target model. Our theoretical analysis shows that ProCal converges to an equilibrium where source knowledge and target information are effectively fused, reducing both knowledge forgetting and overfitting. We validate the effectiveness of our approach through extensive experiments on 31 cross-domain tasks across four public datasets. Our code is available at: https://github.com/zhengyinghit/ProCal . I Introduction Unsupervised Domain Adaptation (UDA) improves model reliability in dynamic open-world scenarios such as autonomous driving [ 54 , 35 , 4 , 45 ] and embodied AI [ 16 , 26 , 11 , 60 ] by mitigating distribution discrepancies between source and target domains. However, traditional UDA methods require access to source data during the adaptation process, which poses challenges in privacy-sensitive applications like medical diagnostics [ 49 , 18 , 34 , 58 ] . To overcome this limitation, Source-Free Domain Adaptation (SFDA) has emerged as an approach that leverages only pre-trained source models along with unlabeled target domain data [ 19 , 9 ] , thereby avoiding the risk of privacy data leakage. Nonetheless, SFDA encounters a critical challenge: the lack of source data restricts effective calibration of target domain representations, leading to significant performance degradation when facing substantial domain shifts. Fig. 1: Illustration of the effect of neighborhood distribution calibration. (a) Direct optimization with neighborhood constraints may lead to source knowledge forgetting and overfitting to noisy local target structures. (b) Neighborhood distribution calibration mitigates these issues and yields better generalization. Existing SFDA methods can be broadly categorized into two paradigms. The first paradigm, exemplified by works such as SHOT [ 20 ] and PS [ 8 ] , focuses on global adaptation through pseudo-label self-training and information maximization [ 12 ] . However, these approaches are prone to error accumulation from noisy pseudo-labels and tend to overlook local sample relationships due to their global optimization bias. The second paradigm, represented by methods like NRC [ 51 ] and AaD [ 50 ] , enforces local smoothness via neighborhood consistency constraints. These methods, however, heavily depend on target-domain prediction similarity for neighborhood construction while neglecting cross-domain discriminative priors. As a result, they face a dual dilemma: 1) an optimization process driven solely by target-domain similarities accelerates the forgetting of source model knowledge and undermines cross-domain invariance; 2) the closed-loop interaction between neighborhood construction and prediction refinement amplifies noise propagation during local aggregation, particularly affecting boundary samples. Fig. 1 illustrates these phenomena. These issues ultimately arise from insufficient explicit constraints on the neighborhood distributions in current methodologies. TABLE I: Feature-accuracy (%) comparison of representative SFDA methods. Sup., Nei., Cal., and Off. denote Supervision, Neighborhood, Calibration, and Office, respectively. Leveraging the proposed probability calibration, we achieve consistent improvements across four public datasets. Method Sup. Nei. Cal. Off.-31 Off.-Home VisDA DomainNet SHOT [ 20 ] hard ✗ ✗ 88.6 71.8 82.9 68.9 AaD [ 50 ] soft ✓ ✗ 89.9 72.7 88.0 70.5 ProCal (ours) soft ✓ ✓ 90.7 73.8 88.6 72.8 To tackle these challenges, we introduce ProCal, which dynamically calibrates neighborhood-based predictions by integrating two key components: 1) prior probabilities from the source model and 2) online predictions from the current target model. By fusing these elements in a probabilistic framework, ProCal effectively suppresses local target-domain noise while preserving critical discriminative information from the source model, thereby striking a balance between knowledge retention and domain adaptation. To further utilize these calibrated probabilities, we design a joint optimization objective that combines a soft supervision loss with a diversity loss, ensuring robust learning even amid significant distribution shifts. Our theoretical analysis, utilizing gradient and fixed-point techniques, demonstrates that ProCal leverages both external guidance and internal feedback to stabilize updates, thereby driving the target model toward a fixed point that harmonizes source knowledge with local target structure. Extensive experimental results on 31 subtasks across four public datasets demonstrate the validity of our method. Table I summarizes the characteristics and performance comparisons of representative SFDA methods, highlighting that ProCal distinguishes itself from existing work through its innovative calibration mechanism, which addresses the limitations of relying on uncalibrated probability distributions in local neighborhood-based soft supervision. Consequently, ProCal achieves superior performance across multiple benchmarks, demonstrating its effectiveness in handling domain shifts and task heterogeneity. The main contributions of this work are summarized as follows: 1) We analyze the limitations of current SFDA approaches and identify two critical challenges: source knowledge forgetting and local noise overfitting that hinder performance. This analysis offers new insights into the bottlenecks of existing methods. 2) We introduce a novel ProCal method that employs a dual-objective optimization framework. By integrating soft supervision with diversified regularization constraints, ProCal effectively balances knowledge transfer with noise suppression. Our theoretical analysis further substantiates ProCal’s effectiveness. 3) We conduct extensive experiments on datasets of varying scales and domain shifts, demonstrating ProCal’s superiority over state-of-the-art methods. II Related Work Pseudo-labelling based SFDA . The core challenge of SFDA lies in the absence of labeled data in the target domain. Many researchers tackle this challenge by leveraging pseudo-labels generated from a pre-trained source model to adapt the target model iteratively [ 20 , 40 , 5 ] . For example, SHOT [ 20 ] performs self-supervised pseudo-labeling in combination with cross-entropy loss and information maximization to enhance feature discriminability. Although SHOT and its successors, such as SHOT++ [ 21 ] , DaC [ 59 ] , and SFDA-DE [ 6 ] , have demonstrated promising results, domain shifts inevitably induce confidence miscalibration. This miscalibration causes the model to assign incorrect pseudo-labels to ambiguous samples near decision boundaries [ 3 ] . To mitigate these inaccuracies, current approaches are typically categorized into two paradigms. One paradigm implements pseudo-label filtering by retaining high-confidence predictions through confidence-based techniques [ 15 , 41 ] or curriculum learning procedures as used in C-SFDA [ 14 ] . The other paradigm treats SFDA as a noisy-label problem, using methods such as Early Learning Regularization (ELR) [ 53 ] or Fuzzy-Aware Learning (FAL) [ 61 ] to suppress the memorization of incorrect labels. However, these frameworks are limited by over-conservative filtering or reliance on noise distribution assumptions that may not hold as noise patterns gradually evolve during adaptation. Fig. 2: Training dynamics on the Ar \rightarrow Cl task of Office-Home. Compared with SHOT and AaD,