PAS: Estimating the target accuracy before domain adaptation
Raphaella Diniz, Jackson de Faria Júnior & Martin Ester · 2026
Read PAS: Estimating the target accuracy before domain adaptation by Raphaella Diniz, Jackson de Faria Júnior & Martin Ester (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09863.txt.
Introduction
Diniz, de Faria, and Ester present PAS, a score estimating how well a source dataset and pretrained feature extractor will transfer to a target classification task before adaptation runs. Source and model choice matter greatly, yet no labeled target validation set exists and candidate models abound. PAS judges source-target fit from pretrained feature embeddings, then ranks candidate models and source sets for the target task. Tests on image classification benchmarks show PAS tracks actual target accuracy closely, consistently picking the best model and source set while cutting compute.
Catalog record
| CREATOR | Raphaella Diniz, Jackson de Faria Júnior & Martin Ester |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53974 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.09863
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PAS: Estimating the target accuracy before domain adaptation Raphaella Diniz, Jackson de Faria Júnior & Martin Ester Abstract The goal of domain adaptation is to make predictions for unlabeled samples from a target domain with the help of labeled samples from a different but related source domain. The performance of domain adaptation methods is highly influenced by the choice of source domain and pre-trained feature extractor. However, the selection of source data and pre-trained model is not trivial due to the absence of a labeled validation set for the target domain and the large number of available pre-trained models. In this work, we propose Potential Adaptability Score (PAS) , a novel score designed to estimate the transferability of a source domain set and a pre-trained feature extractor to a target classification task before actually performing domain adaptation. PAS leverages the generalization power of pre-trained models and assesses source-target compatibility based on the pre-trained feature embeddings. We integrate PAS into a framework that indicates the most relevant pre-trained model and source domain among multiple candidates, thus improving target accuracy while reducing the computational overhead. Extensive experiments on image classification benchmarks demonstrate that PAS correlates strongly with actual target accuracy and consistently guides the selection of the best-performing pre-trained model and source domain for adaptation. 1 Introduction Figure 1: The Potential Adaptability Score (PAS) estimates the performance of adapting to an unlabeled target domain given a pre-trained feature extractor and a labeled source domain. It helps in the selection of the best pre-trained model and best source domain among many candidates and is highly correlated with the final target accuracy after domain adaptation. In many real applications, data is collected from diverse domains, e.g., data obtained from different equipment, collecting procedures, geographic locations, or periods in time. Such differences may lead to a distribution shift between the domains that must be assessed. Unsupervised domain adaptation is a paradigm where only unlabeled data is available for the domain of interest, the target domain. However, labeled data is obtained from a related source domain. One factor that affects the success of domain adaptation methods is the choice of the source domain data. Domain adaptation methods often rely on many assumptions about the relationship between source and target domains, like the existence of invariant discriminative features, the similarity of the label distribution, or the invariance of the task. Unfortunately, as the labels for the target samples are not available, such assumptions may not be verified in real applications for selecting the most appropriate source data. Violating the data assumptions and considering an irrelevant or distant source domain may introduce noise and conflicting patterns during the domain adaptation process. In the worst-case scenario, selecting an undesirable source domain may hurt the target domain performance, a scenario known as negative transfer 45 . If many source domains are available, it is reasonable to assume that not all of them may contribute equally to the target adaptation. Wisely selecting the source domain that may improve the performance on the target data while avoiding negative transfer is an essential requirement in many real-world applications. Another key factor that influences the domain adaptation performance is the choice of the pre-trained model. Pre-training on large-scale data allows the models to learn generic features and patterns that are often transferable across domains and tasks, making them valuable for domain adaptation. Recently, practitioners can choose from a vast number of publicly available pre-trained models, spanning diverse architectures and training paradigms. Each pre-trained model may have its own inductive bias and may capture distinct patterns in the data that may be more or less useful when transferring knowledge between domains. Figure 2: Source and target samples in the embedding space of a pre-trained model. (top left) Ideally, a target sample from a given class should be more similar, and hence closer in the embedding space of the pre-trained model, to a source sample from the same class. (top right) If new discriminative features need to be learned, the chances of overfitting on the source domain during adaptation increase. (bottom) Illustration of the distances from a target sample to all source class centroids. Our PAS score considers the relationship between distances d_{1} and d_{2} , which correspond to the shortest and second shortest distances, respectively. Despite the importance of selecting a suitable source data and a pre-trained model for the success of domain adaptation, it is still an underexplored topic. Current methods of transferability estimation aim to select the best pre-trained model for transfer learning. However, these methods are not applicable to the domain adaptation scenario since they require target labels 2 ; 24 ; 43 . One could employ such methods for selecting the best pre-training model using only the labeled source data and ignoring the unlabeled target data. Nevertheless, considering the target data is essential, as transferring to an easy target domain should lead to different results than transferring to a harder one. Another approach for the problem would be performing domain adaptation for each combination of available source domains and pre-trained models, and applying some model selection strategy 8 ; 44 ; 34 . However, this approach is very time-consuming since it needs to run a domain adaptation algorithm for each combination. A third approach would be to measure the distance between source and target feature distributions in the embedding space of the pre-trained model. This approach is also challenging as the popular metrics for the distance between two feature distributions are symmetric, e.g., Maximum Mean Discrepancy (MMD) 11 , Wasserstein distance 40 , and CORAL 33 . However, a metric suitable for our scenario should be asymmetric because transferring from an easy to a hard domain is more challenging than transferring from the harder domain to the easier one. In this work, we examine the interplay between the three key components in the domain adaptation setting for classification: (1) target data, (2) source data, and (3) the pre-trained model. We propose the Potential Adaptability Score (PAS) , a simple but effective novel measure to quantify the potential success of using a pre-trained model to transfer knowledge from a source domain to the target domain. Our experiments show how the PAS score is highly correlated to the final target accuracy after adaptation. To the best of our knowledge, this is the first proposal for transferability estimation for the domain adaptation setting. We demonstrate how PAS can help to select the most relevant source domain and/or pre-trained model among a set of candidates, indicating the options that are most likely to lead to the best accuracy on the unlabeled target data (See an overview in figure 1 .). Our framework selects the most suitable options before actually performing domain adaptation, demanding fewer computational resources and reducing the training time. PAS leverages the generalization power of models pre-trained on a large-scale dataset, such as the popular ImageNet-1k 6 . Specifically for domain adaptation, initializing with a good pre-trained model appears to be a fundamental step in achieving a good transferability between domains 27 ; 35 ; 15 ; 16 ; 36 . We assume that a good pre-trained model can extract general discriminative features that are robust across all domains. If this assumption is