Multi-Source Unsupervised Domain Adaptation with Prototype Aggregation
Min Huang, Zifeng Xie, Bo Sun, Ning Wang · 2024
Read Multi-Source Unsupervised Domain Adaptation with Prototype Aggregation by Min Huang, Zifeng Xie, Bo Sun, Ning Wang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16255.txt.
Introduction
Min Huang, Zifeng Xie, Bo Sun, and Ning Wang present a method that helps computer models adapt when data come from many sources, in work from 2024. A model trained in one setting often fails in a new one. Using several source settings can help, but past methods missed some key gaps.
Their method groups data around class prototypes, which are stand in points for each class. It scores how well each source should transfer and measures gaps class by class. It also deals with noisy labels guessed for the new setting. The aim is stronger, more reliable transfer to new data.
Catalog record
| CREATOR | Min Huang, Zifeng Xie, Bo Sun, Ning Wang |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-16255
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Source Unsupervised Domain Adaptation with Prototype Aggregation Min Huang, Zifeng Xie, Bo Sun, Ning Wang Abstract Multi-source domain adaptation (MSDA) plays an important role in industrial model generalization. Recent efforts on MSDA focus on enhancing multi-domain distributional alignment while omitting three issues, e.g., the class-level discrepancy quantification, the unavailability of noisy pseudo-label, and source transferability discrimination, potentially resulting in suboptimal adaption performance. Therefore, we address these issues by proposing a prototype aggregation method that models the discrepancy between source and target domains at the class and domain levels. Our method achieves domain adaptation based on a group of prototypes (i.e., representative feature embeddings). A similarity score-based strategy is designed to quantify the transferability of each domain. At the class level, our method quantifies class-specific cross-domain discrepancy according to reliable target pseudo-labels. At the domain level, our method establishes distributional alignment between noisy pseudo-labeled target samples and the source domain prototypes. Therefore, adaptation at the class and domain levels establishes a complementary mechanism to obtain accurate predictions. The results on three standard benchmarks demonstrate that our method outperforms most state-of-the-art methods. In addition, we provide further elaboration of the proposed method in light of the interpretable results obtained from the analysis experiments. † † highlights: Two prototype aggregation discrepancy metrics alleviate the pseudo-label noise. Realizing multi-source domain adaptation in a complementary adaptation mechanism. Quantifying the domain-transferability by a similarity score-based strategy. Experimental and theoretical analyses demonstrate the method’s efficacy. keywords Multiple source,Domain adaptation,Prototype learning,Prototype aggregation † † corresponding: Corresponding author. 1 Introduction Industrial data is generally characterized as large-scale, originating from various sources, and lacking labeling. Single-source domain adaptation (SDA) is an effective unsupervised learning technique that adapts an industrial model trained on one domain to an unknown domain. However, in multi-source scenarios, labeled industrial data originate from various sources and demonstrate diverse characteristics. More training data does not necessarily lead to better adaptation performance [ 22 ] . It is illogical to combine all labeled data into a single source and then apply the SDA method to establish distributional alignment. After realizing these problems, researchers proposed multi-source domain adaptation (MSDA) to extend domain adaptation to multiple source scenarios. MSDA is developed to enhance multiple distributional alignments and to mitigate various domain shifts [ 27 ] . Although many efforts surround the MSDA topic, three primary issues commonly arise. First, most MSDA methods [ 17 , 31 ] focus only on quantifying the domain-level discrepancies while disregarding the class-level discrepancies. Since the class proportions of source and target batches vary, these methods can lead to alignment between samples belonging to different classes. Second, unreliable pseudo-labels have been a long-standing problem for the class-level MSDA methods. On the one hand, incorrect pseudo-labels can lead to negative transfer [ 16 ] . On the other hand, excluding the noisy pseudo-labeled target samples [ 22 , 24 ] would hinder the knowledge extraction. Third, many MSDA efforts [ 26 , 22 ] treat each source domain without discrimination, but the common knowledge of each source domain is diverse. As depicted in Fig. 1 , when French serves as the target domain \mathcal{T} , the transferability of the source domain S_{1} (e.g., Spanish) and the source domain S_{2} (e.g., English) to target domains varies. Figure 1: Different transferability of source domains. To tackle these issues, this paper proposes a prototype aggregation method for multi-source domain adaptation (PAMDA). Due to the class disproportion of randomly sampled batches, a group of source prototypes (i.e., representative features) is generated for domain alignment. Since the target label information is agnostic, PAMDA leverages the source supervise knowledge to assign pseudo-labels to target samples. To avoid negative transfer from noisy pseudo-labels, we consider modeling the domain discrepancies at the class and domain levels for diverse confidence pseudo-labeled target samples. At the class level, we design a class-prototype aggregation discrepancy metric. PAMDA allocates high weights to the source class prototypes that are similar to the corresponding target features so that these source class prototypes can dominate the feature alignment. Such a design is conducive to transferring source-supervised knowledge that is similar to the target features to the target domain. At the domain level, we design a domain-prototype aggregation discrepancy metric. Similarly, through the weight assignment of PAMDA, the source domain prototypes similar to the noisy pseudo-labeled target features can dominate the feature alignment. Adaptation at the class and domain levels establishes a complementary mechanism where the class-prototype and domain-prototype aggregation discrepancy metrics complement each other. On the one hand, minimizing the class-prototype aggregation discrepancy metric can establish alignment for high-confidence pseudo-labeled target samples, thus facilitating the class-discriminability of the model. On the other hand, minimizing the domain-prototype aggregation discrepancy metric can establish alignment for low-confidence pseudo-labeled target samples, thus facilitating the model to produce more high-confidence pseudo-labels. The contributions in this work are summed up as: • We propose a prototype aggregation method to address three issues, e.g., the class-level discrepancy quantification, the unavailability of noisy pseudo-label, and source transferability discrimination. Furthermore, we first propose a complementary mechanism where the class-level and domain-level alignment methods can work together. • We propose a similarity score-based strategy to assess the transferability of source domains. Additionally, we design two prototype aggregation discrepancy metrics to quantify the cross-domain discrepancy at the class and domain levels. 2 Related Work 2.1 Single-source domain adaptation Over the past decade, SDA has been commended for its notable achievements. Previous SDA efforts can be categorized into two groups: discrepancy-based and adversarial-based. Discrepancy-based efforts model discrepancies between source and target domains, followed by minimizing inter-domain differences. The most widely used discrepancy metrics are maximum mean discrepancy (MMD) [ 5 ] , Kullback–Leibler divergence (K-L divergence) [ 20 ] , etc. Adversarial-based efforts [ 12 , 21 ] obfuscate the discriminator’s discrimination of the domain to which the sample belongs by training the feature extractor. 2.2 Multi-source domain adaptation MSDA expands the scope of domain adaptation algorithms to encompass multi-source scenarios. Initial efforts [ 1 , 15 ] proved a theorem that the target domain can be modeled as a source domain combination with a confirmed upper bound on error. Building upon the theorem, some efforts [ 23 , 22 ] attempt to combine the target-relevant source domains and filter out the irrelevant source samples. Nevertheless, these efforts can neither explore the class-specific semantic information nor make full use of source data. Some multi-model-based methods [ 26 , 17 ] establish the prediction alignment among multiple models. However, it is illogical to expect the models that have learned diverse source knowledge to produce identical predictions. Wang et al. [ 22 ] proposed a graph-structured method that forces the feature discrepancy between two arbitrary classes to be consistent across all domains. Two years later, they proposed another graphical method, i.e., Markov Random Field for MSDA (MRF-MSDA). Both graphical methods prioritize aligning reliable pseudo-labeled target samples yet filter out unreliable ones, causing the loss of source information. 3 Method 3.1 Problem description In the MSDA scenario, we suppose that there are N labeled source domain S=\{S_{j}|j=1,2,\ldots,N\} and one unlabeled target domain \mathcal{T} . Each domain exhibits different data characteristics. The j -th source domain S_{j}=\{(X_{S_{j}}^{(i)},Y_{S_{j}}^{(i)})|i=1,2,\ldots,n_{S_{j}}\} is a collection of n_{S_{j}} samples, where Y_{S_{j}}^{(i)}\in\left\{1,2,\ldots,K\right\} ( K