Deep Joint Distribution Optimal Transport for Universal Domain Adaptation on Time Series
Romain Mussard, Fannia Pacheco, Maxime Berar, Gilles Gasso, Paul Honeine · 2025
Read Deep Joint Distribution Optimal Transport for Universal Domain Adaptation on Time Series by Romain Mussard, Fannia Pacheco, Maxime Berar, Gilles Gasso, Paul Honeine (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11217.txt.
Introduction
Romain Mussard and four co-authors adapt time series models across domains whose classes only partly overlap. Their paper appeared in two thousand twenty-five. Universal domain adaptation must share known classes and spot new ones. For time series, few tailored methods exist. Standard tricks threshold a confidence score to flag unknowns. Thresholds are brittle, and scores run overconfident on new classes. Errors follow from both of those flaws.
Their UniJDOT method builds unknown samples into an optimal transport cost. Transport then aligns only what should be aligned. A joint decision space sharpens the known-unknown split. No hand-set threshold carries the whole burden. Time series from sensors and signals gain a safer transfer method. Changing factories and hospitals are natural homes.
Catalog record
| CREATOR | Romain Mussard, Fannia Pacheco, Maxime Berar, Gilles Gasso, Paul Honeine |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11217
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Joint Distribution Optimal Transport for Universal Domain Adaptation on Time Series Romain Mussard, Fannia Pacheco, Maxime Berar, Gilles Gasso, Paul Honeine Abstract Universal Domain Adaptation (UniDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain, even when their classes are not fully shared. Few dedicated UniDA methods exist for Time Series (TS), which remains a challenging case. In general, UniDA approaches align common class samples and detect unknown target samples from emerging classes. Such detection often results from thresholding a discriminability metric. The threshold value is typically either a fine-tuned hyperparameter or a fixed value, which limits the ability of the model to adapt to new data. Furthermore, discriminability metrics exhibit overconfidence for unknown samples, leading to misclassifications. This paper introduces UniJDOT, an optimal-transport-based method that accounts for the unknown target samples in the transport cost. Our method also proposes a joint decision space to improve the discriminability of the detection module. In addition, we use an auto-thresholding algorithm to reduce the dependence on fixed or fine-tuned thresholds. Finally, we rely on a Fourier transform-based layer inspired by the Fourier Neural Operator for better TS representation. Experiments on TS benchmarks demonstrate the discriminability, robustness, and state-of-the-art performance of UniJDOT. *1 keywords Universal Domain Adaptation,Time Series classification,Optimal transport,Auto-thresholding † † copyrightyear: 2022 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: Preprint version † † email: [email protected] † † address: Univ Rouen Normandie, INSA Rouen Normandie, Normandie Univ, LITIS UR 4108 † † corresp: Corresponding author. 1 Introduction Figure 1 : Overview of the proposed method: The source samples x_{s} and the target samples x_{t} are processed by the feature extractor g and the classifier f , resulting in a feature space representation g(x_{s}) (resp. g(x_{t}) ) and logits f(g(x_{s})) (resp. f(g(x_{t})) ). g(x_{s}) are stored in a classwise memory, while some of the g(x_{t}) serve as anchors in the alignment process after the pseudo-labelling step. The pseudo-labelling step relies on the target logits f(g(x_{t})) mitigated by a classwise distance of an entire batch to automatically label the target samples as common or unknown. The network is classically trained using a cross-entropy loss on the source samples and an alignment loss between the source and target samples. This alignment loss relies on optimal transport and takes into account the pseudo-labelling step as follows: common target samples are aligned with source samples (in blue ), while unknown target samples are aligned with anchors (in red ). Deep learning models have enabled significant improvements in Time Series (TS) classification, due to their powerful representational capabilities Ismail Fawaz et al. (2019) . However, most models suffer from a lack of generalization and can hardly be transferred from their training domain (the so-called source domain) to an unfamiliar, external domain (the target domain) Ragab et al. (2023) . This limitation is mainly caused by distribution shifts, a very common phenomenon in TS Zhang et al. (2023) ; Guo et al. (2023) . To address this problem, Unsupervised Domain Adaptation (UDA) attempts to find a domain-invariant feature space for labeled source samples and unlabeled target samples. Recently, several UDA algorithms have been benchmarked for TS tasks Ragab et al. (2023) , mainly using image processing architectures. The limited performance of UDA methods on TS datasets compared to their high accuracy on image tasks underscores the need for TS-specific architectures. Since Ragab et al. (2023) , many approaches have enhanced the performance of TS representation by identifying invariant temporal features specifically tailored for TS Liu et al. (2024) ; Ozyurt et al. (2023) ; Lee et al. (2024) ; Biswas and Tešić (2024) ; Painblanc et al. (2023) . For example, frequency-based features extracted from neural operators, such as Fourier Neural Operators (FNO) Li et al. (2020) , have improved domain-invariant representations and have been used for UDA on TS He et al. (2023) . The UDA framework actually covers a special case where the classes are the same in both domains (despite some small drift between domains) known as the closed-set assumption. Motivated by this limitation, Universal Domain Adaptation (UniDA) was introduced You et al. (2019) . In UniDA, the target domain remains unlabeled, certain classes are shared between the source and target domains, while others are exclusive to either domain. Unlike standard UDA, UniDA helps to discover unknown class samples that are unique to the target domain. This capability is crucial in TS classification, where identifying unseen patterns is often critical Zamanzadeh Darban et al. (2024) . UniDA encompasses two primary tasks: alignment of common classes across domains and isolation of unknown Out-Of-Distribution (OOD) samples. Several approaches have been developed to address both tasks using different strategies. The alignment module is usually a pre-existing UDA method that is slightly modified to account for unknown labels. For instance, UAN You et al. (2019) uses an adversarial UDA approach introduced in Ganin et al. (2016) ; Tzeng et al. (2017) , while DANCE Saito et al. (2020) adopts a similarity-based clustering approach inspired by Haeusser et al. (2017) . Similarly, PPOT Yang et al. (2023) and UniOT Chang et al. (2022) align source and target common samples using Optimal Transport (OT) Villani et al. (2009) , as proposed in Damodaran et al. (2018) ; Fatras et al. (2021) . Alternatively, UniAM Zhu et al. (2023) introduces a novel alignment framework leveraging sparse data representation and Vision Transformer (ViT) architectures. On the other hand, the cited approaches rely on OOD detection methods that are highly threshold-dependent. These methods aim to separate common from unknown samples by thresholding discriminability metrics such as entropy Saito et al. (2020) ; You et al. (2019) , OT masses Yang et al. (2023) ; Chang et al. (2022) , reconstruction error Zhu et al. (2023) , or combinations of metrics Fu et al. (2020) . The threshold value is typically either a fine-tuned hyperparameter You et al. (2019) ; Saito et al. (2020) ; Yang et al. (2023) ; Zhu et al. (2023) or a fixed value Chang et al. (2022) determined from a dataset. However, as shown in experiments in Section 4 , the optimal threshold often varies between datasets and across tasks. Nevertheless, most previous approaches rely on robust state-of-the-art alignment modules to address the inefficiencies in OOD detection caused by rigid threshold definitions. These approaches fail to consider that inadequate OOD detection can compromise the performance of the alignment module. In consequence, these observations highlight the need for a dynamic threshold selection to better adapt UniDA methods to different datasets. Few approaches attempt to address the dynamic nature of the threshold value. For example, TNT Chen et al. (2022) computes a task-specific threshold, but this computation is based solely on the source dataset. Domain shifts may render such computations ineffective on the target dataset. Moreover, OVANet Saito and Saenko (2021) employs a One-vs-All strategy that eliminates the need for a threshold to distinguish common from unknown samples Padhy et al. (2020) . In addition to the challenge of defining a threshold, CMU Fu et al. (2020) states that relying on a single discriminability metric for OOD detection (such