Semi-supervised Deep Transfer for Regression without Domain Alignment

Mainak Biswas, Ambedkar Dukkipati, Devarajan Sridharan · 2025

Read Semi-supervised Deep Transfer for Regression without Domain Alignment by Mainak Biswas, Ambedkar Dukkipati, Devarajan Sridharan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05092.txt.

Introduction

A model trained in one setting often fails when the data shift, and privacy rules may block access to the original training data. Mainak Biswas, lead author with two co-authors, develop a source-free transfer method for regression in a 2025 paper. Their setting also assumes only a few labelled target examples, with continuous outputs to predict.

Building on a contradistinguisher framework, their method CRAFT learns a shared model without aligning intermediate representations. They demonstrate it in two neuroscience settings, including gaze prediction from brain recordings. The approach adapts pretrained models flexibly where source data cannot be shared and labels are scarce.

Catalog record

CREATORMainak Biswas, Ambedkar Dukkipati, Devarajan Sridharan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-05092

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Semi-supervised Deep Transfer for Regression without Domain Alignment Mainak Biswas, Ambedkar Dukkipati, Devarajan Sridharan Abstract Deep learning models deployed in real-world applications (e.g., medicine) face challenges because source models do not generalize well to domain-shifted target data. Many successful domain adaptation (DA) approaches require full access to source data or reliably labeled target data. Yet, such requirements are unrealistic in scenarios where source data cannot be shared either because of privacy concerns or because it is too large and incurs prohibitive storage or computational costs. Moreover, resource constraints may limit the availability of labeled targets. We illustrate this challenge in a neuroscience setting where source data are unavailable, labeled target data are meager, and predictions involve continuous-valued outputs. We build upon Contradistinguisher (CUDA), an efficient framework that learns a shared model across the labeled source and unlabeled target samples, without intermediate representation alignment. Yet, CUDA was designed for unsupervised DA, with full access to source data, and for classification tasks. We develop CRAFT – a Contradistinguisher-based Regularization Approach for Flexible Training – for source-free (SF), semi-supervised transfer of pretrained models in regression tasks. We showcase the efficacy of CRAFT in two neuroscience settings: gaze prediction with electroencephalography (EEG) data and “brain age” prediction with structural MRI data. For both datasets, CRAFT yielded up to 9 % 9\% improvement in root-mean-squared error (RMSE) over fine-tuned models when labeled training examples were scarce. Moreover, CRAFT leveraged unlabeled target data and outperformed four competing state-of-the-art source-free domain adaptation models by more than 3 % 3\% . Lastly, we demonstrate the efficacy of CRAFT on two other real-world regression benchmarks. We propose CRAFT as an efficient approach for source-free, semi-supervised deep transfer for regression that is ubiquitous in biology and medicine. Keywords: source-free DA, continuous label prediction, gaze prediction, brain age prediction, healthcare 1 Introduction For the successful application of deep learning models in the real world, they must be robust to “domain shift” [ 50 ] . For example, in biology and medicine, supervised deep learning models are often trained on large, high-quality source datasets collected in resource-rich settings [ 39 , 11 ] . However, naive transfer or even simple finetuning fails to produce high accuracies when tested with smaller target datasets of mixed quality collected [ 45 , 2 ] . As a result, state-of-the-art domain adaptation (DA) approaches, which enable the source models to generalize successfully to target datasets, must be employed. Many of these approaches involve explicit alignment of source and target, while learning a shared predictive model for both domains [ 19 , 40 , 17 ] . A particular challenge occurs with DA when the source dataset is unavailable. This can happen either because of privacy or proprietary concerns, such as with medical images or patents [ 43 ] . Alternatively, source datasets may be too large, incurring prohibitive storage and computation costs in low-resource settings [ 39 ] . Source-free (SF) domain adaptation methods that address these challenges are getting increasingly popular [ 32 , 18 ] . Such methods generalize the source model to unlabeled or partially target data (unsupervised or semi-supervised DA) with one of two approaches: data-based or model-based. While data-based methods create surrogate source data, model-based methods adapt the source model to the target domain (see Section 2 ). We address model-based SF-DA in a semi-supervised setting. Specifically, we focus on neuroscience applications where source data are inaccessible, and target labels are reliably available only for a few samples. Regression tasks – like predicting brain age (Fig. 1 C) [ 39 ] , saccades [ 29 ] , neural activity [ 20 ] , and stimulus orientation [ 8 ] – are ubiquitous in neuroscience; we tackle a subset of these. We build upon Contradistinguisher [ 3 , 4 ] , a recently-proposed tool for effective unsupervised DA (CUDA). Unlike popular representation alignment DA methods [ 19 , 40 ] , CUDA directly learns a common model for both domains. Yet, CUDA requires full access to source data and addresses classification tasks. Therefore, it is not directly applicable to our problem. Here, we leverage CUDA to develop a new algorithm – Contradistinguisher-based Regularization Approach for Flexible Training (CRAFT) which performs deep transfer, without domain alignment, even when the source dataset is unavailable (Fig. 1 A-B). We also extend CUDA to a regression setting. Previous studies approach regression tasks naively by binning continuous labels into discrete bins [ 40 ] , sometimes employing a rank-ordinal objective [ 7 ] . Regardless, the efficacy of such approaches may depend critically on bin sizes. Our CRAFT model uses a principled approach to extend CUDA to predictions involving continuous-valued outputs. We employ binning as a practical strategy to generate and optimize pseudo-labels, without constraining the model to produce discrete outputs. Our study makes the following main contributions. Figure 1 : Schematic of Semisupervised Deep Transfer without Domain Alignment. ( A ) The approach seeks to transfer a pre-trained model to a target domain with limited labeled data when the source dataset is unavailable. ( B ) Because the source dataset is unavailable, we tune the decision boundaries without explicitly aligning the representation of the domains, combining a supervised loss and the CUDA loss (regularizer). ( C ) The algorithm targets deep transfer in regression tasks, like brain age prediction. • First, we extend CUDA to source-free DA for regression tasks involving continuous-valued outputs. • Second, we formulate a theoretically-motivated semi-supervised objective by combining supervised and unsupervised losses with a tunable hyperparameter ( \alpha ) (Section 3 ). We also derive the unsupervised loss as a maximum entropy prior to model parameters (Appendix A.2 ). • Third, we show the effectiveness of CRAFT on two neuroscience challenges – gaze prediction from electroencephalographic (EEG) [ 29 ] data and brain age prediction from magnetic resonance imaging (MRI) data [ 45 ] . • Fourth, we also apply CRAFT to two real-world regression benchmarks involving people counting [ 44 , 48 ] and tumor size prediction [ 16 , 6 ] . • Fifth, we compare CRAFT against state-of-the-art SF-DA methods [ 26 , 15 , 37 , 35 ] and show that the best improvements occur as unlabeled target samples increases, demonstrating its efficacy for semi-supervised SF-DA. • Finally, we analyze the computational complexity and demonstrate numbers competitive with sota models. • Our code is publicly available (see Appendix E.2 ). 2 Related Work Domain alignment methods. Popular Unsupervised Domain Adaptation (UDA) approaches rely on learning common intermediate representations across source and target domains. Domain Adversarial training of Neural Networks (DANN) [ 19 ] uses a discriminator to learn common representations across both domains adversarially. In Importance Weighting [ 40 ] (IW), higher importance is afforded to losses corresponding to source samples more likely to belong to the target domain. Central Moment Discrepancy (CMD) [ 17 ] minimizes the central moments of the latent representations between the domains, while others optimize their Maximum Mean Discrepancy (MMD) [ 34 , 22 ] . Despite being effective, they cannot be used when the source is unavailable and will not be discussed further. Source-free UDA. To address DA scenarios where source data and its target labels are unavailable, several source-free unsupervised

Read the complete text