SIDDA : SInkhorn Dynamic Domain Adaptation for Image Classification with Equivariant Neural Networks

Aleksandra Ćiprijanović · 2025

Read SIDDA : SInkhorn Dynamic Domain Adaptation for Image Classification with Equivariant Neural Networks by Aleksandra Ćiprijanović (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14048.txt.

Introduction

Sneh Pandya and four co-authors adapt image classifiers across domains in twenty twenty-five. Neural networks falter under covariate shift, when test data comes from a different distribution. Labels still mean the same thing, but the inputs have changed style. Domain adaptation aims to learn features that ignore that change.

Their algorithm, SIDDA, aligns domains using the Sinkhorn divergence. It is built on equivariant neural networks for image classification. The selling point is minimal hyperparameter tuning and low computational overhead. Earlier adaptation methods often needed extensive tuning, which is costly. Tests ran on multiple simulated and real data sets. Readers in astronomy-adjacent machine learning get an out-of-the-box adaptation method that respects image symmetries.

Catalog record

CREATORAleksandra Ćiprijanović
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-14048

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SIDDA : SInkhorn Dynamic Domain Adaptation for Image Classification with Equivariant Neural Networks Aleksandra Ćiprijanović Abstract Modern neural networks (NNs) often do not generalize well in the presence of a “covariate shift”; that is, in situations where the training and test data distributions differ, but the conditional distribution of classification labels given the data remains unchanged. In such cases, NN generalization can be reduced to a problem of learning more robust, domain-invariant features. Domain adaptation (DA) methods include a broad range of techniques aimed at achieving this; however, these methods have struggled with the need for extensive hyperparameter tuning, which then incurs significant computational costs. In this work, we introduce SIDDA, an out-of-the-box DA training algorithm built upon the Sinkhorn divergence, that can achieve effective domain alignment with minimal hyperparameter tuning and computational overhead. We demonstrate the efficacy of our method on multiple simulated and real datasets of varying complexity, including simple shapes, handwritten digits, real astronomical observations, and remote sensing data. These datasets exhibit covariate shifts due to noise, blurring, differences between telescopes, and variations in imaging wavelengths. SIDDA is compatible with a variety of NN architectures, and it works particularly well in improving classification accuracy and model calibration when paired with symmetry-aware equivariant neural networks (ENNs). We find that SIDDA consistently enhances the generalization capabilities of NNs, achieving up to a ≈ 40 % \approx 40\% improvement in classification accuracy on unlabeled target data, while also providing a more modest performance gain of ≲ 1 % \lesssim 1\% on labeled source data. We also study the efficacy of DA on ENNs with respect to the varying group orders of the dihedral group D N D_{N} , and find that the model performance improves as the degree of equivariance increases. Finally, if SIDDA achieves proper domain alignment, it also enhances model calibration on both source and target data, with the most significant gains in the unlabeled target domain—achieving over an order of magnitude improvement in the expected calibration error and Brier score. SIDDA’s versatility across various NN models and datasets, combined with its automated approach to domain alignment, has the potential to significantly advance multi-dataset studies by enabling the development of highly generalizable models. … 0 0 footnotetext: [email protected] \ioptwocol 1 Introduction Deep neural networks (NNs) excel at extracting complex features from data, making them a powerful tool for a wide range of tasks, including classification, regression, and anomaly detection. Unfortunately, some extracted features can be very dataset-specific, which makes it challenging for NN models to generalize to data that differs from the training data, even when the differences are subtle. For instance, a significant drop in performance occurs when the input distribution changes between the training and test datasets, despite the conditional distribution of the labels given the inputs remaining the same — a scenario commonly referred to as a “covariate shift” ( Farahani et al., 2020 ; Liu et al., 2022b ) . Generalization allows models to perform well across diverse data domains, ranging from subtle variations in input distributions to entirely different datasets or environments. Differences between training and testing data can be due to data collection or quality ( Dodge and Karam, 2016 ) , distortions ( Gide et al., 2016 ) , image corruptions ( Ford et al., 2019 ) , or even single-pixel level differences, which can cause the NN to give inaccurate predictions ( Su et al., 2019 ) . Generalization capabilities, in turn, aid the efficiency and applicability of NNs in both science and industry, as they would otherwise need to be continually retrained on new data. For example, in astronomy, a generalized model trained on data from one telescope should accurately predict properties of data from another telescope that has different noise characteristics or resolution, significantly accelerating the process of identifying or characterizing celestial objects across surveys. Domain adaptation (DA) is a group of methods that aim to improve the generalization capabilities of NNs by enabling the NN to learn features in the data that persist across domains ( Wang and Deng, 2018 ; Wilson and Cook, 2020 ) . It is often applied to problems where one has access to labeled data from a “source” domain, but would also like the model to perform well on unlabeled “target” domain data. A large group of distance-based DA methods tackles the covariate shift problem by minimizing some distance metric between internal NN latent representations (distributions) of the source and target data. This, in turn, forces the NN to extract mainly domain-invariant features, which makes both latent data distributions well-aligned. Some well-known distance-based DA methods use maximum mean discrepancy (MMD) ( Gretton et al., 2008 ) , correlation alignment (CORAL) ( Sun et al., 2016 ) , contrastive domain discrepancy (CDD) ( Kang et al., 2019 ) , the Kullback-Leibler (KL) divergence ( Kullback and Leibler, 1951 ) , or the Wasserstein distance ( Panaretos and Zemel, 2018 ) , which is derived from the optimal transport (OT) ( Courty et al., 2014 ) theory for measuring distance between probability distributions. The theory is aimed at solving the OT problem, which includes determining the minimal cost of transporting a probability mass from one distribution to another, where the cost is defined by a chosen metric that measures the effort required to move it. OT thus provides a principled way to quantify the dissimilarity between distributions, capturing both the geometry of the space and the magnitude of the differences. In the sciences, NNs have made significant progress — from mapping the structure of biological proteins ( Jumper et al., 2021 ) to the cosmos ( Jeffrey et al., 2024 ) . In astronomy, astrophysics, and cosmology, the success is mainly due to the emergence of large datasets and high-fidelity simulations. Stage IV projects, such as the Vera Rubin Observatory Legacy Survey of Space and Time (LSST) ( Ivezić et al., 2019 ) , the Nancy Grace Roman Telescope ( Akeson et al., 2019 ) , and the Euclid mission ( Scaramella et al., 2022 ) , will yield an unprecedented amount of data that analysis pipelines must analyze efficiently. Simultaneously, there are many simulations of the Universe from sub-parsec to gigaparsec scales with magneto-hydrodynamic simulation suites, such as IllustrisTNG ( Nelson et al., 2021 ) and CAMELS ( Villaescusa-Navarro et al., 2021 ) , that can be used to prepare pipelines for the analysis of real data. Since simulation-trained models often exhibit a substantial drop in performance when applied to real data, there has been extensive work in implementing DA for astronomical applications: for galaxy morphology classification ( Ćiprijanović et al., 2022 ; Ćiprijanović et al., 2023 ) , classification of supernovae and identification of Mars landforms, ( Vilalta et al., 2019 ) , inference of cosmology ( Roncoli et al., 2023 ) , inference of strong gravitational lensing parameters ( Swierc et al., 2023 ; Agarwal et al., 2024 ) , constraining star formation histories of galaxies ( Gilda et al., 2024 ) , and gravitational lens finding ( Parul et al., 2024 ) . In astronomy, atmospheric distortion, telescope noise, PSF blurring, and data processing errors commonly affect data quality and contribute to the domain shift between simulated and real data.

Read the complete text