AdvDINO: Domain-Adversarial Self-Supervised Representation Learning for Spatial Proteomics
Stella Su, Marc Harary, Scott J. Rodig, William Lotter · 2025
Read AdvDINO: Domain-Adversarial Self-Supervised Representation Learning for Spatial Proteomics by Stella Su, Marc Harary, Scott J. Rodig, William Lotter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04955.txt.
Introduction
Stella Su, Marc Harary, Scott Rodig, and William Lotter harden a self-supervised vision model against batch effects in cancer tissue images. Slides from different labs carry systematic quirks that can fool a model into learning the lab instead of the biology. Their fix adds a domain adversary to the DINOv2 training setup.
A gradient reversal layer punishes features that betray which slide an image came from. Trained on over five million tiles of lung tumor tissue stained for six markers, the model grouped cells into types with distinct protein profiles and survival links. A survival predictor built on top performed strongly, and the robustness carried to breast cancer slides.
Catalog record
| CREATOR | Stella Su, Marc Harary, Scott J. Rodig, William Lotter |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-04955
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AdvDINO: Domain-Adversarial Self-Supervised Representation Learning for Spatial Proteomics Stella Su, Marc Harary, Scott J. Rodig, William Lotter Abstract Self-supervised learning (SSL) has emerged as a powerful approach for learning visual representations without manual annotations. However, the robustness of standard SSL methods to domain shift—systematic differences across data sources—remains uncertain, posing an especially critical challenge in biomedical imaging where batch effects can obscure true biological signals. We present AdvDINO, a domain-adversarial self-supervised learning framework that integrates a gradient reversal layer into the DINOv2 architecture to promote domain-invariant feature learning. Applied to a real-world cohort of six-channel multiplex immunofluorescence (mIF) whole slide images from non-small cell lung cancer patients, AdvDINO mitigates slide-specific biases to learn more robust and biologically meaningful representations than non-adversarial baselines. Across > > 5.46 million mIF image tiles, the model uncovers phenotype clusters with distinct proteomic profiles and prognostic significance, and improves survival prediction in attention-based multiple instance learning. While demonstrated on mIF data, AdvDINO is broadly applicable to other imaging domains—including radiology, remote sensing, and autonomous driving—where domain shift and limited annotated data hinder model generalization and interpretability. Introduction Self-supervised learning (SSL) has emerged as a powerful framework for visual representation learning without annotated data, enabling models such as DINOv2 ( Oquab et al. 2024 ) to learn embeddings that facilitate diverse downstream tasks. However, common contrastive and autoencoding objectives may encourage SSL models to capture domain-specific confounders—arising from variations in acquisition conditions, imaging protocols, or data sources. These systematic variations, known as domain shifts, can undermine the robustness and generalizability of the resulting embeddings. Figure 1: Domain shift in mIF WSIs. Two lung tumor samples show substantial variation in staining intensity and contrast due to batch effects, highlighting the challenge of domain shifts in biomedical imaging. Improved methods for handling domain shift are especially needed for emerging biomedical imaging techniques like spatial proteomics. Named Nature’s Method of the Year in 2024, spatial proteomics involves imaging many protein biomarkers simultaneously in the same tissue sample, resulting in rich, multi-channel images. These techniques are increasingly used in oncology to interrogate the composition and spatial structure of tumors ( de Souza, Zhao, and Bodenmiller 2024 ) . After imaging a selected cohort of interest, a common workflow is to perform clustering to identify distinct subsets within the cohort, and then assess associations between these clusters and patient outcomes. While clustering is traditionally performed using hand-engineered features (e.g., counts of different cell types), SSL applied to the original images offers a promising data-driven solution. However, domain shift is a critical challenge—staining intensity, contrast, and signal distribution can vary dramatically between samples due to run-to-run variability (Figure 1 )—which can obscure true biological signals. To address this challenge, we propose AdvDINO, a domain-adversarial SSL framework that integrates a gradient-reversal-based domain discriminator into DINOv2. During pretraining, AdvDINO discourages the student encoder from capturing domain-identifiable features, while preserving semantic features that support downstream tasks. While broadly applicable, we demonstrate the effectiveness of AdvDINO in spatial proteomics using a unique cohort of 435 lung cancer whole slide images (WSIs) with > 5.46 million multi-channel image tiles. We perform unsupervised clustering on the tile-level embeddings learned by AdvDINO, and assess the biological and prognostic relevance of the resulting clusters. Towards direct prognostication, we apply attention-based multiple instance learning (ABMIL) to predict patient survival at the slide level. We find that the model outperforms traditional hand-engineered metrics and that the domain-adversarial loss results in biologically-meaningful clusters that are shared across samples. Together, these tasks highlight the robustness, interpretability, and downstream utility of AdvDINO. Related Work and Background SSL for Visual Representation Learning. SSL has shown strong performance in representation learning by leveraging pretext tasks that do not require manual labels. DINO ( Caron et al. 2021 ) and its successor DINOv2 ( Oquab et al. 2024 ) use a teacher–student framework with architectural asymmetry and knowledge distillation to learn rich image representations. DINOv2 enhances this framework through large-scale, diverse data and auxiliary objectives such as masked image modeling, achieving strong results across a range of vision tasks. However, the robustness of SSL models to domain shift remains uncertain. For instance, recent studies have shown that DINOv2-trained models in computational pathology are susceptible to batch effects ( de Jong, Marcus, and Teuwen 2025 ; Kömen et al. 2024 ) . Domain Invariant Representation Learning. Domain-Adversarial Neural Networks (DANN) ( Ganin et al. 2016 ) introduced a gradient reversal layer to promote domain-invariant feature learning in supervised settings. While adversarial training has since been extended to various domain adaptation scenarios, many of these methods rely on task-specific supervision. Recent approaches like SASSL ( Rojas-Gomez et al. 2024 ) pursue domain invariance through data augmentation, using neural style transfer to improve feature robustness across domain variations. In contrast, AdvDINO integrates domain-adversarial learning directly into the self-supervised pretraining process. SSL in Biomedical Imaging. SSL has gained traction in biomedical imaging, where labeled data is often scarce. DINOv2 has been used to develop foundation models for H&E histopathology slides ( Chen et al. 2024 ; Xu et al. 2024 ; Vorontsov et al. 2024 ) and radiology images ( Pérez-García et al. 2025 ) , demonstrating success in downstream applications such as classification and segmentation. In histopathology, these models are designed to generate embeddings from image tiles extracted from H&E WSIs. Despite promising performance, recent work has suggested that these embeddings lack robustness to domain shifts, such as encoding clinical site-specific signatures ( de Jong, Marcus, and Teuwen 2025 ; Kömen et al. 2024 ) . Downstream Applications in Tissue Analysis. In biomedical imaging of tissue samples, clustering of tile-level embeddings has been used to uncover distinct histomorphological patterns, as demonstrated by Quiros et al. 2024 who trained a self-supervised model on unannotated H&E pathology slides and identified clusters linked to immune response, tumor grade, and patient outcomes. Similarly, deep multiple instance learning (MIL), particularly attention-based variants like ABMIL ( Ilse, Tomczak, and Welling 2018 ) , has been applied to survival prediction from H&E WSIs. However, these downstream tasks are highly sensitive to the quality and consistency of learned tile representations. Robustly scaling these approaches to spatial proteomics, which offers more detailed information than H&E, presents numerous challenges driven by its multi-channel nature and susceptibility to batch effects. Spatial Proteomics Image Analysis. Spatial proteomics techniques, especially those based on multiplex immunofluorescence (mIF), have been leveraged across many cancer types to quantify variations in the tumor microenvironment and identify features associated with patient outcomes ( de Souza, Zhao, and Bodenmiller 2024 ) . In mIF, a selected set of proteins are imaged with fluorescent markers in a tissue sample. Commonly, this process is performed on sampled regions of a tissue section in the form of a tissue microarray (TMA), which represents a small proportion of the entire WSI. The set of markers used can vary assay-to-assay depending on the clinical context and goal. Traditionally, hand-engineered metrics such as the counts of specific cell types have been used to analyze the resulting images ( Alessi et al. 2024 ) . Several recent works have applied deep learning to mIF, including graph neural networks based on cellular neighborhoods within a TMA ( Wu et al. 2022 ) . Harary, Allen, and Lotter 2024