Using Deep Learning Models Pretrained by Self-Supervised Learning for Protein Localization

Ben Isselmann, Dilara Göksu, Heinz Neumann, Andreas Weinmann · 2026

Read Using Deep Learning Models Pretrained by Self-Supervised Learning for Protein Localization by Ben Isselmann, Dilara Göksu, Heinz Neumann, Andreas Weinmann (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10970.txt.

Introduction

Isselmann and three colleagues test whether self-supervised models pretrained on ImageNet-1k and on HPA fields of view transfer to protein localization in microscopy. Microscopy datasets are small, and staining and channel setups vary across datasets. They test OpenCell embeddings, with and without tuning, under two channel-mismatch strategies and varied tuning data amounts. DINO-based vision transformers transfer well even without fine-tuning. Fine-tuning lifts performance across seventeen classes, and the HPA single-cell model gives the best single-cell results.

Catalog record

CREATORBen Isselmann, Dilara Göksu, Heinz Neumann, Andreas Weinmann
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57131
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10970

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Using Deep Learning Models Pretrained by Self-Supervised Learning for Protein Localization Ben Isselmann, Dilara Göksu, Heinz Neumann, Andreas Weinmann Abstract Background: Task-specific microscopy datasets are often small, which makes it difficult to train deep learning models that learn robust and meaningful features. While recent advances in self-supervised learning (SSL) have shown promise, particularly through pretraining on large, domain-specific datasets, the generalizability of these models across datasets with differing staining protocols, imaging modalities, and channel configurations is not well explored. Yet this cross-domain transferability is crucial, especially for small-scale studies that cannot afford to generate large annotated datasets. Concretely, to investigate the generalizability of pretrained SSL models based on ImageNet-1k and HPA FOV, we evaluated their embeddings on OpenCell data, with and without fine-tuning. We assessed the quality of these embeddings by training a supervised classification head to predict protein localization, and we further examined two strategies for handling channel mismatches between datasets as well as the amount of task-specific data required for effective fine-tuning. We additionally analyzed single-cell embeddings by labeling a subset of OpenCell masks to assess whether the learned features capture biologically meaningful protein localization patterns. Result: Our results demonstrate that DINO-based ViT backbones pretrained on either HPA FOV or ImageNet-1k transfer well to OpenCell, even without any fine-tuning. Among all backbones, the model pretrained on the microscopy-specific HPA FOV data achieved the highest test scores in this zero-shot setting, with a mean macro F 1 F_{1} score of 0.822 ± \pm 0.007, compared to both ImageNet-1k-pretrained backbones and a ViT trained from scratch on OpenCell. When the same backbone was further fine-tuned on the OpenCell dataset, performance increased to a macro F 1 F_{1} score of 0.860 ± \pm 0.013, highlighting that domain-related pretraining can improve protein localization in fluorescence microscopy. At the single-cell level, we further demonstrate the benefit of domain-specific pretraining for DINO-based ViT backbones, as embeddings from the HPA single-cell pretrained model achieved the highest k k -nearest neighbor performance across neighborhood sizes (macro F 1 ≥ F_{1}\geq 0.796), compared with alternative ViT backbones pretrained on HPA FOV or ImageNet-1k. Conclusion: These findings suggest that self-supervised methods like DINO, when pretrained on large, domain-relevant datasets, can enable effective use of deep learning–derived features for fine-tuning on small, task-specific microscopy datasets. keywords Fluorescence microscopy, Self-supervised learning, Transfer learning, Protein subcellular localization, Channel handling 1 Background The analysis of human cells provides a crucial view into the molecular mechanisms underlying diseases and enables the identification of potential drug target references. Advances in high-throughput technologies have made it possible to investigate cellular function at an unprecedented scale 21 ; 29 ; 6 ; 2 ; 43 . In particular, transcriptomic profiling offers critical insights into gene function and regulation by analyzing RNA expression patterns, complementing genomics, which focuses on identifying mutations and structural variations 19 . However, these molecular approaches lack spatial resolution and morphological context. This limitation has led to the rise of image-based profiling, which enables the quantification of complex phenotypes and the assessment of treatment effects at the cellular level 28 ; 16 ; 37 . Advances in high-throughput microscopy and multiplex staining protocols now allow systematic study of subcellular structures and protein localization across large-scale perturbation screens 35 ; 42 ; 4 . Motivated to standardize image-based profiling, researches developed and still further develop the Cell Painting protocol 17 ; 5 , a high-throughput staining method designed to extract rich, quantitative cell profiles. The stained and fixed cells are imaged across five microscopy channels. The recently optimized protocol 13 highlights Cell Painting as the state-of-the-art assay for morphological profiling and provides a robust framework for the systematic analysis of cellular phenotypes. Inspired by the initial Cell Painting assay, both academia and the pharmaceutical industry generated several publicly available datasets. Most notable, the JUMP-CP consortium recently released the largest publicly accessible Cell Painting dataset to date, comprising images from over 116,000 chemical perturbations 9 . While Cell Painting focuses on broad morphological profiling through organelle-level staining, other efforts have extended this idea toward protein-specific localization. Among them, the Human Protein Atlas (HPA) 41 adopts a more targeted approach using antibodybased immunofluorescence. Each HPA image includes three fixed reference channels: DAPI for the nucleus, \beta -tubulin as a cytoskeletal marker for microtubules, and calreticulin to label the endoplasmic reticulum (ER). These markers provide structural context for a fourth channel, which visualizes the protein of interest (POI) through antibody-based staining. In addition to the Human Protein Atlas, OpenCell 12 is a large-scale imaging project with the goal of providing a high-confidence, artifact-free map of protein localization in human cells. Unlike antibody-based approaches, OpenCell uses CRISPR-mediated genome editing to endogenously tag proteins with fluorescent labels, enabling direct visualization of native protein distribution within cells. Alongside the protein of interest (POI), the nucleus is visualized using Hoechst 33342 staining in a second imaging channel. A central challenge in image-based profiling is the generation of meaningful and robust feature representations. While traditional bio-imaging tools provide handcrafted features 8 , their interpretability comes at the cost of flexibility and scalability. Here, Deep learning (DL) offers a powerful alternative by learning task relevant representations directly from raw image data, reducing the need for manual feature engineering 25 ; 34 . The use of deep learning models is often limited by their reliance on large annotated datasets, which are costly to generate and inherently restricted in their biological and experimental coverage. Recent studies have shown that self-supervised learning (SSL) can alleviate this bottleneck by learning transferable representations directly from unlabeled data 23 ; 14 . Among them, Doron et al. 14 evaluated a self-supervised method known as DINO (self-distillation with no labels) 7 , employing a Vision Transformer (ViT) 15 as an encoder to extract biologically meaningful features across three publicly available imaging datasets with diverse biological focuses. In fluorescence microscopy, SSL has also been reported to reduce sensitivity to batch effects 44 , promoting more generic and transferable feature representations. Beyond DINO, other SSL approaches such as masked autoencoders (MAE) have been proposed; for example, the study in 23 compared several SSL models and demonstrated their effectiveness for morphological profiling and generalizability without fine-tuning, with only a small performance gap relative to supervised approaches. Recent efforts have focused on training more generic and transferable models that can accommodate heterogeneous channel configurations. Channel-adaptive approaches learn joint representations of multi-channel microscopy images by introducing channel embeddings and forming sequences of channel-aware patch tokens in ViT-based architectures 3 ; 33 . In contrast, channel-agnostic approaches expose the model to each channel separately during SSL training, aiming to learn representations that transfer across channel types without explicit channel conditioning 26 ; 1 . Despite these efforts and the demonstrated benefits of SSL, the practical reuse of pretrained models with a fixed input-channel configuration on small, task-specific datasets remains underexplored. In many scenarios, such datasets differ moderately from the pretraining distribution, yet share a subset of semantically related channels (e.g., nuclear markers such as DAPI or Hoechst, or channels encoding the protein of interest). For such settings, several concrete questions remain underexplored: (i) How do fixed-channel SSL-based ViT-backbones benefit from pretraining on large datasets (natural images vs. domain-specific fluorescence) with and without any fine-tuning? (ii) How

Read the complete text