C3R: Channel Conditioned Cell Representations for unified evaluation in microscopy imaging

Umar Marikkar, Syed Sameed Husain, Muhammad Awais, Sara Atito · 2025

Read C3R: Channel Conditioned Cell Representations for unified evaluation in microscopy imaging by Umar Marikkar, Syed Sameed Husain, Muhammad Awais, Sara Atito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18745.txt.

Introduction

Umar Marikkar, Syed Sameed Husain, Muhammad Awais, and Sara Atito present a framework for reading stained cell images across labs, in a research paper from 2025. Such images reveal fine cell structure, but staining recipes differ, so image sets arrive with different numbers and mixes of color channels. Models trained on one set often cannot even be tested on another.

Their idea splits channels into context channels, which frame the scene, and concept channels, which carry the target signal. An encoder and training scheme built on that split let one model judge both familiar and wholly new data sets. It beat existing benchmarks on both kinds, with no retraining.

Catalog record

CREATORUmar Marikkar, Syed Sameed Husain, Muhammad Awais, Sara Atito
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18745

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

C3R: Channel Conditioned Cell Representations for unified evaluation in microscopy imaging Umar Marikkar, Syed Sameed Husain, Muhammad Awais, Sara Atito Abstract Immunohistochemical (IHC) images reveal detailed information about structures and functions at the subcellular level. However, unlike natural images, IHC datasets pose challenges for deep learning models due to their inconsistencies in channel count and configuration, stemming from varying staining protocols across laboratories and studies. Existing approaches build channel-adaptive models, which unfortunately fail to support out-of-distribution (OOD) evaluation across IHC datasets and cannot be applied in a true zero-shot setting with mismatched channel counts. To address this, we introduce a structured view of cellular image channels by grouping them into either context or concept—where we treat the context channels as a reference to the concept channels in the image. We leverage this context-concept principle to develop Channel Conditioned Cell Representations (C3R), a framework designed for unified evaluation on in-distribution (ID) and OOD datasets. C3R is a two-fold framework comprising a channel-adaptive encoder architecture and a masked knowledge distillation training strategy, both built around the context-concept principle. We find that C3R outperforms existing benchmarks on both ID and OOD tasks, while a trivial implementation of our core idea also outperforms the channel-adaptive methods reported on the CHAMMI benchmark. Our method opens a new pathway for cross-dataset generalization between IHC datasets, without requiring dataset-specific adaptation or retraining. Figure 1 : The intrinsic separation of channels. Context channels serve as structural references and tend to exhibit high visual consistency across cells and datasets. Concept channels capture more variable, experiment-specific phenotypes, and exhibit greater diversity across instances. 1 Introduction Immunohistochemical (IHC) imaging provides fine-grained visualizations of cells at the subcellular level, making it a valuable source of information used for biomedical applications such as disease prediction and drug discovery. Recently, representation learning using IHC images has gained prominence through self-supervised learning (SSL), and learned cell image representations have been evaluated on both in-distribution (ID) and out-of-distribution (OOD) tasks [ 1 , 2 , 3 , 4 , 5 , 6 ] . However, unlike natural image datasets, IHC datasets differ in their immunofluorescent channel counts and configurations [ 7 , 8 , 9 ] . This poses a challenge for learning transferable representations, as typical vision encoders that build these representations operate under a fixed channel count. Existing studies address this either through model architecture or training strategy [ 10 , 11 , 12 ] , but these methods are constrained by the channel configurations seen during training. To address this, we first analyze the role of individual channels in IHC datasets and identify a natural division into two categories: context and concept [ 8 ] . Context channels offer structural reference information about the cell, such as nuclear shape or organelle organization. These channels are generally consistent and visually similar across images and datasets. In contrast, concept channels capture experiment-specific semantic information—like the subcellular location of a target protein in HPA [ 8 ] , or the response to a drug perturbation in JUMP-CP [ 9 ] . These channels are the primary focus of downstream analysis. This distinction between context and concept has been previously explored in medical imaging- in radiology where the ribcage serves as structural context in X-rays, and in histopathology where hospitals provide specific stain contexts [ 13 , 14 ] . In contrast, Fig. 1 shows that for IHC images, this separation is even clearer, as the channels themselves can be grouped as context and concept. On this insight, we introduce Channel Conditioned Cell Representations (C3R); to improve cell image representations and enable direct cross-dataset OOD evaluation. We propose a Context-Concept Encoder (CCE) architecture; that views cellular image channels as either context or concept, and processes these channels accordingly. The motivation of CCE stems from our hypothesis that the context group carries common information across datasets, hence learning the context separate from the concept yields transferable representations. We use these representations to perform zero-shot OOD evaluation without additional training. Moreover, we show that a naive implementation of our core idea- the architecture reduced to a single stem network- beats existing stem networks evaluated on the CHAMMI benchmark. In addition to CCE, we propose Masked Context Distillation (MCD); a training strategy that encourages concept channels to infer from limited context. We design MCD based on the premise that the elements in context channels are spatially coherent. For example, Fig. 1 shows that the intensity of the E.R channel is typically more prominent on the boundary of the Nucleus. Hence, the concept channel should be able to contribute to a strong global representation, given either of the context channels. The core contribution of C3R lies in its channel-adaptive encoder architecture and a novel context distillation strategy for SSL, outlined as follows: • Context-Concept Encoder (CCE): We introduce a channel-adaptive encoder, where based on the context-concept principle, a set group of channels are processed independently and then processed jointly. We use CCE for OOD evaluation across IHC datasets without requiring additional training, and we also show that the encoder outperforms existing ID and OOD baselines. • Masked Context Distillation (MCD): Based on the same principle, we propose a self-supervised learning strategy for momentum-based encoders, where the student learns from a subset of context channels while the teacher accesses the full context. We find that the use of MCD leads to significant gains in ID performance. 2 Related work 2.1 Representation learning for immunofluorescent images Recent advances in SSL for cell images span a range of approaches, from fully unsupervised methods to those incorporating weak or biological supervision. While some efforts focus on scaling models [ 15 , 16 , 17 ] , we focus on architectural and SSL design choices. Several studies demonstrate the potential of SSL methods to learn representations from cell images without relying on external labels. Kim et al. 2025 train encoders using SimCLR, DINO, and MAE [ 18 , 19 , 20 ] on the JUMP-CP dataset [ 9 ] , evaluating their learned features across diverse downstream tasks, where they find DINO to outperform other methods. Similar to Kim et al. 2025 , DINO4Cells [ 4 ] show that DINO learns unbiased cellular morphology features without domain-specific supervision, which is attributed to the zero-shot and linear probing capabilities inherent in clustering-based SSL methods like DINO and iBOT [ 21 ] . Here, the authors pre-train a separate model for each dataset to accommodate the different channel configurations. Other works [ 22 , 23 ] explore alternative SSL strategies using reconstruction-based objectives. Another subset of studies incorporate weak supervision to improve representations. CytoSelf [ 24 ] introduces a Protein ID-based loss within a VQ-VAE framework, while Set-DINO [ 25 ] leverages structured labels from Optical Pooled Screening (OPS). BIDCell [ 26 ] employs RNA-seq data to supervise representations for segmentation tasks. SubCell [ 5 ] uses a supervised contrastive loss, treating antibody-stained cells as positive pairs. Similar to DINO4Cells, their model is trained on the HPA dataset [ 8 ] , and is evaluated on both HPA (ID) and JUMP-CP (OOD) datasets [ 9 ] . To enable cross-dataset generalization, unlike DINO4Cells, Subcell pre-trains a new encoder on the same source dataset, with the channels adjusted to

Read the complete text