Preserving Marker Specificity with Lightweight Channel-Independent Representation Learning

Simon Gutwein 1,2,3,, Arthur Longuefosse 4, Jun Seita 4, Sabine Taschner-Mandl 1, Roxane Licandro 3,7,8 · 2025

Read Preserving Marker Specificity with Lightweight Channel-Independent Representation Learning by Simon Gutwein 1,2,3,, Arthur Longuefosse 4, Jun Seita 4, Sabine Taschner-Mandl 1, Roxane Licandro 3,7,8 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-15410.txt.

Introduction

Simon Gutwein and four coauthors argue that tiny, separate models beat big fused ones at reading multiplexed tissue images. Such imaging measures dozens of protein markers per cell, yet most deep learning models fuse all channels early, assuming the markers share structure. The authors test whether keeping markers independent, in deliberately shallow networks, learns better representations.

On a Hodgkin lymphoma CODEX dataset with 145,000 cells and 49 markers, they compare early fusion CNNs with channel separated designs. Their shallow Channel Independent Model has only 5.5 thousand parameters. After contrastive pretraining and linear evaluation, early fusion models lost marker specific information and struggled with rare cells. Channel independent models, above all theirs, produced far stronger representations, stable across settings and across 49 and 18 marker versions. The result favors inductive bias over sheer scale.

Catalog record

CREATORSimon Gutwein 1,2,3,, Arthur Longuefosse 4, Jun Seita 4, Sabine Taschner-Mandl 1, Roxane Licandro 3,7,8
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-15410

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Preserving Marker Specificity with Lightweight Channel-Independent Representation Learning Simon Gutwein 1,2,3,, Arthur Longuefosse 4, Jun Seita 4, Sabine Taschner-Mandl 1, Roxane Licandro 3,7,8 Abstract Multiplexed tissue imaging measures dozens of protein markers per cell, yet most deep learning models still apply early channel fusion, assuming shared structure across markers. We investigate whether preserving marker independence, combined with deliberately shallow architectures, provides a more suitable inductive bias for self-supervised representation learning in multiplex data, than increasing model scale. Using a Hodgkin lymphoma CODEX dataset with 145,000 cells and 49 markers, we compare standard early-fusion CNNs with channel-separated architectures, including a marker-aware baseline and our novel shallow Channel-Independent Model (CIM-S) with 5.5K parameters. After contrastive pretraining and linear evaluation, early-fusion models show limited ability to retain marker-specific information and struggle particularly with rare-cell discrimination. Channel-independent architectures, and CIM-S in particular, achieve substantially stronger representations despite their compact size. These findings are consistent across multiple self-supervised frameworks, remain stable across augmentation settings, and are reproducible across both the 49 markers and reduced 18 markers settings. These results show that lightweight, channel-independent architectures can match or surpass deep early-fusion CNNs and foundation models for multiplex representation learning. Code is available at https://github.com/SimonBon/CIM-S \midlauthor 1 St. Anna Children’s Cancer Research Institute, Vienna, Austria 2 TU Wien, Institute of Visual Computing and Human-Centered Technology, CVL, Vienna, Austria 3 Medical University of Vienna, Biomedical Imaging and Image-guided Therapy, Computational Imaging Research, ELIA Group, Vienna, Austria 4 RIKEN Center for Integrative Medical Sciences, Medical Data Deep Learning Team, Tokyo, Japan 7 Medical University of Vienna, Comprehensive Center for AI in Medicine, Vienna, Austria 8 Medical University of Vienna, Christian Doppler Lab for Mathematical Modelling and Simulation of Next-Generation Medical Ultrasound Devices, Vienna, Austria † † volume: – Under Review † † year: 2026 † † workshop: Full Paper – MIDL 2026 submission keywords layer Multiplex Imaging, Representation learning, Channel-Separated Architecture, Phenotyping 1 Introduction Multiplexed biological imaging (MI) technologies such as CODEX 14 , MxIF 12 , IMC 13 and MIBI 3 enable the quantification of a defined set of multiple protein markers at subcellular resolution in biological specimens. These images provide high-dimensional information on cell types, states, and spatial tissue organization. However, their interpretation depends on computational methods that can extract marker-specific spatial features and integrate them into biologically meaningful phenotypes. Existing pipelines rely on cell segmentation 27 ; 7 followed by aggregation of per-cell marker intensities or handcrafted features. This introduces substantial variability, propagates segmentation errors into downstream analyses 8 ; 5 , and limits representation learning to predefined features rather than learning directly from raw multiplex data. Recent advances in computational histopathology and biological imaging increasingly emphasize large-capacity architectures, including foundation models, under the assumption that scale alone improves representation quality 20 . While these models have been adapted for multiplex imaging 23 ; 26 , their designs typically retain early fusion, mixing marker channels from the first layer onward. This implicitly assumes inter-marker correlations that do not generally hold in MI, where each channel represents an independent molecular measurement. An alternative line of work, exemplified by NeXtMarker 17 , modifies convolutional architectures to maintain channel-separable computations in early layers, yielding interpretable feature spaces tuned to marker-specific biological structure. This architectural choice aligns with the recent multimodal learning theory showing that early fusion can induce modality collapse 9 ; 28 . When heterogeneous modalities are fused prematurely, predictive signals from weaker modalities become masked, gradients associated with these modalities diminish toward zero, and the model ultimately relies on only a subset of available inputs. In the context of multiplex imaging, such collapse implies that biologically essential markers may cease to contribute to learning, degrading both cell-type discrimination and phenotypic resolution. This challenge is amplified by the contrast with natural image data. In RGB images, channels are strongly correlated, and early fusion is a well-suited inductive bias that captures shared spatial structure 11 . In multiplexed microscopy, however, channels are statistically independent. Collapsing them at the first layer of a deep architecture mixes chemically distinct signals and can oversmooth the local marker patterns that define cellular phenotypes 19 . These findings support the view that cellular phenotypes are driven by local stoichiometric patterns rather than deep hierarchical abstractions, meaning that early mixing is the main source of degradation. Motivated by these observations, we hypothesize that preserving marker independence in early layers is a critical architectural inductive bias for multiplex imaging, potentially more important than increasing model scale. We adopt a shallow channel-independent architecture that maintains separable per-marker processing throughout early feature extraction, that enables investigation of how architectural bias influences representation quality, independent of parameter count or model depth. We evaluate our hypothesis in supervised and self-supervised settings using a publicly available CODEX dataset of classical Hodgkin lymphoma, and benchmark against both channel-aware and early-fusion CNNs as well as a recent foundation-scale proteomics model trained on tens of millions of image patches. In addition, we assess whether channel-aware embeddings facilitate interpretable, segmentation-free phenotyping through Layer-wise Relevance Propagation (LRP) 4 . This work’s contributions can be summarized as follows: 1. Systematic study of the relationship between early channel independence and representational quality in multiplex imaging. 2. Investigation of architectural inductive bias versus model scale, addressing whether compact architectures can match large pretrained models in this domain. 3. An evaluation of how architectural design affects marker retention and rare-cell discrimination across full multiplex panels. 4. A feasibility demonstration of segmentation-free phenotyping enabled by interpretable spatial relevance patterns. 2 Methods Our goal is to evaluate whether preserving marker-wise independence in early layers provides a more suitable inductive bias for multiplex image representation learning than a conventional early-fusion CNN design. To enable a controlled comparison, we construct a deliberately shallow channel-independent architecture in which per-marker structure is retained throughout early feature extraction while keeping overall capacity low. Channel-Independent Model (CIM) The CIM encoder architecture processes multiplex images using a channel-independent design. The backbone begins with a grouped convolution where the number of groups equals the number of input markers. This enforces strict per-marker processing: each marker is handled by its own set of filters, with no cross-marker mixing. To provide sufficient representational capacity under this constraint, each marker is expanded into a k -dimensional feature space, defined as the width. For each input channel x_{c} , where c\in\{1,2,\ldots,C\} and C denotes the number of markers in the dataset, the layer learns a marker-specific bank of k filters, \mathcal{W}_{c}=\{w_{c,1},\ldots,w_{c,k}\} , to produce a dedicated feature block: z_{c}=x_{c}*\mathcal{W}_{c}. This projection yields C\times k feature maps, organized in such a way, that each marker contributes exactly k independent channels. Early feature extraction is performed by a stack of lightweight blocks that preserve this channel independence. Each block includes a depthwise 3{\times}3 convolution for spatial filtering, a squeeze-and-excitation module 18 that re-weights markers without mixing them, and a grouped 1{\times}1 convolution to refine features within each marker’s subspace. After these blocks, global average pooling produces a compact representation. All cross-marker fusion is deferred to the final projection or classifier head, ensuring that early layers learn marker-specific structures and enabling a controlled comparison to early-fusion CNNs. Shallow Configuration (CIM-S) We adopt a minimal configuration, CIM-S ( N=1 , k=4 , \sim 5.5k parameters), to isolate architectural

Read the complete text