Divide and Conquer Self-Supervised Learning for High-Content Imaging

Lucas Farndale, Paul Henderson, Edward W Roberts, Ke Yuan · 2025

Read Divide and Conquer Self-Supervised Learning for High-Content Imaging by Lucas Farndale, Paul Henderson, Edward W Roberts, Ke Yuan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07444.txt.

Introduction

Lucas Farndale, Paul Henderson, Edward Roberts, and Ke Yuan introduced SpliCER in twenty twenty-five, a self-supervised learning method that refuses to take shortcuts. Representation learners often latch onto simple patterns and ignore subtle features — a serious flaw in scientific imaging, where the subtle features carry the discovery. High-content microscopy is exactly such a setting.

SpliCER splits each image into sections and distills information section by section, forcing the model to learn complex features without losing simple ones. It plugs into any self-supervised loss without modifying the host method. The authors first demonstrate that existing methods do learn shortcut solutions when easy and hard features coexist. SpliCER then delivered significant downstream gains in medical and geospatial imaging tests.

Catalog record

CREATORLucas Farndale, Paul Henderson, Edward W Roberts, Ke Yuan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07444

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Divide and Conquer Self-Supervised Learning for High-Content Imaging Lucas Farndale, Paul Henderson, Edward W Roberts, Ke Yuan Abstract Self-supervised representation learning methods often fail to learn subtle or complex features, which can be dominated by simpler patterns which are much easier to learn. This limitation is particularly problematic in applications to science and engineering, as complex features can be critical for discovery and analysis. To address this, we introduce Split Component Embedding Registration ( SpliCER ), a novel architecture which splits the image into sections and distils information from each section to guide the model to learn more subtle and complex features without compromising on simpler features. SpliCER is compatible with any self-supervised loss function and can be integrated into existing methods without modification. The primary contributions of this work are as follows: i) we demonstrate that existing self-supervised methods can learn shortcut solutions when simple and complex features are both present; ii) we introduce a novel self-supervised training method, SpliCER, to overcome the limitations of existing methods, and achieve significant downstream performance improvements; iii) we demonstrate the effectiveness of SpliCER in cutting-edge medical and geospatial imaging settings. SpliCER offers a powerful new tool for representation learning, enabling models to uncover complex features which could be overlooked by other methods. † † footnotetext: * These authors jointly supervised this work Figure 1 : SpliCER training architecture 1 Introduction Recent advances in our ability to acquire highly detailed, information-rich imaging at scale have resulted in high-content imaging – imaging which aims to maximise data capture – being widely used in science [ 59 ] , medicine [ 46 , 37 ] , and engineering [ 62 ] . In general, however, computer vision methods are designed for natural images such as ImageNet [ 11 ] , which can be well-described with relatively simple features [ 51 ] . High-content imaging, such as advanced medical imaging or satellite imagery, generally contains subtle or complex features which can be difficult to distinguish from noise without strong supervision. However, subtle or complex features can be among the most interesting features for scientific discovery, such as the interaction or morphology of subtly different cell types [ 23 ] , as simpler features are generally more readily discovered by humans. It is therefore essential that alternative methods for learning these features are explored and developed. A prime example is multiplex imaging. Unlike typical RGB images, these images contain more than three channels, each with a distinct meaning, creating significant variation in the complexity of the features in each channel. Despite their prevalence, multiplex images are generally understudied in computer vision, and largely lack dedicated methods to extract key information stored in them. The effect of this can be that some channels dominate the image, and models ignore features from subtler channels. In many cases, we can leverage an intuitive reason or some prior knowledge indicating that the features of a region or channel of an image are of particular interest, or could be ignored. It is usually possible to split the image into smaller components, perhaps by generating a segmentation mask or cropping the image, and this information could be used to guide the model to learn features from each component [ 13 , 14 , 15 , 39 ] . Ensuring features are distributed across all components could ensure that complex features which cluster in a certain component will be learned. However, we generally lack the methods to enable this type of divide and conquer strategy for high-content imaging. In this work we introduce a novel representation learning architecture, SpliCER , which deconstructs an image into components, and distils information from each component to direct models to learn features from each part, significantly improving representation learning and downstream performance. This forces the model to learn features from each component, meaning components with more complex or subtler features cannot be ignored. As this deconstruction is only performed during training, the encoder can then be used downstream without requiring deconstruction. SpliCER is able to utilise any self-supervised architecture or loss, so it is generally applicable across self-supervised methods. Figure 2 : Schematic of the benefits of SpliCER compared to mapping multiple inputs to a shared latent space. 2 Background and Related Work Self-supervised learning (SSL) uses inherent structure in data to learn useful representations without relying on manual labels. This is achieved using a proxy objective which directs the model to learn features satisfying certain conditions [ 50 ] , without prior knowledge of the desired downstream task(s). Recent work demonstrates that many of the most effective methods map multiple views of the same input into a joint embedding (JE) [ 19 ] , maximising the mutual information shared between views. Typically, this is achieved through augmenting the input to artificially create different views, with augmentations designed to avoid augmenting the key semantic features which the model should learn [ 2 ] . 2.1 Simplicity Bias and Domain Generalisation Representation learning relies on proxy metrics to determine which features should be learned. Typical methods seek to optimise desirable properties of the representation, such as maximising the mutual information between embeddings [ 9 , 42 ] , or minimising the covariance between features [ 6 ] . Simplicity bias [ 49 ] is the tendency of machine learning models to learn the simplest features required to satisfy any given objective [ 47 , 10 ] , deteriorating the quality of models’ learned representations. Models must seek to reduce redundancy in their representations so learning every possible complex feature is not possible, as these could be mostly noise. However, in many cases, learning the simplest features is a shortcut solution that neglects the complexity of the true underlying manifold [ 18 ] . The encoder architecture has been shown to have little effect on this bias [ 43 ] . A natural avenue for development is to incorporate additional sources of information into training which make it easier to identify these features. Whilst not explicitly designed to solve simplicity bias, recent work has established the effectiveness of this method, such as vision-language modelling [ 45 ] and knowledge distillation from paired data [ 14 ] . However, these additional sources of information may not always be available. Shortcut solutions are often exposed with transfer learning, as these features typically do not generalise as well as solutions which capture the complexity of the underlying manifold [ 55 ] . Sometimes simpler features are desirable in this setting, as they are usually more robust to minor changes in appearance. However, many simple features such as texture or background can be artefacts of a training set and consequently are harmful to domain generalisation. 2.2 Self-Supervised Learning Feature Complexity It has been shown that self-supervised models learn features with a variance greater than that imposed by the augmentation regime, as these are the only features which can be reliably predicted under augmentation [ 26 ] . In this setting, features which either only exhibit small changes in appearance or have larger, infrequent changes, will typically be very hard to differentiate from noise induced by augmentation. This reduces overfitting on trivial or undesirable features, but also results in models failing to learn the potentially

Read the complete text