Ensemble of Small Classifiers For Imbalanced White Blood Cell Classification

Siddharth Srivastava, Adam Smith, Scott Brooks, Jack Bacon, Till Bretschneider · 2026

Read Ensemble of Small Classifiers For Imbalanced White Blood Cell Classification by Siddharth Srivastava, Adam Smith, Scott Brooks, Jack Bacon, Till Bretschneider (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20856.txt.

Introduction

Srivastava and co-authors classify white blood cells with a light ensemble of small image models. Sorting these cells by hand is slow, and rare cell types are hard to classify well. Their system mixes three small pretrained models: SwinV2-Tiny, DinoBloom-Small, and ConvNeXT-V2-Tiny. They train three copies of each model and average the outputs. Added training data helps ease class imbalance. The authors report strong results on a hard blood cell data set. They also study errors, such as confusion between myelocytes and lymphocytes.

Catalog record

CREATORSiddharth Srivastava, Adam Smith, Scott Brooks, Jack Bacon, Till Bretschneider
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15095
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.20856

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ensemble of Small Classifiers For Imbalanced White Blood Cell Classification Siddharth Srivastava, Adam Smith, Scott Brooks, Jack Bacon, Till Bretschneider Abstract Automating white blood cell classification for diagnosis of leukaemia is a promising alternative to time-consuming and resource-intensive examination of cells by expert pathologists. However, designing robust algorithms for classification of rare cell types remains challenging due to variations in staining, scanning and inter-patient heterogeneity. We propose a lightweight ensemble approach for classification of cells during Haematopoiesis, with a focus on the biology of Granulopoiesis, Monocytopoiesis and Lymphopoiesis. Through dataset expansion to alleviate some class imbalance, we demonstrate that a simple ensemble of lightweight pretrained SwinV2-Tiny, DinoBloom-Small and ConvNeXT-V2-Tiny models achieves excellent performance on this challenging dataset. We train 3 3 instantiations of each architecture in a stratified 3 3 -fold cross-validation framework; for an input image, we forward-pass through all 9 9 models and aggregate through logit averaging. We further reason on the weaknesses of our model in confusing similar-looking myelocytes in granulopoiesis and lymphocytes in lymphopoiesis. Code: https://gitlab.com/siddharthsrivastava/wbc-bench-2026 1 Introduction Haematological image analysis is clinically important for the early diagnosis of Leukaemia, a group of cancers originating in the bone marrow, which lead to an overproduction of abnormal white blood cells (WBC). Traditional diagnosis often relies on microscopic examination performed by a human expert, which is resource intensive and time consuming. Automatic WBC classification promises a low resource alternative for the detection of rare blood cells. Some methodologies are emerging, but still require further validation before they can be put to clinical use, specifically in terms of their robustness [ 16 ] . The ISBI WBCBench 2026: Robust White Blood Cell Classification challenge [ 19 ] was created to benchmark machine learning models for classifying white blood cells into 13 classes. These classes represent the development of WBCs through Haematopoiesis along three major branches that produce the broader classes of granulocytes, monocytes and lymphocytes. [ 6 ] . Despite advances in deep learning models for cell classification [ 18 ] , this problem remains challenging due to inherent limitations in training data, such as noise, stain variation and class imbalance. To address this we propose an ensemble of lightweight classifiers to achieve near state-of-the-art performance with limited compute. 2 Dataset 2.1 Dataset Expansion Figure 1 : Example phase 1 (unperturbed) images for each class from the WBCBench competition dataset. Figure 2 : Number of samples per class in our expanded dataset. The challenge dataset (WBCBench [ 19 ] ) consists of 55,012 H&E stained peripheral blood smear images of size 368\times 368 across 13 classes, capturing all cell types found during Haematopoiesis: segmented neutrophils (SNE), lymphocytes (LY), monocytes (MO), blast cells (BL), eosinophils (EO), myelocytes (MY), band-form neutrophils (BNE), variant (atypical) lymphocytes (VLY), metamyelocytes (MMY), promyelocytes (PMY), plasma cells (PC), and prolymphocytes (PLY); Figure 1 showcases example images from each class. 16,477 images are unlabelled and reserved for testing, leaving 38,535 annotated images for model training. The dataset is highly imbalanced, with SNE and LY classes together comprising 28,155 of the images, and the two least-represented classes, PC and PLY, only 90 and 14 , respectively. Therefore, we expanded the dataset using external public datasets: • Acevedo-20 [ 1 ] : Over 17,000 images, of which we use 10,312 images from the following classes: MO (1420), EO (3117), BNE (1633), PMY (592), BA (1218), MY (1137) and MMY (1015); • Blood_dataset by Taeyeon Kim [ 7 ] , originally developed as the Blood 8 classes dataset [ 17 ] : Over 46,000 images from 8 classes, of which we only use 2895 plasma-cell images. • Prolymphocyte images from CellWiki [ 3 ] : 18 additional prolymphocyte examples bring the total number of PLY instances to 32 . In total, we include additional 13,045 training examples, alleviating some of the most severe class imbalances in the original dataset (per-class frequencies shown in Figure 2 ). We showcase that adding external public data results in a more robust model in Table 1 . To emulate real-world domain shift in scanner and stain variability, WBCBench introduces augmentations in the form of Gaussian noise, motion blur and colour perturbations. While motion blur and colour perturbations can be addressed through train time augmentations, we tackle noise degradation adaptively with non-local means denoising [ 2 ] estimating Gaussian noise using a robust wavelet-based estimator for the standard deviation, \hat{\sigma} [ 5 ] . The patch distance for denoising is set to \sqrt{\hat{\sigma}} . We empirically find this setup retains the fine-grained morphological detail of clean images while sufficiently denoising the noisy images. The extreme class imbalance in the training dataset necessitates the use of a weighted sampler when sampling batches for training, such that rare classes are sampled at the same rate as the most common classes. Thus, we weight each class based on the effective number E_{n} [ 4 ] : E_{n}=(1-\beta^{n})/(1-\beta), n being the class size, and \beta=0.9999 a hyperparameter. 3 Method Figure 3 : Model architecture. Left: our model consists of a 3 -ensemble of 3 different architectures: a ConvNeXT-V2 Tiny [ 20 ] , a SwinV2-Tiny [ 10 ] , and a DinoBloom-Small [ 8 ] model. In each, we replace the pretrained classification head with a simple MLP h . Each instantiation of an architecture is fined-tuned independently on 2 out of 3 folds of data and validated on the last fold to mitigate overfitting, giving 3 models for each architecture and a total of 9 models. The final model \mathcal{M} passes an input image through all 9 architectures and averages the logits to produce the 13 -class logit vector. Right : At inference, we generate multiple augmented views of each image via random flips and rotations. These views are independently processed by \mathcal{M} and their logits are averaged to obtain the final class prediction. 3.1 Model Architecture We outline our model architecture in Figure 3 , which consists of instantiations of 3 pretrained classifiers highlighted below: • Swin Transformer V2 [ 10 ] : a hierarchical vision transformer whose representation is composed of non-overlapping shifted windows. Swin-V2 improves upon the original Swin transformer architecture [ 11 ] by introducing techniques to stabilise training, better handling of differing image resolutions and a new pretraining method to reduce the amount of training data. We use swinv2-tiny , which consists of 27.5M parameters, and replace the classification head with a small MLP, giving a total of 28.1 M parameters. • ConvNeXT-v2 [ 20 ] : a pure convolutional neural network that improves upon ResNets by using LayerNorm layers in place of BatchNorm layers, GELU instead of ReLU, and fewer activation functions [ 12 ] . ConvNeXT-V2 improves upon the original ConvNeXT by using a fully convolutional masked autoencoder framework and a global response normalisation layer [ 20 ] . We use convnextv2-tiny and similarly replace the classification head with a MLP, giving a total of 28.4 M parameters. • DinoBloom [ 8 ] : a foundation model for single-cell haematology images built upon DINOv2 [ 15 ] . We use DinoBloom-Small with our own classification head, totalling 23 M parameters. The selected backbone models provide complementary inductive biases: SwinV2 is a transformer-based model using the hierarchical attention mechanism and shifted windows,

Read the complete text