Is Synthetic Image Augmentation Useful for Imbalanced Classification Problems? Case-Study on the MIDOG2025 Atypical Cell Detection Competition
Leire Benito-Del-Valle, Pedro A. Moreno-Sánchez, Itziar Egusquiza, Itsaso Vitoria, Artzai Picón, Cristina López-Saratxaga, Adrian Galdran · 2025
Read Is Synthetic Image Augmentation Useful for Imbalanced Classification Problems? Case-Study on the MIDOG2025 Atypical Cell Detection Competition by Leire Benito-Del-Valle, Pedro A. Moreno-Sánchez, Itziar Egusquiza, Itsaso Vitoria, Artzai Picón, Cristina López-Saratxaga, Adrian Galdran (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02612.txt.
Introduction
Leire Benito-Del-Valle and six co-authors wrote a 2025 computational pathology study asking whether synthetic images help classify atypical dividing cells, a rare class in the MIDOG 2025 challenge. Real atypical examples are heavily outnumbered by normal ones.
Two backbones were compared: a ConvNeXt model pretrained on general images, and a histopathology vision transformer trained by self-supervision. The team generated extra atypical examples to balance classes, then trained with real data alone versus real plus synthetic. Five-fold validation gave both backbones strong ranking scores. The general model peaked slightly higher, while the domain model varied less between folds. Synthetic balancing brought no consistent gain. On a hidden out-of-distribution test slice, the general backbone led on ranking score.
Catalog record
| CREATOR | Leire Benito-Del-Valle, Pedro A. Moreno-Sánchez, Itziar Egusquiza, Itsaso Vitoria, Artzai Picón, Cristina López-Saratxaga, Adrian Galdran |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02612
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Is Synthetic Image Augmentation Useful for Imbalanced Classification Problems? Case-Study on the MIDOG2025 Atypical Cell Detection Competition Leire Benito-Del-Valle, Pedro A. Moreno-Sánchez, Itziar Egusquiza, Itsaso Vitoria, Artzai Picón, Cristina López-Saratxaga, Adrian Galdran Abstract The MIDOG 2025 challenge extends prior work on mitotic figure detection by introducing a new Track 2 on atypical mitosis classification . This task aims to distinguish normal from atypical mitotic figures in histopathology images, a clinically relevant but highly imbalanced and cross-domain problem. We investigated two complementary backbones: (i) ConvNeXt-Small, pretrained on ImageNet, and (ii) a histopathology-specific ViT from Lunit trained via self-supervision. To address the strong prevalence imbalance (9,408 normal vs. 1,741 atypical), we synthesized additional atypical examples to approximate class balance and compared models trained with real-only vs. real+synthetic data. Using five-fold cross-validation, both backbones reached strong performance (mean AUROC ≈ \approx 95%), with ConvNeXt achieving slightly higher peaks while Lunit exhibited greater fold-to-fold stability. Synthetic balancing, however, did not lead to consistent improvements. On the organizers’ preliminary hidden test set—explicitly designed as an out-of-distribution debug subset—ConvNeXt attained the highest AUROC (95.4%), whereas Lunit remained competitive on balanced accuracy. These findings suggest that both ImageNet and domain-pretrained backbones are viable for atypical mitosis classification, with domain-pretraining conferring robustness and ImageNet pretraining reaching higher peaks, while naive synthetic balancing has limited benefit. Full hidden test set results will be reported upon challenge completion. \leadauthor Leire Benito-Del-Valle Synthetic Image Augmentation for MIDOG 2025 keywords Atypical Mitosis classification | Histopathology | Domain shift | Data imbalance | Synthetic augmentation | MIDOG 2025 {corrauthor} [email protected] Introduction Counting mitotic figures is a long-standing prognostic marker in surgical pathology, but automated analysis is challenged by substantial domain shifts across tumor types, scanners, labs, and staining protocols. The MIDOG series of challenges was created to stress-test robustness and generalization in this setting; the 2025 edition adds a dedicated track for subtyping mitoses into normal vs atypical, a clinically relevant distinction linked to tumor aggressiveness . [MIDOG 2025 Nature] In the context of the MIDOG 2025 competition ( 1 ) , Track 2 (Atypical Classification) formalized the aforementioned task as binary patch-level classification of mitotic figures. Training data was released as a set of 128x128 crops derived from the MIDOG++ dataset [X], spanning nine domains (unique combinations of tumor type, species, scanner, and lab), with 10,191 normal and 1,748 atypical annotations. Evaluation emphasizes prevalence-robust performance via balanced accuracy (BA), reflecting that atypical mitoses occur at much lower rates ( \approx 20%) than normal ones. The organizers highlighted four core challenges: (1) severe class imbalance, (2) high intra-class variability, (3) subtle inter-class differences, and (4) pronounced cross-domain shifts. In order to address the above challenges, in this work, we study whether synthetic image augmentation targeted at the minority category can mitigate class imbalance. We pair this with a model zoo spanning both ImageNet-pretrained backbones and domain-pretrained representations (e.g., histopathology-tuned ViT/DiNO variants), and we compare training with real images only versus with synthetic-balanced positives. Candidate models are selected by cross-validation and submitted to the challenge platform for blind testing on hidden domains. Our aim is to provide a simple, reproducible reference for when and how synthetic positives help (or fail to help) under the distribution shifts emphasized by MIDOG 2025. Note that previous comprehensive studies have been recently presented benchmarking diverse capabilities of large histopathology image analysis models ( 2 , 3 ) , like few-shot learning ability, or robust segmentation performance, but here we focus on their use as initialization for common supervised training of models when data of minority categories is scarce. Our contributions are as follows: (i) A systematic assessment of minority-class synthesis for atypical mitosis classification under cross-domain shift. (ii) A comparative study of ImageNet vs. domain-pretrained encoders trained on real-only vs. synthetically balanced data. (iii) A compact, competition-ready pipeline for selection and submission of robust classifiers on MIDOG 2025 - mitosis classification task. Material and Methods Figure 1: Top: Real atypical mitotic figure examples. Bottom: Synthetically generated atypical mitotic figures, see Section 0.2 . 0.1 Problem and Data The task at hand in MIDOG 2025 is atypical mitotic figure classification, but we first approached the preliminary goal of synthesizing atypical mitotic cells in order to correct the class imbalance of the original dataset. The training of the generative model was conducted in two stages. To pretrain our generative model for synthetic mitotic figures, we leveraged two large-scale canine histopathology datasets with exhaustive mitotic figure annotations. The MITOS_WSI_CMC dataset ( 4 ) comprises 32 whole slide images (WSIs) of canine mammary carcinoma, fully annotated for mitotic figures. From this resource we extracted approximately 14,000 mitotic figure patches. The MITOS_WSI_CCMCT dataset ( 5 ) contains 350 WSIs of canine cutaneous mast cell tumors, again with comprehensive mitotic figure annotations. From this dataset we extracted around 42,000 mitotic figure patches. In both cases, no distinction is made between typical and atypical mitoses, as such a labelling does not exist for these cohorts. These collections nevertheless provide a large, diverse pool of mitotic morphologies that we found useful for pretraining our synthetic generator. For both the training of the synthetic generator in a typical vs. atypical setting and for the development of our classification models, we used the dataset released for MIDOG 2025, Track 2 ( 6 ) . This dataset consists of 128{\times}128 crops centered on mitotic figures collected from MIDOG++ and partner cohorts. Each crop is annotated as either normal or atypical . The dataset covers nine domains, defined by distinct combinations of tumor type, species (human/veterinary), scanner, and laboratory. In total, the training set contains 10,191 normal and 1,748 atypical mitoses. This dataset thus serves both as the ground truth for classifier training and as the reference distribution for evaluating our synthetic augmentation strategy. For visual reference, Fig. 1 shows in the top row five randomly sampled atypical mitotic figures from the MIDOG-2025 dataset, and five synthetic figures below them. Regarding classifier evaluation data, the official competition score for MIDOG 2025 Track 2 is computed on a hidden test set of 120 cases spanning 12 tumor types (human and veterinary), including two types not present in previous MIDOG editions. 0.2 Synthetic Image Generation There has been recent interest in the generation of synthetic data to boost predictive model performance in histopathology image analysis ( 7 , 8 ) . In this work, we propose using a diffusion model to generate synthetic mitotic figures. These models consist of two main stages: a forward diffusion process that gradually adds noise to the input until it becomes white noise, and a reverse denoising process that reconstructs data from noise. Inspired by Rombach et al. 2022 , we adopt a latent diffusion approach to reduce computational cost by operating in a compressed latent space. The architecture comprises a Variational Autoencoder (VAE) for mapping between pixel and latent spaces, and a Denoising Diffusion Probabilistic Model (DDPM) that performs generation within the latent space. In particular, we opt for the Diffusion Transformer (DiT) ( 10 ) architecture, a latent diffusion model which uses a transformer-based model as the backbone for the denoising process. While a large dataset of mitotic figure images is available, only a small subset includes class annotations. Therefore, we propose a two-stage training