Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models
Anis Bourou, Biel Castaño Segade, Thomas Boyer, Valérie Mezger, Auguste Genovesio · 2025
Read Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models by Anis Bourou, Biel Castaño Segade, Thomas Boyer, Valérie Mezger, Auguste Genovesio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09665.txt.
Introduction
Anis Bourou and co-authors use image generation models to reveal faint cell differences. Their 2025 paper deals with microscopy, where real changes between conditions can hide inside normal cell variety. Deep generative models can expose such shifts by translating images. But training them needs large data and heavy computing, both scarce in biology labs.
Their route leans on pre-trained latent diffusion models instead of training from scratch. That cuts both data and compute needs. They test the method on several small image sets, with both visual and numeric checks. The approach caught changes that could be seen and changes that could not. The authors present it as a practical tool for labs with limited resources, with use in drug discovery.
Catalog record
| CREATOR | Anis Bourou, Biel Castaño Segade, Thomas Boyer, Valérie Mezger, Auguste Genovesio |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-09665
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models Anis Bourou, Biel Castaño Segade, Thomas Boyer, Valérie Mezger, Auguste Genovesio Abstract Identifying subtle phenotypic variations in cellular images is critical for advancing biological research and accelerating drug discovery. These variations are often masked by the inherent cellular heterogeneity, making it challenging to distinguish differences between experimental conditions. Recent advancements in deep generative models have demonstrated significant potential for revealing these nuanced phenotypes through image translation, opening new frontiers in cellular and molecular biology as well as the identification of novel biomarkers. Among these generative models, diffusion models stand out for their ability to produce high-quality, realistic images. However, training diffusion models typically requires large datasets and substantial computational resources, both of which can be limited in biological research. In this work, we propose a novel approach that leverages pre-trained latent diffusion models to uncover subtle phenotypic changes. We validate our approach qualitatively and quantitatively on several small datasets of microscopy images. Our findings reveal that our approach enables effective detection of phenotypic variations, capturing both visually apparent and imperceptible differences. Ultimately, our results highlight the promising potential of this approach for phenotype detection, especially in contexts constrained by limited data and computational capacity. 1 Introduction In recent years, generative models have undergone rapid and accelerating advancements Song et al. 2022 ; Ho et al. 2020 ; Rezende and Mohamed 2015 ; GM et al. 2020 ; Bourou et al. 2024b , resulting in their widespread adoption across a variety of fields. Notably, these models have made significant contributions to biological research. For example, they have been employed in protein design Strokach and Kim 2022 , predicting protein structures Jumper et al. 2021 , integrating cancer data Simidjievski et al. 2019 , synthesizing biomedical images Gao et al. 2023 ; Jung et al. 2023 , predicting molecular structures Cao and Kipf 2022 ; Popova et al. 2018 , and identifying phenotypic cell variations Bourou and Genovesio 2023 ; Bourou et al. 2024a ; Lamiable et al. 2023 . Identifying phenotypic variations in biological images is crucial for advancing our understanding of biological processes. Detecting these differences can be particularly challenging due to the high degree of biological variability, yet it holds immense potential for enhancing disease understanding, discovering novel biomarkers, and developing new therapeutics and diagnostics Moshkov et al. 2022 ; Chandrasekaran et al. 2021 ; Lotfollahi et al. 2023 . Traditional methods for identifying these phenotypes often rely on cell segmentation and the quantification of features such as intensity, shape, and texture Moshkov et al. 2022 . Recently, deep learning techniques, particularly generative models Lamiable et al. 2023 ; Bourou and Genovesio 2023 ; Bourou et al. 2024a , have been applied to automate and refine this process, enabling the identification of more interpretable and biologically meaningful features. Among these approaches, diffusion models have emerged as state-of-the-art generative models Dhariwal and Nichol 2021 , achieving remarkable results in tasks such as image synthesis. However, training diffusion models, like other deep learning models requires large datasets, which is often difficult to obtain in biological applications. In this work, we propose Phen-LDiff a method to detect cellular variations in small biological datasets by leveraging pre-trained Latent Diffusion Models (LDMs) Rombach et al. 2022 . 2 Related Work Diffusion Models. Diffusion Models (DMs) Ho et al. 2020 ; Song et al. 2022 are generative models that have recently achieved remarkable results in various tasks. DMs are latent variable models that operate through two key processes: a fixed forward process that gradually adds noise to the data and a learned backward process that denoises it, reconstructing the data distribution Ho et al. 2020 ; Song et al. 2022 . Recently, these models have seen several advancements Song et al. 2022 ; Dhariwal and Nichol 2021 ; Ho and Salimans 2022 ; Karras et al. 2022 , making them state-of-the-art in image synthesis, surpassing traditional generative models like GANs Dhariwal and Nichol 2021 . One of the notable improvements is the introduction of Latent Diffusion Models (LDMs) Rombach et al. 2022 , where images are first compressed into a latent space using a variational autoencoder, and then the diffusion process occurs within this compressed latent space. This approach enables more efficient scaling to higher-resolution images and accelerates training times. Additionally, LDMs incorporate a conditioning mechanism, allowing for tasks such as text-conditioned image generation, inpainting, and super-resolution. These innovations in LDMs have facilitated their training on massive datasets Schuhmann et al. 2022 , resulting in powerful pre-trained models such as Stable Diffusion Rombach et al. 2022 , which have demonstrated exceptional performances in various generative tasks. Identifications of Phenotypes in Biological Images. Identifying phenotypic variations in biological images is essential in biology and drug discovery Moshkov et al. 2022 ; Chandrasekaran et al. 2021 , yet it presents significant challenges. One of the key difficulties is the biological variability among cells within the same condition, which can obscure the differences between distinct conditions. Recently, generative models have been employed to cancel this natural variability in order to visualize and explain cellular phenotypes in microscopy images Lamiable et al. 2023 ; Fonnegra et al. 2023 ; Bourou and Genovesio 2023 . In Bourou and Genovesio 2023 , cellular variations between conditions were identified through an image-to-image translation task between two classes, following methodologies similar to those in Zhu et al. 2020 ; Isola et al. 2018 . In Phenexplain Lamiable et al. 2023 , a conditional StyleGAN2 Karras et al. 2020 was trained to detect cellular changes by performing translations between synthetic images within the latent space of StyleGAN2, allowing for training across multiple conditions, unlike the approach in Bourou and Genovesio 2023 . A similar method was presented in Fonnegra et al. 2023 , but instead of utilizing the latent space of GANs, the authors proposed learning a representation space using self-supervised learning techniques Gui et al. 2023 . In Bourou et al. 2024a , conditional diffusion models were applied to identify phenotypes in real images. This approach consists of two stages: first, the source class image is inverted into a latent code, which is then used to generate an image from the target class. This method provides a powerful alternative for phenotype detection using real biological data. However, all of these models require a large number of images to be properly trained. Fine-tuning Diffusion Models. Fine-tuning Simonyan and Zisserman 2015 ; Moon et al. 2022 ; Tan et al. 2018 ; Han et al. 2023 ; Hu et al. 2021 , a well-established strategy for training deep learning models on limited data, involves adapting pre-trained models. It involves adapting a pre-trained model’s weights to fit a smaller dataset. Fine-tuning methods can be categorized into three main groups: adaptive methods Simonyan and Zisserman 2015 ; Ridnik et al. 2021 , where the entire model’s weights are adjusted; selective methods Zaken et al. 2022 ; Basu et al. 2023 ; Frankle et al. 2021 , where only a subset of the model’s parameters are modified; and additive methods Hu et al. 2021 ; Han et al. 2023 , where additional networks are incorporated to refine the weights. These techniques have proven effective for discriminative models