Sequence models for continuous cell cycle stage prediction from brightfield images

Louis-Alexandre Leger 1 \midljointauthortext Contributed equally, Maxine Leonardi 1 \midlotherjointauthor, Andrea Salati 1 \midlotherjointauthor, Felix Naef 1 \midljointsharedauthortext Shared supervision, Martin Weigert 1,2 \midlothersharedauthor · 2025

Read Sequence models for continuous cell cycle stage prediction from brightfield images by Louis-Alexandre Leger 1 \midljointauthortext Contributed equally, Maxine Leonardi 1 \midlotherjointauthor, Andrea Salati 1 \midlotherjointauthor, Felix Naef 1 \midljointsharedauthortext Shared supervision, Martin Weigert 1,2 \midlothersharedauthor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02182.txt.

Introduction

Louis-Alexandre Leger and four co-authors test which AI designs best track a cell's cycle stage from plain microscope images. Their paper appeared in two thousand twenty-five. Fluorescent tags can mark the cycle live, but they need genetic tweaks and take up imaging channels. Brightfield images need no tags at all.

The team built a large data set of dividing human cells with full cycle records. They compared three model families: single-frame readers, causal sequence models, and two-way transformer models. The sequence models beat frame-by-frame ones by a wide margin. They could even call a key switch point within about an hour, though the eye sees nothing change. The results argue that time-aware models are the right tool for label-free cell tracking. That could free fluorescence channels for other markers.

Catalog record

CREATORLouis-Alexandre Leger 1 \midljointauthortext Contributed equally, Maxine Leonardi 1 \midlotherjointauthor, Andrea Salati 1 \midlotherjointauthor, Felix Naef 1 \midljointsharedauthortext Shared supervision, Martin Weigert 1,2 \midlothersharedauthor
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-02182

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sequence models for continuous cell cycle stage prediction from brightfield images Louis-Alexandre Leger 1 \midljointauthortext Contributed equally, Maxine Leonardi 1 \midlotherjointauthor, Andrea Salati 1 \midlotherjointauthor, Felix Naef 1 \midljointsharedauthortext Shared supervision, Martin Weigert 1,2 \midlothersharedauthor Abstract Understanding cell cycle dynamics is crucial for studying biological processes such as growth, development and disease progression. While fluorescent protein reporters like the Fucci \xspace system allow live monitoring of cell cycle phases, they require genetic engineering and occupy additional fluorescence channels, limiting broader applicability in complex experiments. In this study, we conduct a comprehensive evaluation of deep learning methods for predicting continuous Fucci \xspace signals using non-fluorescence brightfield imaging, a widely available label-free modality. To that end, we generated a large dataset of 1.3 M images of dividing RPE1 cells with full cell cycle trajectories to quantitatively compare the predictive performance of distinct model categories including single time-frame models, causal state space models and bidirectional transformer models. We show that both causal and transformer-based models significantly outperform single- and fixed frame approaches, enabling the prediction of visually imperceptible transitions like G1/S within 1h resolution. Our findings underscore the importance of sequence models for accurate predictions of cell cycle dynamics and highlight their potential for label-free imaging. \midlauthor \setsharedfootnotesymbol 1 Institute of Bioengineering, School of Life Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland 2 Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI), Dresden/Leipzig, Germany † † proceedings: : keywords Cell cycle prediction, label-free microscopy, sequence-models 1 Introduction The cell cycle is the driving force behind the growth and development of all living organisms. This well-studied sequence of cellular events is tightly regulated and aberrations in such mechanisms can lead to genomic instability, a key driver of various diseases including cancer Kastan and Bartek (2004) . Live cell fluorescence microscopy has become a powerful tool for studying cell cycle progression, particularly through the genetic engineering of fluorescent reporters like the Fucci \xspace system Sakaue-Sawano et al. (2008) ; Stallaert et al. (2022) . This system enables the distinction of cell cycle phases from single images by fluorescently tagging the two proteins Cdt1 and Geminin, whose expression changes distinctively with the cell cycle (fig:Overview_of_data). Despite its utility, the classic Fucci \xspace system and recent variants Sakaue-Sawano et al. (2017) ; Grant et al. (2018) are limiting in practice as they occupy two of the few available microscopy channels, reducing the ability to study other cellular processes simultaneously and requiring genetic modification that might interfere with the endogenous cell cycle regulation. In contrast, brightfield microscopy is an easily accessible and label-free imaging modality that does not require genetic engineering, providing limited specificity and imaging contrast. Although some cell cycle transitions, such as nuclear envelope breakdown, are marked by distinct morphological changes that are easily detectable, most cell cycle transitions are visually indiscernible in individual brightfield images of cells. In this paper, we ask whether leveraging the temporal information in time-lapse brightfield microscopy images of cells would allow to predict continuous cell cycle states without the need for fluorescent reporters such as Fucci \xspace . To address this, we study several sequence-based deep learning models, including transformers Vaswani et al. (2017) and recently proposed state-space models Gu et al. (2022) . In particular, we will investigate both causal sequence models that only use information from previous time points, as well as non-causal models that may ingest the entire sequence. Providing a new dataset of over 1 M images of segmented and tracked RPE-1 cells with accompanying ground truth Fucci \xspace signals, we show that both causal and transformer-based non-causal models significantly outperform single-frame approaches, enabling the prediction of morphologically subtle cell state transitions like G1/S within 1h resolution from live-cell brightfield imaging alone. 1.1 Related work The prediction of individual cell states from single microscopy images has found considerable interest in the literature. For instance Rappez et al. (2020) and Narotamo et al. (2021) ; Li et al. (2024) showed that deep learning-based models allow to classify discrete cell cycle states such as the G1, S, or G2 phase from static multichannel images of cells. In particular, Eulenberg et al. (2017) ; Blasi et al. (2016) ; Jin et al. (2021) ; He et al. (2022) explored the use of brightfield and phase-imaging data for cell cycle classification without fluorescence labeling. However, accurately annotating discrete cell cycle stages highly depends on the imaging modality with nuclear stains like DAPI or Hoechst providing clear features, while phase or brightfield imaging require substantial more manual annotation expertise. Beyond static images, several studies have investigated how the temporal information of images sequences can be leveraged to capture dynamic cell behaviors Wang et al. (2020) ; Zhao et al. (2024) ; Chu et al. (2020) . However, most approaches have so far been focused on well-defined cell phases such as mitosis, where large morphological changes facilitate annotation and prediction Held et al. (2010) ; Moreno-Andrés et al. (2022) ; Jose et al. (2024) ; Su et al. (2017) . A notable exception is Ulicna et al. (2023) which applies dynamic time warping (DTW) to features from an unsupervised autoencoder, enabling to temporally align cell trajectories and to continuously predict cycle states across interphase. Sequence models such as recurrent neural networks and transformers Vaswani et al. (2017) have been shown to be effective for modeling temporal data Hewamalage et al. (2021) ; Wen et al. (2023) , with state-space models such as Mamba Gu and Dao (2023) having recently gained considerable interest due to their training and inference efficiency. As the cell cycle is a continuous causal process, sequence models appear to be a natural fit for our task. However, studies that address this question systematically remain missing, with the closest work being Jose et al. (2024) which uses recurrent neural networks for cell cycle prediction, but focuses on morphologically stark intermitotic phases. 2 Method 2.1 Dataset We generated a large dataset of dividing human Fucci \xspace RPE1 cells using joint brightfield and fluorescence time lapse microscopy. Movies spanning 72 hours were acquired at a 5 minute time resolution, capturing multiple cell cycles. In addition to the brightfield modality, we acquired a nuclear marker channel (Histone H2B) and the two Fucci \xspace channels ( \textsc{Fucci}\xspace_{1/2} ). Based on the H2B channel, we segmented the cell nuclei with a custom StarDist model Schmidt et al. (2018) and tracked them across frames using TrackMate Tinevez et al. (2017) . Note that since the amount of H2B histones needed by cells to pack DNA doubles during S (DNA replication), the H2B channel does contain information on cell cycle progression (fig:Overview_of_datac). Below, we leverage this as a control to assess predictive performance of brightfield vs H2B. Full cell cycle tracks (from one mitosis to the next, M-M) were identified using K-Means clustering and ground-truth Fucci \xspace signals were computed by normalizing the average Fucci \xspace intensities measured across the segmented nuclear mask (fig:Overview_of_datac,d). The training dataset comprises 5,188 full (M-M) cell cycle tracks with an average track length of 230 frames. Each track contains paired brightfield and H2B images of size 64\times 64 centered on the nucleus and the corresponding integrated Fucci \xspace signals. To evaluate model performance, we created two additional test datasets:

Read the complete text