Cell2Text: Multimodal LLM for Generating Single-Cell Descriptions from RNA-Seq Data
Oussama Kharouiche, Aris Markogiannakis, Xiao Fei, Michail Chatzianastasis, Michalis Vazirgiannis · 2025
Read Cell2Text: Multimodal LLM for Generating Single-Cell Descriptions from RNA-Seq Data by Oussama Kharouiche, Aris Markogiannakis, Xiao Fei, Michail Chatzianastasis, Michalis Vazirgiannis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24840.txt.
Introduction
Oussama Kharouiche and co-authors present a 2025 frame that turns gene reads from a single cell into a written account of that cell. Gene reads at cell level have changed biology, giving cell type, state, and disease clues. Past models built on those reads give only fixed labels, which flatten the rich story a biologist needs.
The frame joins gene codes from a large cell model with a large language model that writes text. Its accounts cover cell identity, tissue source, disease links, and which pathways are active, even for cells it has not seen. Tests beat baselines on label accuracy and on how well the text fits known cell facts. The word accounts also stay true to the data in sense. The pair of data and words gives strong calls with clear reasons.
Catalog record
| CREATOR | Oussama Kharouiche, Aris Markogiannakis, Xiao Fei, Michail Chatzianastasis, Michalis Vazirgiannis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-24840
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cell2Text: Multimodal LLM for Generating Single-Cell Descriptions from RNA-Seq Data Oussama Kharouiche, Aris Markogiannakis, Xiao Fei, Michail Chatzianastasis, Michalis Vazirgiannis Abstract Single-cell RNA sequencing has transformed biology by enabling the measurement of gene expression at cellular resolution, providing information for cell types, states, and disease contexts. Recently, single-cell foundation models have emerged as powerful tools for learning transferable representations directly from expression profiles, improving performance on classification and clustering tasks. However, these models are limited to discrete prediction heads, which collapse cellular complexity into predefined labels that fail to capture the richer, contextual explanations biologists need. We introduce Cell2Text, a multimodal generative framework that translates scRNA-seq profiles into structured natural language descriptions. By integrating gene-level embeddings from single-cell foundation models with pretrained large language models, Cell2Text generates coherent summaries that capture cellular identity, tissue origin, disease associations, and pathway activity, generalizing to unseen cells. Empirically, Cell2Text outperforms baselines on classification accuracy, demonstrates strong ontological consistency using PageRank-based similarity metrics, and achieves high semantic fidelity in text generation. These results demonstrate that coupling expression data with natural language offers both stronger predictive performance and inherently interpretable outputs, pointing to a scalable path for label-efficient characterization of unseen cells. 1 Introduction Single-cell RNA sequencing (scRNA-seq) enables measurement of gene expression at the resolution of individual cells, opening new possibilities for mapping tissue organization, reconstructing developmental processes, and studying disease at a fine-grained scale. Despite this potential, interpretation of scRNA-seq data still depends heavily on annotation, where cells are labeled by type, state, or function using marker genes and expert knowledge. This process is both slow and subjective, and it does not scale to the millions of cells now routinely generated by modern experiments. As datasets continue to grow, there is a pressing need for computational frameworks that go beyond predefined categories and provide richer, biologically grounded descriptions of cellular identity and function. A range of computational methods have been developed to automate annotation, with recent attention focused on large foundation models. Approaches such as Geneformer ( Theodoris et al. 2023b ) and scGPT ( Cui et al. 2024a ) generate powerful embeddings of gene expression profiles and have shown promise across several tasks. However, these methods typically require classification heads to map embeddings onto predefined categories. This reliance introduces important limitations: new cell types, states, or biological contexts demand additional training or fine-tuning, a process that is often computationally intensive and impractical for many biology labs. As a result, even though embeddings capture rich structure in the data, their utility remains constrained by static label spaces and specialized model development workflows. Together, these issues point to the need for a more flexible approach that can generalize beyond static labels and deliver richer, more contextual descriptions of cellular identity and function. In this work, we introduce Cell2Text, a multimodal generative framework that converts scRNA-seq profiles into natural-language descriptions. Our contributions can be summarized as follows: • We introduce Cell2Text , a multimodal generative framework that aligns gene-level embeddings with instruction-tuned language models, producing interpretable, context-rich natural language descriptions. • We demonstrate that Cell2Text achieves competitive performance across cell type, tissue, disease, and pathway classification tasks, with ontology-aware evaluation revealing that even incorrect predictions maintain high biological relevance. • We show that Cell2Text generates high-quality natural language descriptions with exceptional semantic similarity and biological soundness, demonstrating the model’s ability to produce scientifically meaningful and interpretable cellular characterizations. • We construct a large-scale multimodal dataset of 1M cells from CELLxGENE, enriched with ontology terms, tissue and disease metadata, and pathway annotations. This dataset supports cross-modal training and evaluation at a scale not available in existing resources. 2 Related Work Single cell analysis is rooted from traditional experimental biology, where cell types can be distinguished via lab assays and known markers. The raise of single-cell RNA sequencing (scRNA-seq) provided a way to numerically profile cells, but the high-dimensional data remains the obstacle. Early scRNA-seq studies relied on unsupervised clustering with manual annotation of clusters based on biomarkers ( Xie et al. 2021 ; Ianevski et al. 2022 ; Cheng et al. 2023 ) , which is labor-intensive and requires expert knowledge ( Ranjan et al. 2021 ; Kim et al. 2023 ) . Large consortium efforts including the Human Cell Atlas ( Human Cell Atlas Consortium 2017 ; Hon et al. 2018 ; Abhulimen 2024 ) produced reference, yet mapping new cells to these references demands careful handling of noise and batch effects ( Kang et al. 2021 ; Lotfollahi et al. 2022 ; Luecken et al. 2022 ) . While current scRNA-seq pipelines are mostly used for identifying cell types and lineage trajectories ( Lotfollahi et al. 2024 ; Li et al. 2025 ) , the interaction of the cell with the environment remains limited. To automate cell annotation, many computational methods formulate it as a reference-based classification. SCMAP ( Kiselev et al. 2018 ) , SingleR ( Aran et al. 2019 ) and many other straightforward approaches ( Huang et al. 2021 ; Pasquini et al. 2021 ) match cells to reference profiles with cosine similarity, while CHETAH ( de Kanter et al. 2019 ) evaluates how well a cell fits the expression distributions of known types. As complex non-linear patterns are ignored with barely pairwise similarity ( Chang et al. 2024 ) , other methods explicitly train machine learning classifiers on annotated datasets. scPred ( Alquicira-Hernandez et al. 2019 ) uses a support vector machine, SingleCellNet ( Tan & Cahan 2019 ) applies an ensemble of decision trees, and the Seurat toolkit ( Stuart et al. 2019 ) implements the label transfer using reference atlas integration. Other works ( Wang et al. 2021b ; Lewinsohn et al. 2023 ; Bhadani et al. 2023 ) construct graphs of cells then propagate label information via diffusion, improving efficiency on large scale data. Common limitation of these approaches lies in the lack of curated marker gene lists ( Pullin & McCarthy 2024 ) , improper handling of batch differences ( Luecken & Theis 2019 ; Zappia et al. 2025 ) , and inability to leverage higher-order gene-gene interactions ( Wang et al. 2021a ) . Another direction leverages foundation models as powerful feature extractors for classification. These transformer encoders are much larger and are pre-trained on massive single-cell datasets. scBERT ( Yang et al. 2022 ) adopts the BERT text encoder structure, and Geneformer ( Theodoris et al. 2023a ) pre-trained on around 30 million human single-cell transcriptomes, both demonstrating good performance on diverse prediction tasks with a pooling layer. scGPT ( Cui et al. 2024b ) introduces a similar decoder-only structure, while CellWhisperer ( Schaefer et al. 2024 ) applies the CLIP-style contrastive learning to align gene expressions with transcriptions, but used bulk RNA-seq expressions instead of single-cell data. Despite these advances, existing approaches inherently produce only categorical labels or limited annotations. These models also face challenges in scaling, as attaching a classification head requires enumerating all possible categories. Also, the unavoidable pooling layer leads to serious loss of information, as many downstream tasks may rely on subtle details. These limitations spurred recent interest in Large Language Models (LLMs) that can generate richer and more descriptive outputs. Cell2Sentence (C2S) ( Levine et al. 2024 )