Spatial Coordinates as a Cell Language: A Multi-Sentence Framework for Imaging Mass Cytometry Analysis
Chi-Jane Chen, Yuhang Chen, Sukwon Yun, Natalie Stanley, Tianlong Chen · 2025
Read Spatial Coordinates as a Cell Language: A Multi-Sentence Framework for Imaging Mass Cytometry Analysis by Chi-Jane Chen, Yuhang Chen, Sukwon Yun, Natalie Stanley, Tianlong Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01918.txt.
Introduction
Chi-Jane Chen and co-authors turn cell maps into sentences for language models in a 2025 paper. Imaging mass cytometry profiles many proteins in tissue while keeping each cell's place. Language models can read cell states as text, but they drop spatial context and neighbor effects.
Their framework, Spatial2Sentence, writes both protein data and coordinates into multi-sentence form. Neighborhood cells enter the text too, so cell-to-cell relations survive the translation. Models can then reason over a tissue scene, not a bag of lone cells. Spatial drugs and tumor studies both need that scene-level view. The method borrows the strength of language models for a deeply spatial science.
Catalog record
| CREATOR | Chi-Jane Chen, Yuhang Chen, Sukwon Yun, Natalie Stanley, Tianlong Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-01918
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spatial Coordinates as a Cell Language: A Multi-Sentence Framework for Imaging Mass Cytometry Analysis Chi-Jane Chen, Yuhang Chen, Sukwon Yun, Natalie Stanley, Tianlong Chen Abstract Image mass cytometry (IMC) enables high-dimensional spatial profiling by combining mass cytometry’s analytical power with spatial distributions of cell phenotypes. Recent studies leverage large language models (LLMs) to extract cell states by translating gene or protein expression into biological context. However, existing single-cell LLMs face two major challenges: (1) Integration of spatial information : they struggle to generalize spatial coordinates and effectively encode spatial context as text, and (2) Treating each cell independently : they overlook cell-cell interactions, limiting their ability to capture biological relationships. To address these limitations, we propose Spatial2Sentence , a novel framework that integrates single-cell expression and spatial information into natural language using a multi-sentence approach. Spatial2Sentence constructs expression similarity and distance matrices, pairing spatially adjacent and expressionally similar cells as positive pairs while using distant and dissimilar cells as negatives. These multi-sentence representations enable LLMs to learn cellular interactions in both expression and spatial contexts. Equipped with multi-task learning, Spatial2Sentence outperforms existing single-cell LLMs on preprocessed IMC datasets, improving cell-type classification by 5.98% and clinical status prediction by 4.18% on the diabetes dataset while enhancing interpretability. The source code can be found here: https://github.com/UNITES-Lab/Spatial2Sentence . † † footnotetext: * Equal contribution. \dagger Co-corresponding authors. Correspondence: {natalies,tianlong}@cs.unc.edu 1 Introduction Single-cell technologies, such as flow and mass cytometry (CyTOF) and single-cell RNA sequencing, have revolutionized our ability to analyze cellular heterogeneity in blood and tissue samples Bendall et al. 2012 ; Brodin et al. 2019 ; Jagadeesh et al. 2022 . These techniques provide high-resolution insights into the human immune system, enabling targeted therapeutic strategies for disease treatment and prevention Reece et al. 2016 . CyTOF, for instance, identifies immune cells based on protein expression Bendall et al. 2012 . However, traditional suspension-based proteomic approaches lack spatial context, limiting our understanding of cell-cell interactions and tissue organization. Recent advancements, such as imaging mass cytometry (IMC) and multiplexed ion beam imaging (MIBI), overcome this limitation by integrating mass cytometry with spatial profiling Kakade et al. 2021 ; Shaaban et al. 2024 . These next-generation single-cell proteomics technologies enable high-dimensional immune profiling while preserving spatial relationships Giesen et al. 2014 ; Nair et al. 2015 . Such insights are crucial for characterizing the tumor microenvironment, where spatial interactions between immune and tumor cells influence prognosis Keren et al. 2018 . By capturing cell types, states, and interactions, spatial proteomics enhances our understanding of the immune system’s complexity and disease mechanisms Hartmann and Bendall 2020 . Inspired by the advances in natural language processing (NLP), researchers have started conceptualizing cellular information as "words" and "sentences," enabling deep learning models to interpret cellular behavior within a context-dependent framework Fang et al. 2024 . A recent innovative approach applies large language model to extract cell (gene) state by translating cell (gene) expression information into biological context Levine et al. 2023 ; Chen and Zou 2024 . By leveraging vast single-cell datasets, those models can generalize across gene expression dynamics, phenotype, and disease status, paving the way for new discoveries in immune system and therapeutic development. Despite their effectiveness in various downstream tasks, current approaches face two major bottlenecks: Integration of Spatial Information. With rapid advancements in spatial transcriptomics and multiplexed imaging, capturing spatial context has become increasingly important Rao et al. 2021 ; Tian et al. 2023 ; Yun et al. 2024 . Cells interact within their microenvironment, influencing differentiation, immune response, and disease progression Marx 2021 . However, current models rely solely on expression matrices (e.g., gene or protein) and overlook spatial organization, leading to suboptimal representations. Spatial context is essential for modeling intercellular interactions, uncovering cell-type-specific behaviors, and improving biological relevance. Ignoring it risks missing key regulatory mechanisms that shape cellular function within complex tissues. Treating each cell independently. Current single-cell LLM approaches Levine et al. 2023 ; Cui et al. 2024 treat each cell as an independent entity, overlooking broader cellular interactions across similar or distinct groups of cells. Learning the similarities and distinctions between cells within the same or different functional groups ( e.g., cell types or tissue niches) can enrich the biological context captured in cell sentences Keren et al. 2018 ; Hartmann and Bendall 2020 . Without this information, models may fail to capture key regulatory relationships or misinterpret cellular function within a tissue-specific context. Driven by these motivations, we propose Spatial2Sentence , a novel single-cell LLM framework that integrates spatial information into language using a multi-sentence approach to capture cellular interactions. Specifically, we construct an expression similarity matrix and a distance matrix from the expression matrix and spatial coordinates, respectively. For each cell, we identify the most similar and adjacent cells as positive pairs, while dissimilar and distant cells serve as negative pairs. These structured pairs are then used to prompt an LLM, enabling it to capture cell-cell interactions effectively. Using our newly preprocessed IMC dataset, which containing protein expression matrices, spatial coordinates, and designated cell-type annotations for diabetes and brain tumor samples, Spatial2Sentence achieves state-of-the-art performance, improving cell-type classification by 5.98% and clinical status prediction by 4.18% compared to recent single-cell LLM approaches. Furthermore, our approach provides new insights into interpretability by identifying which cell types and protein markers are most crucial for distinguishing clinical states, offering a deeper understanding of their roles in disease progression. In summary, our main contributions are summarized as follows: • We highlight the limitations of existing single-cell LLMs, particularly their lack of spatial information integration and their limitation in capturing contextual information from neighboring cells, which can be important for improving annotation accuracy in spatial omics data. • We propose a novel single-cell LLM framework, Spatial2Sentence that integrates spatial information as language and introduces multi-sentence contrastive prompting, enabling LLMs to capture cell interactions using positive and negative pairs based on both expression and spatial proximity. • We preprocess and transform two IMC datasets into cell × protein feature matrices, providing spatial coordinates and cell-type annotations for each cell. • Our method achieves state-of-the-art performance, surpassing previous models by 5.98% in cell-type classification and 4.18% in clinical status prediction on the Diabetes dataset. 2 Related Works Cells as language. Transformer-based models have made significant advances in natural language processing due to their exceptional parallel processing capabilities and highly adaptable attention mechanisms. Building on these successes, researchers have begun applying transformer architectures to the modeling of single-cell data Lan et al. 2024 . scGPT is a deep learning-based approach designed for cell identification, particularly in the context of single-cell RNA sequencing (scRNA-seq) Cui et al. 2024 . The model has demonstrated strong performance in various downstream tasks, including multi-batch integration, multiomic synthesis, cell-type classification, genetic perturbation prediction, and gene network inference. Cell2Sentence (C2S) is another pretrained model, fine-tuned from GPT-2, specifically designed to process textual sequences containing gene names Levine et al. 2023 . The model generates new cell-level textual representations, and conversely, it can transform these textual sequences back into corresponding gene expression vectors. By converting cell text sequences back into gene expression profiles, C2S ranks genes based on their expression levels and preserves key information from the original data in the majority of