Deep Learning Approaches for Blood Disease Diagnosis Across Hematopoietic Lineages Stanford CS229 Project
Gabriel Bo, Justin Gu, Christopher Sun · 2025
Read Deep Learning Approaches for Blood Disease Diagnosis Across Hematopoietic Lineages Stanford CS229 Project by Gabriel Bo, Justin Gu, Christopher Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20049.txt.
Introduction
Gabriel Bo, Justin Gu, and Christopher Sun present a 2025 project paper on reading disease signs from blood cell genes. Blood diseases arise across a family tree of cells, from stem-like progenitors down to mature types. The team asked whether a model trained on progenitors could capture signals that carry through the whole tree.
An autoencoder compressed over twenty thousand gene measures from progenitor cells into a compact code. That code held enough signal to classify disease states in both progenitors and their mature descendants. Three classifier designs were tested on the codes, topping ninety-five percent accuracy on multi-class tasks. A zero-shot test, applying the progenitor model to mature cells unseen in training, also scored well.
Catalog record
| CREATOR | Gabriel Bo, Justin Gu, Christopher Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20049
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Learning Approaches for Blood Disease Diagnosis Across Hematopoietic Lineages Stanford CS229 Project Gabriel Bo, Justin Gu, Christopher Sun Abstract We present a foundation modeling framework that leverages deep learning to uncover latent genetic signatures across the hematopoietic hierarchy. Our approach trains a fully connected autoencoder on multipotent progenitor cells, reducing over 20,000 gene features to a 256-dimensional latent space that captures predictive information for both progenitor and downstream differentiated cells such as monocytes and lymphocytes. We validate the quality of these embeddings by training feed-forward, transformer, and graph convolutional architectures for blood disease diagnosis tasks. We also explore zero-shot prediction using a progenitor disease state classification model to classify downstream cell conditions. Our models achieve greater than 95% accuracy for multi-class classification, and in the zero-shot setting, we achieve greater than 0.7 F1-score on the binary classification task. Future work should improve embeddings further to increase robustness on lymphocyte classification specifically. 1 Introduction and Related Work The differentiation of hematopoietic cells from multipotent progenitors is fundamental to both developmental biology and disease pathology. Recent studies have showcased machine learning’s power to decode complex gene-expression patterns, shedding light on stem cell renewal, aging, and disease progression ( Arai et al. 2020 ) ( Muhsen et al. 2020 ) . For example, Wang et al. 2023 and Cheng et al. 2020 demonstrate the utility of machine learning in this domain. In addition, work by Arai et al. 2020 and related interpretability analyses by ( Muhsen et al. 2020 ) underscore the value of approaches such as self-attention and graph-based methods ( Veličković et al. 2018 ) , such as a recent use of transformers for detecting skin lesions ( Vaswani et al. 2023 ) ( Pedro and Oliveira 2021 ) . Such machine learning approaches are useful in their niche area of biology, but do not have the robustness needed to learn generalizable features along a stem cell lineage. While single-cell profiling and deep learning are accelerating biological innovation, the intrinsic heterogeneity within and across cell types continues to be an analysis challenge. Our work is motivated by the need for a foundation modeling framework that is able to learn useful biology along the lineage of hematopoietic stem and progenitor cells (Figure 1 ), enabling blood and bone marrow disease diagnosis through purely hematological features. We utilize high-dimensional gene expression data comprising 29,150 features from hematopoietic cells. An autoencoder compresses this data into a 256-dimensional latent space that contains maximally predictive information generalizable across the hematopoietic lineage ( Gabdullin 2024 ) . The autoencoder is trained on upstream multipotent progenitor cells and then applied to downstream cells such as monocytes and lymphocytes. These latent embeddings serve as inputs to various downstream architectures – including fully connected neural networks, multi-head self-attention models, and graph convolutional networks – to predict disease states. We further explore a zero-shot classification scenario, where an upstream-trained classifier is evaluated on downstream cell types. 2 Dataset and Features Our work leverages the public dataset “Human circulating hematopoietic stem and progenitor cells in aging, cytopenia, and MDS” from the Chan Zuckerberg Foundation ( CZIScience 2025 ) . This dataset comprises over a million cells across nine hematopoietic cell types and provides gene expression measurements for 29,150 genes. Each cell is labeled with one of seven disease states, including 1) myelodysplastic syndrome (MDS), 2) cytopenia, 3) chronic myelomonocytic leukemia (CMML), 4) smoldering multiple myeloma and MDS, 5) myeloproliferative neoplasm and MDS, 6) CMML and MDS, and 7) normal condition. The data set included 199,764 hematopoietic multipotent progenitor cells, 20,643 monocytes, and 4,224 lymphocytes. Figure 1: We used single-cell sequencing data from Hematopoietic Multipotent Progenitor Cells, Monocytes, and Lymphocytes in this analysis. The PCA-transformed latent embeddings for these cell types are plotted accordingly. 3 Methods 3.1 Fully-Connected Autoencoder To extract a low-dimensional representation from high-dimensional gene expression profiles, we use a dense autoencoder with an encoder–decoder structure. Let \mathbf{x}\in\mathbb{R}^{G} be the raw input vector of G gene expression levels; the autoencoder learns the mapping: \mathbf{z}=f_{\text{enc}}(\mathbf{x})\quad\text{and}\quad\hat{\mathbf{x}}=f_{\text{dec}}(\mathbf{z}), (1) by minimizing reconstruction error, where \mathbf{z}\in\mathbb{R}^{d} is the latent embedding (with d=256 in our experiments) and \hat{\mathbf{x}} is the reconstructed input. The encoder reduces the dimensionality from G to d using fully connected layers with Batch Normalization and ReLU activations, enforcing a compact latent space that captures salient features. The decoder mirrors this architecture to reconstruct \mathbf{x} from \mathbf{z} with similar layers, culminating in a final output layer. By minimizing the mean squared error between \mathbf{x} and \hat{\mathbf{x}} , the autoencoder learns a compact representation that is subsequently used to enhance downstream classification tasks across various hematopoietic cell types. 3.2 Fully-Connected Neural Network To capture non-linear relationships in the latent space and learn a disease diagnosis, we employ a feed-forward network with multiple fully connected layers. Let \mathbf{x}\in\mathbb{R}^{d} denote the input vector. The network computes: \mathbf{h}_{1}=\mathrm{ReLU}(\mathbf{W}_{1}\mathbf{x}+\mathbf{b}_{1}),\quad\mathbf{h}_{2}=\mathrm{ReLU}(\mathbf{W}_{2}\mathbf{h}_{1}+\mathbf{b}_{2}),\quad\mathbf{y}=\mathbf{W}_{3}\mathbf{h}_{2}+\mathbf{b}_{3}. (2) Key design elements include ReLU activations for non-linearity, batch normalization for training stability, and dropout regularization to mitigate overfitting. The output \mathbf{y} is subsequently passed through a softmax (multi-class) or sigmoid (binary) layer for classification. This architecture effectively models complex decision boundaries and captures nuanced patterns in gene expression embeddings, outperforming simpler approaches like logistic regression. 3.3 Transformer Model with Multi-head Self-Attention We further explore advanced architectures using a simplified attention-based model ( Vaswani et al. 2023 ) . Each latent embedding is treated as a sequence of length 256 and dimension of 1. The model begins by projecting the d -dimensional input to a hidden dimension D using a linear layer. Next, multi-head self-attention computes queries, keys, and values, capturing diverse feature-to-feature relationships: \mathrm{Attention}(\mathbf{Q},\mathbf{K},\mathbf{V})=\mathrm{softmax}\Bigl(\frac{\mathbf{Q}\mathbf{K}^{\top}}{\sqrt{D}}\Bigr)\mathbf{V}. (3) By splitting the hidden dimension into multiple heads, the model attends to various subspaces: \mathrm{MultiHead}(\mathbf{Q},\mathbf{K},\mathbf{V})=\bigl[\mathrm{head}_{1}\,\|\,\mathrm{head}_{2}\,\|\,\dots\,\|\,\mathrm{head}_{h}\bigr]\,\mathbf{W}^{O}. (4) A small stack of fully connected feed-forward layers then refines the attention outputs, with the final output passed through a classification layer to predict disease labels. This approach effectively captures global, context-aware features within the latent space. 3.4 Graph Convolutional Networks We implement Graph Convolutional Networks (GCNs) ( Kipf and Welling 2017 ) to assess whether the explicit modeling of cell-to-cell relationships enhances diagnostic ability. The embedded data is represented as a graph, where nodes are samples and edges are formed based on pairwise cosine similarity with thresholding and a fixed maximum to manage memory. Our two-layer GCN updates node representations by aggregating neighbors’ features weighted by a normalized adjacency matrix, applying the following propagation rule: H^{(l+1)}=\sigma\left(\hat{D}^{-\frac{1}{2}}\hat{A}\hat{D}^{-\frac{1}{2}}H^{(l)}W^{(l)}\right), (5) where H^{(l)} is the node feature matrix at layer l , initialized as the input feature matrix X , \hat{A}=A+I is the adjacency matrix with self-connections, \hat{D} is the diagonal degree matrix of \hat{A} , W^{(l)} is the trainable weight matrix at layer l , and \sigma is an activation function (ReLU in this case). 4 Experiments and Results 4.1 Experiments All models were trained using a batch size between 512 and 16,384, depending on memory constraints. We employed a 70/30 train/test random split and used Adam optimization with a learning rate between 3\times 10^{-4} and 1\times 10^{-3} . Further hyperparameter details are given in the following sections. Fully-Connected Neural Network The fully-connected feed forward network, based on the architecture described in Section 3.2 , was experimented based on it’s dropout rate ( Bebis and Georgiopoulos 1994 )