ORBIT: Learning Gene Program Co-Activation Structure for Cell-Type-Stratified Pathway Rewiring Analysis in Single-Cell Transcriptomics
Yuechen Wang, Lina Jia, Qinglong Wang, Feng Tian, [0.5em] Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical SchoolBoston, MA 02115, USA, [0.5em] Correspondence: [email protected] · 2026
Read ORBIT: Learning Gene Program Co-Activation Structure for Cell-Type-Stratified Pathway Rewiring Analysis in Single-Cell Transcriptomics by Yuechen Wang, Lina Jia, Qinglong Wang, Feng Tian, [0.5em] Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical SchoolBoston, MA 02115, USA, [0.5em] Correspondence: [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02142.txt.
Introduction
Yuechen Wang, Lina Jia, Qinglong Wang, and Feng Tian introduce ORBIT, a model that learns how gene programs activate together inside single cells. Past methods treat programs on their own or need perturbation data to model their links. ORBIT learns from observational single-cell RNA data alone, using a self-supervised transformer.
Its training asks how other programs change when one program is removed. That gives attention weights that reflect one-way influence, not just co-occurrence. On almost one hundred ninety-two thousand prefrontal cortex nuclei, across three pathway vocabularies, ORBIT recovered patterns matching known Alzheimer's vulnerability signs. It also found cell-type-specific rewiring that standard differential expression missed, showing links that vary by cell type.
Catalog record
| CREATOR | Yuechen Wang, Lina Jia, Qinglong Wang, Feng Tian, [0.5em] Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical SchoolBoston, MA 02115, USA, [0.5em] Correspondence: [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.02142
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ORBIT: Learning Gene Program Co-Activation Structure for Cell-Type-Stratified Pathway Rewiring Analysis in Single-Cell Transcriptomics Yuechen Wang, Lina Jia, Qinglong Wang, Feng Tian, [0.5em] Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical SchoolBoston, MA 02115, USA, [0.5em] Correspondence: [email protected] Abstract Gene programs co-activate within cells, but existing single-cell methods either treat programs independently or require experimental perturbation data to model their interactions. We introduce ORBIT, a self-supervised transformer that learns asymmetric dependencies among gene programs from observational single-cell RNA-sequencing data alone, quantifying how strongly each program influences every other program. The key mechanism is an intervention-consistent training objective: the model learns each program’s directional influence on every other program by predicting how the others change when that program is removed, yielding attention weights that reflect asymmetric influence rather than symmetric co-occurrence. Applied to 191,890 prefrontal cortex nuclei across three pathway vocabularies, ORBIT recovers co-activation structure consistent with established Alzheimer’s disease vulnerability signatures, identifies cell-type-specific rewiring invisible to differential expression, and achieves 0.984 macro F1 on cell-type classification from 220 pathway scores, which is within 0.3 points of a state-of-the-art classifier using all 22,088 genes. Code is available at: https://anonymous.4open.science/r/elliptic6621. 1 Introduction Learning directed dependencies among gene programs from observational single-cell transcriptomes is a central challenge in computational biology ( Mou et al. 2019 ; Subramanian et al. 2005 ; Bull et al. 2024 ) . Gene programs, or curated sets of functionally related genes, co-activate within cells according to structured dependencies that shape cellular phenotype, and these dependencies can be reorganized in disease without any individual program changing its mean expression level ( Talukdar and Chatterji 2023 ; Seguella and Gulbransen 2021 ) . Detecting such co-activation rewiring requires a method that (i) operates on standard single-cell RNA-sequencing data without perturbation labels, (ii) models pairwise program interactions rather than scoring programs independently, and (iii) recovers asymmetric influence relationships, not merely symmetric co-occurrence, which is a distinction that determines which program is the upstream driver and therefore the more effective therapeutic target ( Krämer et al. 2013 ) . No existing method satisfies all three requirements. In the brain, where cell types maintain tight coupling between synaptic, metabolic, and immune programs, such relational reorganization may distinguish early neurodegeneration from healthy aging ( Mitra et al. 2024 ) . Existing single-cell methods each address a subset of these requirements. Gene-set and pathway-scoring methods ( Aibar et al. 2017 ; Subramanian et al. 2005 ) quantify program activity at single-cell resolution but treat programs as independent features, satisfying none of (ii) or (iii). Co-expression and gene regulatory network methods ( Aibar et al. 2017 ; Xu et al. 2024 ; Silkwood et al. 2024 ) recover coordinated molecular modules but typically operate at the gene or transcription-factor level, rely on symmetric associations, and do not directly yield an interpretable program-by-program dependency matrix stratifiable by cell type and condition, satisfying (ii) partially but not (iii). Perturbation-response models ( Roohani et al. 2024 ; Gonzalez et al. 2025 ) learn directed effects and satisfy (ii)–(iii), but require matched perturbation–expression pairs unavailable in most human post-mortem tissue atlases ( Mathys et al. 2024 ; Morabito et al. 2021 ) , failing (i). Single-cell foundation models ( Cui et al. 2024 ; Yang et al. 2022 ; Theodoris et al. 2023 ) learn powerful cell representations satisfying (i), but their embeddings do not expose an interpretable matrix of pathway-level dependencies comparable across biological states. We present ORBIT ( O rganization of R ewiring B etween I nteracting T ranscriptional programs), a two-stage framework that fills this gap. The idea is simple: train a transformer over program-level embeddings, then add a training objective that forces the attention matrix to encode directional dependency. Concretely, for each program p , ORBIT zeros p ’s input and requires the attention weights A[p,\cdot] to predict how every other program’s reconstructed score shifts, converting attention from a co-occurrence statistic into a directional dependency operator. Stage 1 learns the co-activation matrix without any labels; Stage 2 fine-tunes a thin classification head ( 3.9\% of parameters) to stratify the map by cell type and condition. Throughout, we use directed dependency to mean asymmetric predictive influence between programs under input ablation, A[p,q]\neq A[q,p] in expectation; we reserve co-activation for the underlying expression-covariance structure that ORBIT learns from. Applied to 191,890 prefrontal cortex nuclei from an AD atlas ( Morabito et al. 2021 ) across three independent pathway vocabularies, ORBIT recovers biologically interpretable co-activation structure and identifies cell-type-specific rewiring that is structurally undetectable by differential expression. As a secondary validation, the learned pathway representation preserves cell-type identity, achieving classification performance comparable to gene-level cell-type classifiers despite using compact pathway-level inputs. The main contributions are summarized as follows: • We formally characterize two structural limitations of existing approaches: (1) correlation-based methods are symmetric by construction and cannot represent directed program influence; (2) graph-based perturbation models require experimental labels unavailable in post-mortem tissue, restricting discovery to interactions already encoded in a predefined network. • We propose ORBIT, a two-stage framework in which a pathway attention transformer learns asymmetric, directed program co-activation weights from expression covariance alone via an intervention-consistent influence loss, which trains A[p,\cdot] to predict score-space shifts under single-program removal, converting attention from a similarity measure into a directional dependency operator. • Applied to an AD snRNA-seq atlas across three pathway vocabularies, ORBIT identifies cell-type-specific rewiring undetectable by differential expression that is consistent with prior empirical evidence and achieves 0.984 macro F1 on cell-type classification from 220 pathway scores (within 0.3 points of CellTypist using all 22,088 genes). 2 Method Overview. ORBIT takes as input a nucleus’s gene expression vector and a curated vocabulary of P gene programs (the number of curated gene sets in the vocabulary; 220 for ABA, P=318 for KEGG, 170 for Reactome), from which it computes a precomputed scalar activation score per program (Eq. 1 ). It outputs (i) a P\times P attention matrix encoding the pairwise directed dependency from each program to every other program and (ii) a cell-type label. Stage 1 learns the attention matrix via self-supervised masked reconstruction combined with the intervention-consistent objective, using no labels. Stage 2 fine-tunes a small classification head on cell-type labels to enable condition-stratified analysis. 2.1 Input Representation Let \mathbf{g}_{i}\in\mathbb{R}_{+}^{G} denote the library-size-normalized, log1p-transformed expression vector of nucleus i over G genes. Let \Pi=\{\pi^{1},\ldots,\pi^{P}\} be a vocabulary of P gene programs, each \pi_{p}\subseteq\{1,\ldots,G\} a curated gene set. The size-normalized activation score for program p in nucleus i is: s_{i,p}=\frac{1}{\sqrt{|\pi_{p}|}}\sum_{g\in\pi_{p}}g_{i,g}, (1) yielding \mathbf{s}_{i}\in\mathbb{R}_{+}^{P} . The square-root denominator corrects for program size without penalizing broadly expressed programs. 2.2 Model Architecture The architecture has three components: a pathway encoder, a pathway attention transformer, and a classification head (Fig. 1 ). Figure 1: ORBIT architecture and information flow. ORBIT is a two-stage self-supervised model that learns biological program co-activation structure from scRNA-seq data. a , Model overview. ORBIT is trained on 191,890 prefrontal cortex nuclei from the Morabito 2021 atlas, comprising AD-condition donors ( n=92{,}201 ) and control-condition donors ( n=60{,}779 ); an 80/20 stratified split (seed 42) reserves 38,910 nuclei for held-out evaluation. b , Internal architecture. Raw gene expression is reduced to P scalar program activation scores via the binary pathway membership mask M . The Pathway