Gene Ontology-Guided Hierarchical Spatial Gene Expression Prediction from Histopathology Images

Zhiwen Xu, Xiaoming Yan, Chengkun Wu, Juan Chen, Haoang Chi, Liyang Xu · 2026

Read Gene Ontology-Guided Hierarchical Spatial Gene Expression Prediction from Histopathology Images by Zhiwen Xu, Xiaoming Yan, Chengkun Wu, Juan Chen, Haoang Chi, Liyang Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00405.txt.

Introduction

Xu and co-authors predict spatial gene expression from histopathology images with ontology guidance. Such prediction enables large-scale transcriptomic profiling without direct measurement cost. Past methods decode target genes as a flat vector. Shared pathways and regulatory programs create gene dependencies that flat decoding ignores. Models then must learn those links from scarce paired data alone.

Their MSGR system uses the Gene Ontology as an explicit structural prior. Target genes sit in a four-level GO tree. A guided decoder refines predictions from coarse domains to single genes by residual corrections. The decoder is gene-side only, so it plugs into existing architectures untouched. On nine HEST-1k data sets, GO-structured decoding beat flat decoding. It also beat a random hierarchy of the same shape by 0.027. The gain traces to ontology structure itself.

Catalog record

CREATORZhiwen Xu, Xiaoming Yan, Chengkun Wu, Juan Chen, Haoang Chi, Liyang Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2608.00405

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gene Ontology-Guided Hierarchical Spatial Gene Expression Prediction from Histopathology Images Zhiwen Xu, Xiaoming Yan, Chengkun Wu, Juan Chen, Haoang Chi, Liyang Xu Abstract . Predicting spatial gene expression from histopathology images enables large-scale transcriptomic profiling without the cost of direct measurement. Existing methods decode the target gene set as a flat, unstructured vector, ignoring the inter-gene dependencies arising from shared biological pathways and regulatory programs. Without explicit structural guidance, models must infer these dependencies entirely from limited paired data, constraining prediction quality. We propose MSGR ( M ulti- S cale G ene R efiner), which bridges this gap by incorporating the Gene Ontology (GO), a curated functional hierarchy of genes, as an explicit structural prior. MSGR organizes target genes into a four-level GO tree. Its GO-guided decoder then progressively refines predictions from coarse functional domains to fine individual genes via residual corrections under scale-weighted supervision. Operating solely on the gene side, the GO-guided decoder serves as a seamless plug-in replacement that consistently improves existing architectures without requiring any image-side modifications. Extensive experiments on nine datasets from the HEST-1k benchmark provide empirical evidence for two central claims: GO-structured decoding consistently outperforms flat decoding, even against a state-of-the-art generative baseline, and the gain is attributable to biological ontology structure rather than hierarchical decomposition per se, as confirmed by a +0.027 margin over a structurally equivalent random hierarchy. The source code is publicly available at https://github.com/NozomiMizore/MSGR . \correspondingauthor \correspondingauthor Conference: Proceedings of the 34th ACM International Conference on Multimedia; November 10–14, 2026; Rio de Janeiro, Brazil Proceedings of the 34th ACM International Conference on Multimedia (MM ’26), November 10–14, 2026, Rio de Janeiro, Brazil ISBN: 979-8-4007-2213-4/2026/11 CCS: Applied computing Computational biology CCS: Computing methodologies Hierarchical representations † † cc-license: by 1. Introduction Spatial transcriptomics (ST) has emerged as a technology that enables simultaneous profiling of gene expression while preserving the spatial coordinates of measurements within tissue samples ( Li and Wang, 2021 ) . This capability provides valuable insights into the spatial organization of cells, facilitating the characterization of cellular heterogeneity and the tumor microenvironment. Moreover, ST has demonstrated clinical relevance in elucidating disease mechanisms, discovering drug targets, and predicting therapeutic responses ( Lewis et al., 2021 ; Cao et al., 2024 ; Williams et al., 2022 ) . Although ST technologies, such as Visium ( Ståhl et al., 2016 ) , provide spatially resolved molecular landscapes, their clinical adoption is hindered by prohibitive costs, labor-intensive workflows, and limited sample throughput ( Wang et al., 2025a ) . In contrast, hematoxylin and eosin (H&E) staining—the standard protocol for preparing tissue sections for microscopic examination—is widely accessible, cost-effective, and already applied to archival collections in hospitals worldwide. These stained tissue sections are routinely digitized as whole slide images (WSIs) for diagnostic purposes. Developing a computational strategy that bridges morphological and transcriptomic modalities by predicting spatial gene expression from routinely available histopathology images could therefore transform existing WSI archives into a scalable source of molecular-level insights, reducing reliance on costly direct transcriptomic measurements ( Wang et al., 2025a ; Chelebian et al., 2025 ) . Several computational approaches have been proposed for this cross-modal prediction task. Single-magnification regression methods extract histological features from spot-centered image patches at a single magnification and directly regress gene expression ( He et al., 2020 ; Pang et al., 2021 ; Yang et al., 2023 ; Zeng et al., 2022 ) . Extending this paradigm, multi-magnification regression methods enrich the histological signal by extracting features at multiple magnifications, jointly leveraging fine-grained cellular morphology and broader tissue context ( Chung et al., 2024 ; Wang et al., 2025b ; Nguyen et al., 2025 ) . Retrieval-based methods learn joint image–expression embeddings via contrastive learning and impute predictions from nearest neighbors during inference ( Xie et al., 2023 ) . More recently, generative modeling approaches have formulated this problem as a conditional generation task ( Huang et al., 2025 ; Zhu et al., 2025 ) . Despite their architectural diversity, existing methods share a fundamental limitation: they decode all target genes simultaneously, reducing an inherently structured gene set to a flat output vector (Figure 1 (a)). Such a design does not explicitly account for the cross-modal semantic gap between tissue-level morphological phenotypes captured by histopathology images and fine-grained molecular variation reflected in gene expression. It also requires the model to implicitly learn complex functional and expression dependencies among hundreds of genes from limited paired data. Introducing structured biological knowledge as an intermediate representation offers a natural alternative, transforming flat, one-step decoding into a coarse-to-fine prediction process that progressively narrows the semantic gap while explicitly coordinating the predictions of functionally related genes (Figure 1 (b)). Figure 1 . Traditional flat decoding vs. hierarchical decoding guided by a biological prior. (a) Flat decoder outputs all genes simultaneously as a flat vector. (b) Biological prior-guided decoder refines predictions coarse-to-fine. (c) Simplifying the complex GO DAG architecture into tractable trees. Comparison of flat gene decoding with GO-guided coarse-to-fine decoding, alongside a diagram showing how the GO directed acyclic graph is simplified into trees. The Gene Ontology (GO) ( Ashburner et al., 2000 ) provides a structured representation of biological knowledge. As a curated vocabulary, GO annotates genes through a hierarchical framework modeled as a directed acyclic graph (DAG). This framework partitions biological concepts into three top-level domains (biological process, molecular function, and cellular component), which branch into progressively more specific descendant terms. Importantly, genes sharing granular GO annotations tend to exhibit correlated expression patterns ( Van Dam et al., 2018 ) , providing a biological foundation for structured prediction. While the native GO architecture is a complex DAG (Figure 1 (c)), it can be projected into a computationally tractable tree structure ( Liang et al., 2018 ; Gu, 2024 ) , enabling a unique ancestral path for hierarchical decoding. Unlike protein-protein interaction (PPI) networks (e.g., STRING ( Szklarczyk et al., 2025 ) ), which primarily represent non-hierarchical pairwise interactions, the GO framework provides a curated, top-down hierarchy, making it naturally suited for the hierarchical decoding paradigm. Motivated by these observations, we present MSGR ( M ulti- S cale G ene R efiner), a multi-scale spatial gene prediction framework simplifying the GO DAG into hierarchical trees as structural priors. This approach decomposes the regression of all target genes into a sequence of biologically aligned subtasks. Instead of treating all target genes as a flat output vector, MSGR organizes them into a four-level GO tree (virtual root \rightarrow GO domains \rightarrow GO terms \rightarrow genes) and progressively refines predictions from the coarsest level to the finest. At each non-root level, a shared Transformer backbone predicts a residual correction to the estimate inherited from the coarser level. Concurrently, a cross-scale latent highway propagates latent context from coarser levels to finer ones, providing each refinement step with direct access to the broader biological context that guides its correction. By decoupling structured gene decoding from the image-feature extractor, the GO-guided decoder can be integrated into different base architectures. Extensive experiments on nine HEST-1k ( Jaume et al., 2024 ) datasets demonstrate that MSGR outperforms existing methods, while integrating the decoder into existing architectures yields consistent performance improvements. The main contributions of this work are as follows: • We introduce MSGR, a

Read the complete text