HaDM-ST: Histology-Assisted Differential Modeling for Spatial Transcriptomics Generation
Xuepeng Liu 2,∗, Zheng Jiang 2,∗, Pinan Zhu 2, Hanyu Liu 2, Chao Li 1 🖂 · 2025
Read HaDM-ST: Histology-Assisted Differential Modeling for Spatial Transcriptomics Generation by Xuepeng Liu 2,∗, Zheng Jiang 2,∗, Pinan Zhu 2, Hanyu Liu 2, Chao Li 1 🖂 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07225.txt.
Introduction
Xuepeng Liu and co-authors present a method to sharpen maps of gene activity in tissue in a 2025 paper. Spatial transcriptomics shows where genes are active in a slice of tissue, but its resolution is coarse. Stained tissue images hold finer detail, yet pulling the right cues from them and aligning them with gene maps is hard.
Their framework tackles three problems: picking expression-relevant features from complex images, aligning image and gene data pixel by pixel, and modeling each gene's own variation. A distillation network, an alignment module, and a channel-aware learner each handle one problem. Across two hundred genes in varied tissues and species, the method beat prior tools on sharpness and gene-level coherence.
Catalog record
| CREATOR | Xuepeng Liu 2,∗, Zheng Jiang 2,∗, Pinan Zhu 2, Hanyu Liu 2, Chao Li 1 🖂 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07225
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HaDM-ST: Histology-Assisted Differential Modeling for Spatial Transcriptomics Generation Xuepeng Liu 2,∗, Zheng Jiang 2,∗, Pinan Zhu 2, Hanyu Liu 2, Chao Li 1 🖂 Abstract Spatial transcriptomics (ST) reveals spatial heterogeneity of gene expression, yet its resolution is limited by current platforms. Recent methods enhance resolution via H&E-stained histology, but three major challenges persist: (1) isolating expression-relevant features from visually complex H&E images; (2) achieving spatially precise multimodal alignment in diffusion-based frameworks; and (3) modeling gene-specific variation across expression channels. We propose HaDM-ST (Histology-assisted Differential Modeling for ST Generation), a high-resolution (HR) ST generation framework conditioned on H&E images and low-resolution (LR) ST. HaDM-ST includes: (i) a semantic distillation network to extract predictive cues from H&E; (ii) a spatial alignment module enforcing pixel-wise correspondence with low-res ST; and (iii) a channel-aware adversarial learner for fine-grained gene-level modeling. Experiments on 200 genes across diverse tissues and species show HaDM-ST consistently outperforms prior methods, enhancing spatial fidelity and gene-level coherence in HR ST predictions. † † footnotetext: * These authors contributed equally to this work. 1 Introduction Spatial transcriptomics (ST) has revolutionized our understanding of tissue biology by providing spatially resolved gene expression. However, the spatial resolution of most mainstream ST platforms remains inherently limited [ 1 ] , as they typically measure gene expression at coarse, spot-level granularity, which hinders fine-scale spatial analysis. Although recent high-resolution (HR) ST technologies such as Xenium [ 2 ] and Visium [ 3 ] emerge, they are costly and often suffer from reduced capture efficiency [ 4 ] , limiting their real-world applications. To overcome these limitations, recent efforts have explored the potential of leveraging histology context, particularly hematoxylin-and-eosin (H&E) stained tissue sections, to infer HR ST data and improve its spatial resolution. Among the generative modeling approaches, conditional diffusion models have emerged as a powerful solution in medical image synthesis tasks [ 5 , 6 ] . These models simulate a denoising Markov chain conditioned on auxiliary inputs, enabling the generation of realistic HR images from low-resolution (LR) or multimodal inputs. Their inherent stochasticity allows for uncertainty-aware prediction, while their conditioning mechanisms provide flexibility to integrate diverse sources of biological information [ 7 , 8 , 9 ] . In this study, we explore a cross-modal generation paradigm in which HR ST maps are synthesized by integrating H&E histology morphology with corresponding LR ST measurements. Unlike conventional super-resolution methods that merely upscale existing ST data, our approach learns a modality translation process guided by histology context and augmented by transcriptomic priors. Specifically, the LR ST provides coarse-grained gene expression levels across spatial regions, along with gene–gene co-expression relationships, serving as a biological prior that informs both expression intensity and inter-gene structural dependencies during generation. To effectively leverage the histological morphology for ST generation, three core challenges remain: Complex histology semantics: H&E images contain rich and heterogeneous visual features, making it difficult to isolate expression-relevant morphological cues that correlate with gene activity; Multi-conditional misalignment: Traditional diffusion pipelines struggle to align heterogeneous modalities, such as histology textures and transcriptomic signal, at pixel-level precision, especially when conditioned on coarse-resolution ST inputs; Lack of gene-specific modeling: ST data consists of multiple gene expression channels, each reflecting unique biological patterns. Existing methods lack mechanisms to explicitly model gene-wise variations across these channels. To address these challenges, we propose HaDM-ST (Histology-assisted Differential Modeling for ST Generation), a diffusion-based image translation framework that generates HR ST maps from H&E images, guided by LR ST inputs during training. Our method introduces three key innovations. • H&E-Driven Semantic Distillation (HSD): A transformer-based semantic encoder that filters out irrelevant histology noise and distills expression-relevant features from H&E morphology. • Cross-Modal Spatial Alignment (CMSA): A pixel-level alignment module based on contrastive learning, which uses LR ST data to guide the alignment between histology and transcriptomic features. • Gene-wise Differential Adversarial Learning (GDAL): A graph-based gene modeling module that incorporates a channel-aware discriminator to capture inter-gene relationships and refine gene-specific expression in the predicted ST maps. Extensive experiments across 200 genes from public ST datasets covering multiple tissues and species demonstrate that HaDM-ST consistently outperforms existing approaches, achieving superior spatial fidelity and gene-level accuracy in the generated HR ST outputs. 2 Related Work and Problem Statement ST is rapidly evolving from spot–based sequencing toward subcellular and even single-cell imaging [ 10 ] . High sequencing costs and resolution bottlenecks, however, still hinder its widespread clinical adoption. A growing body of research leverages readily available H&E slides to reconstruct or predict HR gene-expression maps [ 11 ] . Instead of grouping the literature by model archetype, we review it through the lens of three key challenges . For completeness, we cover all classic methods [ 12 , 13 , 14 , 15 , 16 ] and explicitly point out how our work differs at the end of each subsection. Resolution Mismatch: From Spots to Subcellular Scale Early studies confirmed a strong link between tissue morphology and gene expression. He et al. [ 12 ] employed an ImageNet-pretrained DenseNet to regress the spot-level expression of 250 genes in breast cancer, demonstrating multi-gene prediction but inheriting the coarse spot grid. XFuse [ 13 ] mixed multi-scale latent variables of H&E and ST through a down-sampling reconstruction loss, while iStar [ 14 ] introduced spatial priors into a Vision Transformer under weak supervision. Both still rely on LR ST labels and fail to capture pixel-level details. Heterogeneous-Modality Alignment H&E image translation must align two heterogeneous modalities: morphology and molecules. TESLA [ 15 ] embeds both modalities into a unified graph and spreads information via graph convolutions; ControlNet [ 16 ] and Uni-ControlNet [ 17 ] insert explicit conditioning branches into large diffusion models. Despite their success, these approaches usually fuse modalities by channel concatenation or simple addition and lack dynamic filtering of shared versus unique features, leading to blurred reconstructions in structurally complex tissues. Multi-Gene Synergy Gene expression exhibits strong synergy and complementarity; modeling each gene independently discards latent co-regulation. BayesSpace [ 18 ] uses Bayesian statistics and spot adjacency to refine sub-spot inference, but ignores gene-level interactions. In MRI synthesis, DisC-Diff [ 19 ] deploys SE attention to weight each contrast channel globally, yet overlooks local differences. Video and multispectral methods such as MCCNet [ 20 ] and GCRVFL [ 21 ] confirm the value of channel correlation but operate on global statistics only. 3 Methodology 3.1 Problem Formulation and Overview As shown in Figure 1 ,We propose a image translation method for ST Generation in histology-assisted differential modeling(HaDM-ST), which conditions on H&E-stained histology images and LR ST measurements to reconstruct HR ST maps via the reverse diffusion process. Specifically, let \tilde{\mathbf{s}}\!\in\!\mathbb{R}^{C\times H_{l}\times W_{l}} be a LR ST tensor with C gene channels, and let \mathbf{m}\!\in\!\mathbb{R}^{3\times H_{m}\times W_{m}} denote the co-registered H&E image of the same tissue section ( H_{m}\!\approx\!10H_{l},\,W_{m}\!\approx\!10W_{l} in practice). Our goal is to synthesise a HR ST map \hat{\mathbf{s}}\!\in\!\mathbb{R}^{C\times H\times W} , where H,W\!\gg\!H_{l},W_{l} , by leveraging both histology morphology and LR-ST measurements. Figure 1 : Overall architecture of our histology-assisted differential modeling methods, comprising (A) the gene-wise differential adversarial learning module (GDAL), (B) the H&E-driven semantic distillation module (HSD), and (C) the cross-modal spatial alignment module (CMSA), and we additionally include an information prompt to