Prior-Guided Multi-Omic Transformers for Single-Cell Gene Regulatory Network Inference Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 9–13, 2026; Jeju Island, Republic of Korea. Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD 2026), August 9–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3818945 CCS: Computing methodologies Machine learning approaches CCS: Applied computing Computational genomics CCS: Applied computing Recognition of genes and regulatory elements
Tianyang Xu, Tianci Liu, Niraj Rayamajhi, Ryan Patrick, Kranthi Varala, Ying Li, Jing Gao · 2026
Read Prior-Guided Multi-Omic Transformers for Single-Cell Gene Regulatory Network Inference Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 9–13, 2026; Jeju Island, Republic of Korea. Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD 2026), August 9–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3818945 CCS: Computing methodologies Machine learning approaches CCS: Applied computing Computational genomics CCS: Applied computing Recognition of genes and regulatory elements by Tianyang Xu, Tianci Liu, Niraj Rayamajhi, Ryan Patrick, Kranthi Varala, Ying Li, Jing Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00685.txt.
Introduction
Xu and co-authors map gene control networks in this 2026 paper. These networks show how transcription factors switch genes on and off in a cell. Paired data on gene activity and open chromatin can help rebuild them. But the chromatin data are very sparse, and most tools rely on fixed links from peaks to genes.
Their model, EpiAwareNet, is a Transformer that learns from both data types at once. A cross-attention step lets each gene gather its own chromatin signals, with no fixed links. A second stage adds a rough network from bulk data as weak hints, marked as noisy. The authors report that EpiAwareNet beats known single- and multi-omic tools. Its networks also recover more known gene links. They argue that light bulk hints can guide single-cell work well when the model can weigh them.
Catalog record
| CREATOR | Tianyang Xu, Tianci Liu, Niraj Rayamajhi, Ryan Patrick, Kranthi Varala, Ying Li, Jing Gao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00685
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Prior-Guided Multi-Omic Transformers for Single-Cell Gene Regulatory Network Inference Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 9–13, 2026; Jeju Island, Republic of Korea. Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD 2026), August 9–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3818945 CCS: Computing methodologies Machine learning approaches CCS: Applied computing Computational genomics CCS: Applied computing Recognition of genes and regulatory elements Tianyang Xu, Tianci Liu, Niraj Rayamajhi, Ryan Patrick, Kranthi Varala, Ying Li, Jing Gao Abstract . Gene regulatory networks (GRNs) capture transcription factor-target interactions and are central to understanding cell-state regulation and disease. Reconstructing GRNs from paired single-cell transcriptomic and chromatin accessibility data is promising but challenging: scATAC is extremely sparse, and most methods rely on fixed peak-to-gene links and weak supervision. We present EpiAwareNet , a prior-guided multi-omic Transformer framework that reconstructs GRNs from paired single-cell data using only lightweight biological priors. In Stage 1, EpiAwareNet learns joint gene-peak representations with a gene–peak cross-attention module, enabling data-driven, gene-specific aggregation of accessibility signals rather than hard-coded peak-to-gene assignments. In Stage 2, EpiAwareNet incorporates a bulk-derived GRN prior as noisy positive edges to provide weak supervision under label scarcity, refining regulatory scores while remaining robust to prior noise. In our experiments, EpiAwareNet improves overall GRN reconstruction robustness over representative single- and multi-omic baselines and yields GRNs with greater biological plausibility, such as improved recovery of known regulatory interactions, suggesting that lightweight biological priors from bulk data can effectively guide single-cell GRN inference when combined with adaptive cross-modal representation learning. Code and data are available at https://github.com/tianyang-x/EpiAwareNet_pub . † † cc-license: by 1. Introduction In biology, gene regulatory networks (GRNs) describe how regulators, such as transcription factors (TFs), control downstream target genes and thereby shape cellular states. Characterizing regulator–target relationships is fundamental for understanding developmental patterning and morphogenesis ( 6 ) , cell-type specification and differentiation ( 14 ) , and responses to environmental stimuli ( 8 ) . GRN inference is also central to applied settings, including drug-target discovery ( 7 ) , synthetic biology and cell reprogramming ( 6 ) , and agricultural or industrial biotechnology ( 14 ) . From a machine learning perspective, GRN inference requires learning directed regulatory relationships from observational transcriptomic data that are often noisy, sparse, and only partially informative. Consequently, reconstructing accurate GRNs is a core task at the intersection of computational biology and machine learning. Early in silico efforts inferred GRNs from bulk transcriptomic data, in which many cells are pooled and each gene is represented by an average expression level over a mixed population, using heuristic or regression-based approaches such as ARACNe and GENIE3 ( 19 ; 13 ) . Because bulk measurements capture only coarse population-level patterns, their predictions are limited in resolving cell-type- or condition-specific regulatory edges. With the advent of single-cell technologies ( 18 ; 31 ) , GRN reconstruction expanded to single-cell RNA sequencing (scRNA-seq), enabling cell-type-specific and context-dependent regulatory analysis ( 30 ; 22 ) . However, extreme sparsity and noise in scRNA-seq make it difficult to distinguish genuine regulatory signals from stochastic fluctuations ( 15 ) , often yielding unstable networks ( 24 ; 4 ) or predictions with weak support from independent evidence ( 1 ) . A natural way to mitigate these limitations is to integrate scRNA-seq with an additional omic layer measured in the same cells (a “multi-omic” setting), such as single-cell ATAC sequencing (scATAC-seq), which measures chromatin accessibility, i.e., whether local DNA regions are “open” and thus more likely to support regulatory activity. Intuitively, two noisy views can still be beneficial when they provide independent constraints on the underlying regulatory relationships. When multiple molecular modalities (e.g., RNA expression and chromatin accessibility) are profiled in the same cells, the resulting paired measurements are commonly referred to as a “multi-omic” dataset. In principle, accessibility marks candidate regulatory regions (e.g., promoters and enhancers) and provides complementary evidence that can support weak or noisy expression measurements ( 28 ; 12 ) . Yet multi-omic integration introduces two key challenges for GRN inference. First, per-cell chromatin accessibility is even sparser and noisier than expression, and linking accessibility peaks to their target genes is fundamentally ambiguous. Second, enhancer–promoter regulation is context-dependent ( 26 ) ; therefore, fixed peak-to-gene heuristics can assign accessibility evidence to incorrect targets, limiting robustness across cell types or conditions. Existing solutions often rely on heuristic peak-to-gene linkages, for example by associating TF motif accessibility with gene expression (e.g., SCENIC+) or by inferring co-accessibility between enhancers and promoters (e.g., Cicero) ( 2 ; 23 ) . However, such heuristics can be brittle when regulatory interactions deviate from the assumed linking rules ( 26 ) . Overall, robust multi-omic GRN inference remains challenging because it requires assigning sparse cross-modal evidence to correct targets without reliable peak-to-gene ground truth. Recently, foundation models pretrained on large-scale single-cell datasets have shown promise for learning transferable cellular representations ( 29 ; 5 ) . However, it remains unclear whether such representations, when adapted to GRN reconstruction, yield regulator–target predictions that are both accurate and supported by independent regulatory evidence in sparse multi-omic settings. To address this gap, we evaluate inferred GRNs not only by predictive performance (i.e., how many reference edges are predicted), but also by orthogonal biological evidence through literature-grounded case studies on representative regulators. These challenges motivate a prior-guided formulation: we aim to recover regulator–target edges from sparse multi-omic observations over a large combinatorial space with limited reliable labels, while avoiding hard-coded peak-to-gene mappings and leveraging weak biological supervision under label scarcity. Our work is therefore situated in the broader prior-informed GRN literature, where external information such as motifs, genomic proximity, chromatin accessibility, and known regulatory links is used to constrain otherwise underdetermined network inference problems ( 27 ) . Rather than claiming that each component is new in isolation, our contribution is the specific formulation for paired scRNA-seq/scATAC-seq GRN refinement: paired multi-omic input, candidate-constrained gene–peak cross-attention for adaptive peak aggregation, and a separate weakly supervised regulator–target scoring stage that uses bulk-derived edges as noisy positives rather than hard constraints. Here, we present EpiAwareNet , a prior-guided multi-omic Transformer framework that integrates weak candidate priors with deep representation learning for GRN reconstruction from paired scRNA-seq and scATAC-seq data. Specifically, EpiAwareNet follows a two-stage design. In Stage 1 ( representation learning stage ), EpiAwareNet jointly models gene expression and chromatin accessibility with a Transformer-style architecture. Rather than fixing peak-to-gene mappings, EpiAwareNet constructs a candidate set of ATAC peaks for each gene using genomic proximity as a lightweight prior, and uses sparse cross-attention to aggregate accessibility signals when forming each gene representation. This masked-reconstruction stage is a proxy for learning chromatin-informed representations: it can capture how accessible candidate regions help explain expression variation, but it does not by itself identify causal TF–target regulation or edge direction. In Stage 2 ( GRN fine-tuning stage ), EpiAwareNet is adapted for directional GRN reconstruction by attaching a lightweight prediction head and incorporating a bulk-derived GRN as a weak biological prior. Directionality is introduced at this stage by scoring ordered regulator–target pairs under directed weak supervision. Concretely, edges in the bulk GRN are treated