BIRDNet: Mining and Encoding Boolean Implication Knowledge Graphs as Interpretable Deep Neural Networks DOI: XXXXXXX.XXXXXXX Conference: The 35th ACM International Conference on Information and Knowledge Management; November 7–11, 2026; Rome, Italy CCS: Computing methodologies Knowledge representation and reasoning CCS: Computing methodologies Neural networks CCS: Applied computing Computational biology

Tirtharaj Dash · 2026

Read BIRDNet: Mining and Encoding Boolean Implication Knowledge Graphs as Interpretable Deep Neural Networks DOI: XXXXXXX.XXXXXXX Conference: The 35th ACM International Conference on Information and Knowledge Management; November 7–11, 2026; Rome, Italy CCS: Computing methodologies Knowledge representation and reasoning CCS: Computing methodologies Neural networks CCS: Applied computing Computational biology by Tirtharaj Dash (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28739.txt.

Introduction

Tirtharaj Dash presents BIRDNet, mining and encoding Boolean implication knowledge graphs as interpretable deep neural networks. Tabular data in knowledge-rich domains often hides Boolean implication links between feature pairs, mined with a sparse-exception binomial test. The mined typed graph becomes the connectivity of a layered network where each hidden unit stands for one mined rule for its two features. BIRDNet lands near 0.02 AUROC of the strongest dense rival using up to 95-fold fewer active parameters, and its first-layer rules match known biological signatures across cancer subtypes.

Catalog record

CREATORTirtharaj Dash
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23545
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28739

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BIRDNet: Mining and Encoding Boolean Implication Knowledge Graphs as Interpretable Deep Neural Networks DOI: XXXXXXX.XXXXXXX Conference: The 35th ACM International Conference on Information and Knowledge Management; November 7–11, 2026; Rome, Italy CCS: Computing methodologies Knowledge representation and reasoning CCS: Computing methodologies Neural networks CCS: Applied computing Computational biology Tirtharaj Dash Abstract . Tabular data in knowledge-rich domains often carries a latent prior in the form of Boolean implication relationships (BIRs) between pairs of features. We mine such relationships with a sparse-exception binomial test. The mined implications form a typed directed graph, equivalent to a propositional rule base of 2-literal clauses. We encode this graph as the connectivity of a layered neural network, called BIRDNet, in which each hidden unit corresponds to one mined rule and binds only to its two features. We show two consequences of this design: First, the architecture is sparse by construction: at most 2 / d 2/d of the weights in each BIR layer are active, where d d is the input dimension. Second, the model is interpretable: every trained unit keeps a stable symbolic identity, so rules can be read off the network without surrogate models. Unlike most neurosymbolic models, BIRDNet does not consume an external rule base; its structural prior is mined from the data. We evaluate BIRDNet on six transcriptomic and proteomic benchmarks. Our results show that BIRDNet stays within 0.02 AUROC of the strongest dense baseline, at a small accuracy cost, while using up to 96 × 96\times fewer active parameters than an architecture-matched dense MLP. First-layer rules recover known biological signatures across multiple cancer subtypes and tissue types, including canonical amplicons, lineage-defining co-expression modules, and immune-infiltration markers. Data and code are available at: https://github.com/MAHI-Group/BIRDNet . 1. Introduction Tabular data in knowledge-rich scientific domains often carries latent symbolic structure that a black-box predictor cannot fully exploit. In gene expression and proteomics, and more broadly across binarisable measurement modalities, pairs of features routinely satisfy strong logical relationships of the form “high a implies high b ,” “low a implies low b ,” and their negations ( 15 ) . The complete set of such relationships across all feature pairs constitutes a typed directed graph that can be mined directly from data without supervision. Its strongest implications often align with known relational structure in the domain of interest such as gene-regulatory interactions in transcriptomics or protein interactions in proteomics datasets ( 16 ) . In this paper, we investigate whether this mined graph can serve as the architecture of a deep neural network. To this end, we propose BIRDNet, a network whose connectivity in each hidden layer is determined entirely by an implication graph mined from available training data. Each hidden unit in a BIRDNet corresponds to one mined implication. It connects only to the two features participating in that implication, and a binary mask fixed at construction time enforces this structure throughout training. While the first hidden layer of BIRDNet corresponds directly to implications mined among input features, defining the connectivity of subsequent layers is less direct: there are no raw features to mine over. We address this by constructing subsequent layers greedily: layer \ell mines a fresh implication graph on the post-activation outputs of layer \ell{-}1 , and contributes one hidden unit per mined implication. Sparsity follows from the same topological constraint at every layer, since each hidden unit has exactly two active incoming weights. The same constraint also gives interpretability of the model. Each hidden unit is bound at construction to one mined implication over two named features, and this binding is preserved throughout training. The rules contributing to a prediction can therefore be read off the network directly, without post-hoc attribution. Related work. Building neurosymbolic AI models typically relies on an external, hand-curated rule base or ontology, with a neural model constrained to respect it. For instance, in biomedicine, DCell ( 10 ) encodes the Gene Ontology and P-NET ( 5 ) encodes Reactome pathways, in both cases routing connectivity through a curated hierarchy of biological concepts. Outside biology, Compositional Relational Machines ( 17 ) populate vertices with first-order features composed via an expert-specified mode language, and a broader family of approaches injects logical rules or knowledge graphs into neural training as soft constraints or differentiable layers ( 7 ; 19 ; 4 ) . In all of these, the symbolic prior is external to the data, and the role of the network is to obey it. BIRDNet takes a different route. Its structural prior is not supplied; it is mined from the training data by a statistical test with a precise propositional reading. The symbolic content the network internalises is therefore already present in the data it is asked to model, rather than imposed on top of it. Of course, this data-driven prior has its own limitations, which we discuss in Section 4 . Contributions. Our contributions are the following: (1) we formalise Boolean implication knowledge graphs as a typed, data-mineable representation suitable for use as a structural prior of a deep neural network; (2) we introduce BIRDNet, a layer-wise sparse architecture that encodes the mined graph as connectivity, prove a 2/d upper bound on the active-weight fraction per BIR layer (so the compression ratio over an architecture-matched dense layer grows linearly with input dimension d ), and give a rule-extraction procedure that maps trained units back to weighted symbolic rules; and (3) we evaluate BIRDNet on six biomedical benchmarks (number of instances n from 566 to 10 051, number of features d from 77 to 54 675, number of classes k from 5 to 27) spanning transcriptomics and proteomics. Beyond the main results, implementation details, per-class rule tables for all six datasets, and per-instance rule traces are made available in a supplementary file in the code repository. 2. Method 2.1. Mining the implication knowledge graph Let X\in\mathbb{R}^{n\times d} be a feature matrix over n samples and d features. Each feature is binarised independently using the StepMiner threshold \tau_{j} , obtained by sorting the values of X_{\cdot j} and fitting a single-step function that minimises the within-segment sum of squared residuals ( 15 ) . The step location \tau_{j} separates a low-valued segment from a high-valued segment, which suits features with approximately bimodal distributions. The binarised matrix B\in\{0,1\}^{n\times d} has B_{ij}=\mathbf{1}[X_{ij}>\tau_{j}] . A Boolean implication relationship (BIR) is defined over an ordered pair of features (a,b) . For each such pair we test four primary implication types T_{0}\!:a^{H}{\to}b^{H} , T_{1}\!:a^{L}{\to}b^{L} , T_{2}\!:a^{H}{\to}b^{L} , T_{3}\!:a^{L}{\to}b^{H} , where a^{H},a^{L} denote B_{\cdot a}=1 and B_{\cdot a}=0 respectively. For each candidate we count exception samples (those violating the implication) and test the null that this count is consistent with a binomial whose success probability is the marginal product under independence. An implication is asserted whenever the right-tail p -value falls below p^{*}=10^{-6} and the exception fraction does not exceed \pi=0.05 ( 15 ) . Pairs satisfying both T_{0} and T_{1} are labelled equivalent ( T_{4} , a\equiv b ); pairs satisfying both T_{2} and T_{3} are labelled opposite ( T_{5} , a\equiv\neg b ). The output is a typed directed graph \mathcal{G}=(V,E,\mathit{type}) with \mathit{type}:E\to\{T_{0},\dots,T_{5}\} . We call \mathcal{G} the Boolean implication knowledge graph of X . Propositional semantics. For each feature a ,

Read the complete text