GLIDR: Graph-Like Inductive Logic Programming with Differentiable Reasoning

Blair Johnson, Clayton Kerce, Faramarz Fekri · 2025

Read GLIDR: Graph-Like Inductive Logic Programming with Differentiable Reasoning by Blair Johnson, Clayton Kerce, Faramarz Fekri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06716.txt.

Introduction

Johnson, Kerce, and Fekri introduce GLIDR, a system that learns explicit logic rules from knowledge graphs using differentiable reasoning. Rule learning gives interpretable predictions for tasks like completing missing links, but most methods assume rules are simple chains, which limits what they can express and how well they read. GLIDR's inference passes messages in a way that allows branches and cycles in rules, with a single knob capping how many free variables a rule may use.

Trained models can hand their rules to ordinary symbolic solvers. On knowledge graph completion tests, GLIDR beat earlier rule learners and even rivaled embedding methods, despite using structure alone. Its extracted rules kept much of the predictive power, and the method proved robust to noisy training data. It can also be chained into neural networks for rule learning on other data types.

Catalog record

CREATORBlair Johnson, Clayton Kerce, Faramarz Fekri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06716

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GLIDR: Graph-Like Inductive Logic Programming with Differentiable Reasoning Blair Johnson, Clayton Kerce, Faramarz Fekri Abstract Differentiable inductive logic programming (ILP) techniques have proven effective at finding approximate rule-based solutions to link prediction and node classification problems on knowledge graphs; however, the common assumption of chain-like rule structure can hamper the performance and interpretability of existing approaches. We introduce GLIDR, a differentiable rule learning method that models the inference of logic rules with more expressive syntax than previous methods. GLIDR uses a differentiable message passing inference algorithm that generalizes previous chain-like rule learning methods to allow rules with features like branches and cycles. GLIDR has a simple and expressive rule search space which is parameterized by a limit on the maximum number of free variables that may be included in a rule. Explicit logic rules can be extracted from the weights of a GLIDR model for use with symbolic solvers. We demonstrate that GLIDR can significantly outperform existing rule learning methods on knowledge graph completion tasks and even compete with embedding methods despite the inherent disadvantage of being a structure-only prediction method. We show that rules extracted from GLIDR retain significant predictive performance, and that GLIDR is highly robust to training data noise. Finally, we demonstrate that GLIDR can be chained with deep neural networks and optimized end-to-end for rule learning on arbitrary data modalities. 1 Introduction This paper presents GLIDR (Graph-like Logical Induction with Differentiable Reasoning), a differentiable inductive logic programming (ILP) method that learns expressive graph-structured logical rules for knowledge graph reasoning. Unlike existing differentiable ILP approaches that are limited to chain-like rule structures, GLIDR supports an expressive syntax that can represent rules with branches, cycles, and complex variable interactions. The method consists of two key components: (1) a graph-like rule representational structure, and (2) a differentiable message passing algorithm for deriving the entailment of rules encoded in this representational structure. Experiments on knowledge graph completion benchmarks demonstrate GLIDR’s expanded expressiveness enables it to significantly outperform existing rule learning methods while maintaining the noise robustness and scalability advantages of differentiable approaches. Furthermore, as a differentiable method, GLIDR can be integrated end-to-end with deep neural networks, enabling rule learning on mixed symbolic and continuous data modalities. 1.1 Inductive Logic Programming Inductive Logic Programming (ILP) is a machine learning technique that learns from examples of facts to construct logical rules. ILP benefits from a strong modeling bias that allows it to learn from small amounts of data, and the logical nature of the models it produces is explicitly interpretable. Learned rules explicitly describe the conditions under which a model makes a given prediction. In doing this, learned rules often reveal explicit knowledge about the patterns present in the data used for training. The logical rules learned by ILP systems are typically first-order logic rules comprised of predicates, variables, constants, and logical operators. A predicate P can represent conceptual relationships or properties. Constants represent specific entities, and predicates can be combined with constants to represent facts. For instance, \text{dog}(\text{Rufus}) , uses the ”dog” predicate to record the fact that a specific entity, ”Rufus”, is a dog. Sometimes, we need to express facts that are true for many entities without enumerating them. Logic variables allow first-order logic to express abstract facts in this manner. The fact \forall X,Y(\text{parent}(X)\leftarrow\text{has\_child}(X,Y)) states that for all possible pairs of entities, represented by variables X,Y , if the entity represented by Y is the child of the entity represented by X , then X must necessarily be a parent. We call abstract facts of this nature rules because they describe patterns of other facts. The first term of the rule, \text{parent}(X) , is referred to as the head literal and is implied to be true whenever the fact described by the body literal , \text{has\_child}(X,Y) , is true. Logical operators like conjunction ( \wedge ) and disjunction ( \vee ) allow first order logic to express more complex facts. The conjunction operator represents the logical AND of facts, and it is frequently used to combine multiple literals in a rule body to express simultaneously necessary conditions. For example, the rule \forall X,Y,Z( grandparent (X,Y)\leftarrow parent (X,Z)\wedge parent (Z,Y)) represents the fact that an entity X is always the grandparent of an entity Y if X is the parent of an entity Z and that entity Z is the parent of Y . The disjunction operator implements the logical OR of facts, meaning that at least one of the facts it connects must be true. ILP systems typically favor conjunctive rule bodies because they are computationally efficient to evaluate and describe clear, human-understandable sets of truth conditions. Using these simple primitives, rules learned by ILP can represent highly expressive statements about the world. 1.2 Knowledge Graphs As ILP deals heavily with relational facts, ILP problems are closely related to knowledge graph reasoning problems. Knowledge graphs are useful and convenient data structures for encoding information about entities, their properties, and the relationships between them. The generality of knowledge graphs as a mechanism for storing and retrieving relational information has resulted in widespread adoption across many domains such as biomedicine nicholson2020constructing ; ernst2015knowlife , cybersecurity piplai2020cyber ; qi2023attack , financial crime suzumura2019towards , and public health park2021discovering ; bettencourt2020exploring . By representing knowledge in a structured and machine-readable format, knowledge graphs have enabled a wide range of applications, including question answering, recommendation systems Fensel2020 , and decision support systems nickel2015review . All of these applications rely on the core tasks of predicting edges and classifying nodes using the background knowledge contained in the knowledge graph. These tasks can also be represented as ILP problems, and ILP methods are frequently evaluated on knowledge graph completion benchmarks. While embedding methods represent the most popular and performant approaches for knowledge graph reasoning tasks, they have several important limitations. The most significant limitation of embedding methods is that they typically operate in the transductive setting, and must be trained on a set of entities that overlaps those seen at test-time teru2020inductive . They often perform poorly on rare entities with few training examples zhang2019iteratively . They have limited interpretability GeseseBS19 ; HamiltonYL17 , and they struggle to model patterns that can be naturally compressed into rules qu2020rnnlogic . These limitations motivate the development of graph reasoning algorithms that can generate predictions from structure alone , enabling interpretability and generalization unseen data. 1.3 Previous Work Previous ILP techniques such as Progol muggleton1995progol , Aelph srinivasan_aleph , and Metagol muggleton_meta-interpretive_2015 have relied heavily on symbolic solvers, often implemented in Prolog, to search for rules that entailed the positive examples provided to the algorithm and reject the negative examples. These solvers used hypothesis generation algorithms, inverse entailment, heuristic search, and meta-templating strategies to construct rules explaining observed data. Recent advancements such as Popper cropper_learning_2021 have re-framed ILP problems as special cases of answer set programming (ASP) or Boolean satisfiability (SAT) problems. These approaches leverage high-performance SAT and ASP solvers to improve the performance and efficiency of the ILP process while enjoying the passive benefit of advancements in SAT and ASP solving. While symbolic ILP techniques like Metagol and Popper initially lacked noise tolerance, extensions to these methods have eased this limitation muggleton2018meta ; noisypopper ; hocquette_learning_2023 . Today’s

Read the complete text