Interpretable Hybrid Machine Learning Models Using FOLD-R++ and Answer Set Programming
Sanne Wielinga, Jesse Heyninck · 2025
Read Interpretable Hybrid Machine Learning Models Using FOLD-R++ and Answer Set Programming by Sanne Wielinga, Jesse Heyninck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19573.txt.
Introduction
Sanne Wielinga and Jesse Heyninck present a 2025 paper on medical prediction models that can explain themselves. Neural networks predict well but cannot say why, which limits trust in high-stakes care. Pure logic systems explain their rules clearly but often predict worse.
Their hybrid joins both sides. A rule-learning method called FOLD-R++ produces readable logical rules through answer set programming. A standard black-box classifier handles the bulk of cases. Where the classifier is unsure, the rules step in to correct the call and supply a human-readable reason. Tests on five medical datasets showed real gains in accuracy and in the balanced F1 score. The study argues accuracy and clarity can rise together.
Catalog record
| CREATOR | Sanne Wielinga, Jesse Heyninck |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-19573
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Interpretable Hybrid Machine Learning Models Using FOLD-R++ and Answer Set Programming Sanne Wielinga, Jesse Heyninck Abstract Machine learning (ML) techniques play a pivotal role in high-stakes domains such as healthcare, where accurate predictions can greatly enhance decision-making. However, most high-performing methods such as neural networks and ensemble methods are often opaque, limiting trust and broader adoption. In parallel, symbolic methods like Answer Set Programming (ASP) offer the possibility of interpretable logical rules but do not always match the predictive power of ML models. This paper proposes a hybrid approach that integrates ASP-derived rules from the FOLD-R++ algorithm with black-box ML classifiers to selectively correct uncertain predictions and provide human-readable explanations. Experiments on five medical datasets reveal statistically significant performance gains in accuracy and F1 score. This study underscores the potential of combining symbolic reasoning with conventional ML to achieve high interpretability without sacrificing accuracy. 1 Introduction Machine learning has become an essential tool for predictive analytics and decision-making in various domains, including healthcare ( Tonekaboni et al. 2019 ) . Advanced ML models, particularly black-box models such as neural networks and ensemble methods, have shown impressive predictive performance. However, many of these high-performing models offer little insight into why a specific prediction is made. This lack of transparency slows down the adoption of models in applications where understanding the reasoning behind a prediction is as important as the prediction itself ( Arrieta et al. 2020 ) . In fields like medicine, decisions informed by ML models can have serious implications on patient outcomes. The ability to explain and justify predictions is therefore important for trust, accountability, and informed decision-making ( Doshi-Velez and Kim 2017 ) . Meanwhile, symbolic methods such as Answer Set Programming (in short, ASP), allow to represent knowledge in transparent, human-understandable logical rules ( Erdem et al. 2016 ) . The FOLD-R++ algorithm uses ASP to learn default rules ( Wang and Gupta 2022 ) . These rules can complement black-box models by offering explanations for their predictions and therefore improving interpretability. However, integrating ASP-derived rules with black-box ML models without changing their internal mechanisms remains challenging. Hybrid neuro-symbolic methods have emerged as a promising solution, though most of them emphasize neural architectures and require specialized integration ( Garcez et al. 2019 ; Manhaeve et al. 2018 ; Yang et al. 2023 ) . In contrast, relatively few works integrate symbolic rules with other types of black-box models, such as support vector machines or ensemble methods. This paper proposes a hybrid approach that addresses this gap by integrating FOLD-R++, an algorithm that learns ASP rules with exceptions ( Wang and Gupta 2022 ) , with various black-box ML models. By using rules that capture domain knowledge, the hybrid system can (1) correct ML model errors when the model is uncertain and (2) provide human-readable explanations. The following research questions guide this study: RQ1 : Does integrating interpretable ASP rules derived from FOLD-R++ improve the predictive performance of black-box ML models across various medical datasets? RQ2 : How does the hybrid model of ML and ASP improve the interpretability of predictions? The remainder of this paper is organized as follows: Section 2 provides an overview of interpretability research and other related approaches. Section 3 covers the background on ASP syntax and semantics, the FOLD-R++ algorithm, and a brief discussion of traditional ML methods. Section 4 outlines the methodology, including data preparation, model training, and hybrid model implementation. Section 5 presents the empirical findings. Section 6 concludes with limitations and paths for future research. 2 Related Work 2.1 Interpretability and Related Approaches The need for interpretable ML has surged amid concerns for trust, transparency, and accountability ( Guidotti et al. 2018 ) . Traditional interpretable models, such as decision trees and linear models, provide clear decision paths but may miss complex interactions in large datasets. In contrast, advanced ML techniques, such as deep neural networks and ensemble methods, achieve superior performance but function as ”black-box” models with opaque decision-making processes.. This opacity is problematic in areas such as healthcare, where interpretability is essential for ethical considerations, regulatory compliance, and establishing trust among clinicians and patients ( Tonekaboni et al. 2019 ) . Clinicians must understand how a model arrived at a specific diagnosis to trust and effectively use it in decision-making ( Tonekaboni et al. 2019 ) . Lack of transparency can lead to mistrust or rejection of ML systems ( Arrieta et al. 2020 ) . Moreover, regulatory bodies increasingly require explanations for automated decisions, especially when they impact patient care ( Palaniappan et al. 2024 ) . Researchers have proposed various strategies to address these challenges. These include developing inherently interpretable models such as decision trees and rule-based systems ( Rudin 2019 ) , and using post-hoc techniques like SHAP ( Lundberg 2017 ) to explain predictions from black-box models. These methods attempt to approximate the behavior of complex models locally with simpler models. However, a trade-off exists between interpretability and performance: simple models may miss complex patterns, while complex models remain opaque. Our proposed hybrid method aims to navigate this trade-off by integrating interpretable rules with high-performing black box models. 2.2 Hybrid Models A key line of related work focuses on combining symbolic reasoning and machine learning, which focuses on integrating symbolic reasoning with neural networks, creating neuro-symbolic systems ( Garcez et al. 2019 ) . For instance, DeepProbLog integrates probabilistic logic programming with deep learning ( Manhaeve et al. 2018 ) . NeurASP is a framework that combines neural networks with ASP ( Yang et al. 2023 ) . These approaches often require modifications to the learning algorithms or network architectures, which can be complex and computationally intensive. Moreover, they primarily focus on neural networks and do not address integration with other types of black-box ML models, such as random forests or support vector machines. Thus, a gap remains on the model-agnostic integration of symbolic reasoning. This study addresses this gap by integrating interpretable ASP rules from FOLD-R++ with a variety of black-box ML classifiers. The hybrid approach does not require changing the ML models, thus preserving their performance. The ASP component adds a layer of interpretability by offering human-understandable explanations for the predictions. 3 Background 3.1 Symbolic Logic and Answer Set Programming Symbolic logic offers a framework for interpretable models by encoding knowledge in structured, human-readable formats. Answer Set Programming combines logic programming with non-monotonic reasoning to represent complex relationships and constraints ( Erdem et al. 2016 ) . ASP programs consist of rules, which in turn are composed of literals (positive or negated atomic formulas) and constraints that define which combinations of literals cannot all be true simultaneously (integrity constraints). A key aspect of ASP is its use of stable model or answer set semantics to determine which sets of ground literals are considered stable solutions to a program. The non-monotonic nature of ASP makes it ideal for representing default rules and exceptions. An answer set program II consists of rules of the form: a 0 :- a 1 , ..., a m , not a m+1 , ..., not a n . where each a i is an atom, and not represents negation as failure. The head of the rule ( a