Learning Concept-Driven Logical Rules for Interpretable and Generalizable Medical Image Classification

Yibo Gao 1, Hangqi Zhou 1, Zheyao Gao 2, Bomin Wang 1, Shangqi Gao 3, Sihan Wang 1, Xiahai Zhuang 1 · 2025

Read Learning Concept-Driven Logical Rules for Interpretable and Generalizable Medical Image Classification by Yibo Gao 1, Hangqi Zhou 1, Zheyao Gao 2, Bomin Wang 1, Shangqi Gao 3, Sihan Wang 1, Xiahai Zhuang 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14049.txt.

Introduction

Gao and co-authors build a medical image classifier whose decisions read as plain logical rules built from named concepts. Concept-based models promise explanations doctors can audit, but soft concept scores can smuggle stray information, and most give only case-by-case reasons. Their 2025 framework learns yes-no concepts from images, then layers logic over them to extract rules.

The rules explain both single cases and the model's global behavior. On two medical imaging tasks, the model matched rival accuracy while generalizing far better to data from new sources. The authors release their code. They present rule-based reading as a safety feature for clinical AI.

Catalog record

CREATORYibo Gao 1, Hangqi Zhou 1, Zheyao Gao 2, Bomin Wang 1, Shangqi Gao 3, Sihan Wang 1, Xiahai Zhuang 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14049

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Concept-Driven Logical Rules for Interpretable and Generalizable Medical Image Classification Yibo Gao 1, Hangqi Zhou 1, Zheyao Gao 2, Bomin Wang 1, Shangqi Gao 3, Sihan Wang 1, Xiahai Zhuang 1 Abstract The pursuit of decision safety in clinical applications highlights the potential of concept-based methods in medical imaging. While these models offer active interpretability, they often suffer from concept leakages , where unintended information within soft concept representations undermines both interpretability and generalizability. Moreover, most concept-based models focus solely on local explanations (instance-level), neglecting the global decision logic (dataset-level). To address these limitations, we propose Concept Rule Learner (CRL), a novel framework to learn Boolean logical rules from binarized visual concepts. CRL employs logical layers to capture concept correlations and extract clinically meaningful rules, thereby providing both local and global interpretability. Experiments on two medical image classification tasks show that CRL achieves competitive performance with existing methods while significantly improving generalizability to out-of-distribution data. The code of our work is available at https://github.com/obiyoag/crl . 1 Introduction Deep learning models, especially those operating as black boxes, have shown great promise in medical imaging applications [ 10 , 13 , 12 ] . However, the high standards of trust and accountability required in healthcare have spurred growing interest in explainable approaches [ 22 ] . Merely attempting to interpret black-box models could inadvertently reinforce flawed clinical practices and lead to harmful medical outcomes [ 19 ] . Therefore, it is essential to develop self-explanatory methods for medical imaging. Recently, Concept Bottleneck Models (CBMs) [ 11 ] have gained attention as an effective approach to foster active interpretability [ 25 ] . In CBMs, a set of interpretable intermediate concepts is first generated by a concept predictor, and these concepts are then used to make the final predictions by a label predictor. Building on CBMs, Concept Embedding Models (CEMs) [ 6 ] improve the predictive performance by employing high-dimensional concept representations and demonstrate their applicability in medical domain [ 7 ] . However, both CBMs and CEMs suffer from concept leakage [ 14 ] , where the label predictor inadvertently exploits unintended information from concept probabilities or embeddings. This leakage compromises both interpretability and generalizability [ 15 ] . In terms of interpretability, the predictions are influenced not only by the intended concepts but also by image information encoded in the soft concepts ( i.e. probabilities or embeddings). The concept predictor no longer needs to faithfully predict the concepts to obtain accurate label predictions. Regarding generalizability, reliance on unintended leaked information may lead to overfitting, rendering the models less robust to distribution shifts. The overfitting occurs because the soft concepts may encode spurious correlations that are not representative of the true underlying concepts. Furthermore, most concept-based models only provide explicit local explanations by focusing on individual predictions, detailing how predicted concepts influence each decision [ 16 , 24 ] . They offer insights for particular instances but may not fully capture the overall decision logic across the entire category or dataset. To achieve a more comprehensive interpretability, it’s essential to integrate both local and global explanations [ 25 , 20 ] . A recent work, named Deep Concept Reasoner (DCR) [ 2 ] , explores to extract syntactic logical rules from concept embeddings. However, building upon fuzzy logic and concept embeddings, DCR’s decision-making process becomes less transparent and susceptible to concept leakage. To mitigate the issue of concept leakage and unify local and global explanations, we propose the Concept Rule Learner (CRL), a framework to learn Boolean logical rules from visual concepts. To alleviate concept leakage, CRL employs binary concept values ( i.e. , 0 and 1), which inherently carry less unintended image information. CRL introduces logical layers [ 23 ] to model Boolean logical operations, thereby capturing correlations between concepts. Each logical layer comprises a conjunction layer and a disjunction layer, which perform the AND and OR operations, respectively. The connections across these layers generate flexible decision rules, and the final prediction for an input image is derived by aggregating the contributions of triggered rules through linear weights. By making decisions based on domain-invariant logical rules, CRL not only incorporates global interpretability, but also improves generalizability to unseen domains. Our main contributions can be summarized as follows: \bullet We propose CRL, a novel framework that learns Boolean logical rules from binarized visual concepts to model concept correlations, while mitigating the issue of concept leakage. \bullet CRL not only delivers concept explanations for individual predictions but also extracts decision rules for the entire datasets, thereby unifying local and global interpretations. \bullet We evaluate the effectiveness of the proposed methods on two medical image classification tasks. The experimental results demonstrate that our approach can extract meaningful concept logical rules and exhibits superior generalizability to the unseen dataset. 2 Method 2.1 Model Architecture Figure 1 : The architecture of Concept Rule Learner (CRL). CRL is a composition of four functions (f\circ r\circ q\circ g) , where g(\cdot) represents the concept predictor, r(\cdot) denotes a stack of logical layers, q(\cdot) means discretization and f(\cdot) corresponds to a linear layer. The decision interpretation is presented in the dashed box, illustrating how concepts and rules contribute to the final prediction. Given an image \mathbf{x}\in\mathbb{R}^{n} annotated with a task label y\in\{1,\cdots,L\} and K concept labels \mathbf{c}\in\{0,1\}^{K} , our objective is to develop a Concept Rule Learner (CRL) capable of performing medical image classification through concept-driven logical rules. As illustrated in Fig. 1 , the CRL framework is a quadruple of functions \boldsymbol{(g,q,r,f)} , whose composition (f\circ r\circ q\circ g) predicts the label based on the derived concepts and rules. The first function \boldsymbol{g}:\mathbb{R}^{n}\to[0,1]^{K} , referred to as the concept predictor, learns a mapping from the input image \mathbf{x} to a set of concept activations \hat{\mathbf{c}}=g(\mathbf{x})\in[0,1]^{K} , where \hat{c}_{i} represents the probability supporting the presence of the i -th concept. The second function \boldsymbol{q}:[0,1]^{K}\to\{0,1\}^{K} serves as a binarizer that converts the concept activations into binary values. The third function \boldsymbol{r}:\{0,1\}^{K}\to\{0,1\}^{R} , consists of a series of logical layers adopted from [ 23 ] . This function maps the activated concepts to a set of rule activations \mathbf{r}=r(q(\hat{\mathbf{c}}))\in\{0,1\}^{R} , where R denotes the total number of extracted logical rules. A rule activation r_{i}=1 indicates that the i -th rule is activated for the input image \mathbf{x} and 0 for otherwise. The fourth function \boldsymbol{f}:\{0,1\}^{R}\to\mathbb{R}^{L} , represents the final linear layer, which learns the mapping from the activated logical rules to the task logits \hat{\mathbf{y}}=f(\hat{\mathbf{r}})\in\mathbb{R}^{L} . (a) (b) Figure 2 : (a) An example of two adjacent logical layers, where the directed arrows indicates the presence of the connections between nodes. The corresponding rules could be derived by analyzing the connections. (b) The computation graph of CRL. Arrows with solid lines represent forward pass while arrows with dashed lines represent backpropagation. 2.2 Logical Operation Modelling To learn logical rules from concept activations, the function r(\cdot) adopts a series of logical layers to model the concept-based rules with Boolean logic. Let \mathcal{N}^{l} denote the l -th logical layer, where n_{j}^{l} represents the j -th node within the layer. The output of layer \mathcal{N}^{l} is a vector containing the values of all the nodes, denoted as \mathbf{n}^{l} . As shown in Fig.

Read the complete text