Evaluating Local Explainability Metrics for Machine Learning Models on Tabular Data
Tomás Pereira, João Vitorino, Eva Maia, Isabel Praça · 2026
Read Evaluating Local Explainability Metrics for Machine Learning Models on Tabular Data by Tomás Pereira, João Vitorino, Eva Maia, Isabel Praça (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27618.txt.
Introduction
Tomas Pereira, Joao Vitorino, Eva Maia, and Isabel Praca test local explanation scores for table-based machine learning models. They test LIME, SHAP, and feature ablation across 32 datasets on faithfulness, toughness, and explanation size, splitting samples into all-right and all-wrong groups. Explanations do not always track predictive performance; dataset complexity and feature spread drive explanation quality instead.
Catalog record
| CREATOR | Tomás Pereira, João Vitorino, Eva Maia, Isabel Praça |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46320 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27618
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating Local Explainability Metrics for Machine Learning Models on Tabular Data Tomás Pereira, João Vitorino, Eva Maia, Isabel Praça Abstract Despite the wide use of explainability techniques to attempt to understand the behavior of Artificial Intelligence (AI), the generated explanations may not always be reliable. An explanation can appear plausible to humans but fail to capture the internal reasoning of a model, particularly when dealing with complex tabular data. This paper studies the trustworthiness of local explainability techniques when applied to complex tabular classification tasks, considering evaluated metrics for three main properties: faithfulness to the model’s predictions, robustness to input data variations, and complexity of the explanation itself. A benchmark was performed for Local Interpretable Model-Agnostic Explanations (LIME), Kernel SHapley Additive exPlanations (SHAP), and Feature Ablation techniques, across 32 datasets and different types of machine learning models. Model performance ranges were analyzed to identify two groups: consensus-correct, which are samples that all models predicted correctly, and consensus-wrong, samples that all models predicted incorrectly. The obtained results demonstrate that that the explanations are not always correlated with a model’s predictive performance. Instead, dataset complexity and feature distributions seem to be the main factors affecting explanation quality and reliability. I Introduction Artificial Intelligence (AI) is being increasingly used to support and automate decisions and business processes across a wide range of domains. In particular, machine learning models are now frequently used to automate tasks such as risk assessment, fraud detection, medical decision support, and other operational processes where predictions directly influence real-world outcomes [ 23 , 1 ] . However, with the increasing complexity of AI models, in most cases users cannot trace how a predictions was made. These black-box models prioritize performance and accuracy over explainability and unlike more simple models like linear models, their inner workings are a lot of times unknown [ 23 , 1 , 22 ] . To address this challenge, a broad range of explainability techniques have been proposed. These techniques can have a global or a local scope [ 29 ] . Global methods attempt to explain the model’s behavior as a whole as means to verify if their decision boundaries are adequate to the problem at hand [ 29 ] . On the other hand, local explanations are particularly relevant in risk-sensitive scenarios, where understanding a specific decision is essential for trust, debugging, and accountability [ 12 ] . Despite the growing number of explainability techniques, evaluating the quality of an explanation itself remains an open problem. An explanation can appear plausible to humans but fail to represent the model’s true behavior. Furthermore, the same method may not always be consistent, behaving differently depending on the predictive model, dataset characteristics, or input data. Therefore it is important to perform a systematic and reproducible evaluation of the usefulness of the commonly used explainability techniques, with quantitative evaluation metrics. This work studies the trustworthiness of local explainability techniques when applied to complex tabular classification tasks, aiming to identify patterns and correlations between dataset complexity, model performance, and explanation trustworthiness. A benchmark was performed for three commonly used techniques: Local Interpretable Model-Agnostic Explanations (LIME), Kernel SHapley Additive exPlanations (SHAP), and Feature Ablation. The considered evaluation metrics were focused on three main properties: faithfulness to the model’s predictions, robustness to input data variations, and complexity of the explanation itself. The remainder of this paper is organized as follows. Section II reviews related work and compares available frameworks. Section III describes the selected metrics, explainability techniques, models, datasets, and the evaluation process. Section IV presents and discusses the results. Finally, Section V summarizes the main conclusions and future work. II Related Work It is essential to review prior work in explainable artificial intelligence (XAI), identifying which explainability techniques have been most widely adopted in recent years, and which evaluation metrics are more suitable for complex tabular data. II-A Explainability Techniques A review of recent papers and surveys addressing explanation techniques in XAI was performed. with the goal of identifying which have been most frequently adopted in recent years and which of them are repeatedly recommended for practical machine-learning settings. Across the surveyed literature, three broad categories are defined [ 29 ] , [ 25 ] : • Global: Global explanations try to explain the general behavior of the model. They are useful to, for examaple, determining the feature importance of the models. • Local: This type of explanation aims to explain a single prediction. They are critical to understand why the model takes certain decisions. • Counterfactual: Counterfactual explanations are mainly local explanations that try to understand what perturbations are necessary in the features of a single instance for the model’s prediction to change. Many different explainability techniques exist, covering various model architectures and goals. Table I summarizes the main explanation families considered in this study. TABLE I: Overview of Explainability Techniques Technique Type Model LIME [ 21 ] Local Agnostic SHAP [ 17 ] Local/Global¹ Machine Learning TreeSHAP [ 18 ] Local/Global¹ Tree models LinearSHAP [ 17 ] Local/Global¹ Linear models GradientSHAP [ 17 ] Local/Global¹ Neural Networks Kernel SHAP [ 17 ] Local/Global¹ Agnostic Feature Ablation [ 16 ] Local/Global¹ Agnostic Integrated Gradients [ 26 ] Local Neural Networks Grad-CAM [ 24 ] Local Neural Networks Partial Dependency Plots [ 11 ] Global Machine Learning DiCE [ 20 ] Counterfactual/Local Agnostic • ¹Global with sample aggregation LIME is a local, model-agnostic technique that explains a single prediction by generating perturbed samples around the instance of interest and fitting an interpretable surrogate model, typically linear, in that local neighborhood. SHAP is a framework based on Shapley values from cooperative game theory, where each feature receives a score according to its contribution to the prediction. Depending on how results are aggregated, SHAP can be interpreted locally for a single sample or globally across a dataset using sample aggregation. Several other specialized techniques exist to efficiently adapt SHAP to various models. TreeSHAP adapts SHAP to tree-based models and LinearSHAP performs the same role for linear models, making use of their simpler structure. GradientSHAP extends the idea to neural networks by combining gradient-based information with SHAP attribution values. Kernel SHAP is the model-agnostic implementation of SHAP and is especially relevant for this work because it can be applied to many model families. Feature Ablation is another model-agnostic approach that explains predictions by systematically removing or replacing individual features and measuring how much the model output changes. In practice, this provides a direct estimate of each feature’s influence on the prediction. The remaining techniques in the table cover settings that are outside the main focus of this paper but help give context to the chosen explanations. Integrated Gradients attributes predictions by accumulating gradients from a baseline input to the target instance, which makes it particularly suitable for neural network models. Grad-CAM highlights salient spatial regions in convolutional neural networks and is mainly used in image analysis. Partial Dependence Plots provide global explanations by showing how changes in one or more features affect the model’s average prediction. Finally, DiCE generates counterfactual explanations by identifying minimal feature changes that would alter the predicted class. In this paper, the focus is placed on local explanations, as they provide insight into model decisions at the sample