Explanations Go Linear: Post-hoc Explainability for Tabular Data with Interpretable Meta-Encoding
Simone Piaggesi, Riccardo Guidotti, Fosca Giannotti, Dino Pedreschi · 2025
Read Explanations Go Linear: Post-hoc Explainability for Tabular Data with Interpretable Meta-Encoding by Simone Piaggesi, Riccardo Guidotti, Fosca Giannotti, Dino Pedreschi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20667.txt.
Introduction
Simone Piaggesi and co-authors present ILLUME, a framework that makes explanations of black-box models for tabular data both local and global, published in 2025. Surrogate-based explanations are popular but split awkwardly: local surrogates capture detail at high cost and with fragile settings, while global ones are cheap but miss local behavior.
ILLUME grounds explanation in representation learning. A globally trained surrogate is paired with instance-specific linear transformations learned by a meta-encoder. That pairing yields feature attributions and decision rules for single cases and for the model as a whole. Wide experiments showed the explanations were accurate, robust, and cheap to compute. The framework can be combined with various surrogate models, the authors note, offering one route around the limits of older methods.
Catalog record
| CREATOR | Simone Piaggesi, Riccardo Guidotti, Fosca Giannotti, Dino Pedreschi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20667
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Explanations Go Linear: Post-hoc Explainability for Tabular Data with Interpretable Meta-Encoding Thanks: This work has been partially supported by the European Community Horizon 2020 programme under the funding scheme ERC-2018-ADG G.A. 834756 XAI: Science and technology for the eXplanation of AI decision making , and the NextGenerationEU programme under the funding schemes: PNRR-PE-AI (M4C2, investment 1.3, line on AI) FAIR (Future Artificial Intelligence Research), and “ SoBigData.it - Strengthening the Italian RI for Social Mining and Big Data Analytics” - Prot. IR0000013, and by the Italian Project Fondo Italiano per la Scienza FIS00001966 MIMOSA. Simone Piaggesi, Riccardo Guidotti, Fosca Giannotti, Dino Pedreschi Abstract Post-hoc explainability is essential for understanding black-box machine learning models. Surrogate-based techniques are widely used for local and global model-agnostic explanations but have significant limitations. Local surrogates capture non-linearities but are computationally expensive and sensitive to parameters, while global surrogates are more efficient but struggle with complex local behaviors. In this paper, we present illume , a flexible and interpretable framework grounded in representation learning, that can be integrated with various surrogate models to provide explanations for any black-box classifier. Specifically, our approach combines a globally trained surrogate with instance-specific linear transformations learned with a meta-encoder to generate both local and global explanations. Through extensive empirical evaluations, we demonstrate the effectiveness of illume in producing feature attributions and decision rules that are not only accurate but also robust and computationally efficient, thus providing a unified explanation framework that effectively addresses the limitations of traditional surrogate methods. I Introduction In eXplainable AI (XAI), post-hoc explanations seek to clarify how machine learning (ML) black-box models make decisions. Commonly studied explanations are feature attribution, decision rules, and counterfactuals [ 1 , 2 ] . Among post-hoc techniques, surrogate explainers are largely adopted given their effectiveness in performing complex model distillation [ 3 ] . Global surrogates, like trepan [ 4 ] and related approaches [ 5 ] , involve training a single interpretable model (e.g., linear regression or decision tree) to replicate the behavior of the target black-box across the entire dataset, providing broad insight but often missing complex non-linear patterns. Instead, local surrogates, such as lime [ 6 ] and lore [ 7 ] , build an interpretable model within a (typically synthetically generated) neighborhood of each specific instance, thus better approximating local non-linearities of decision boundaries. Despite being pivotal for explainability [ 1 , 8 ] , existing local explainers face several limitations [ 9 , 10 ] , including instability [ 11 ] , sensitivity to hyperparameters [ 12 ] , computational inefficiencies [ 13 ] and misleading behaviors [ 14 ] . These drawbacks are primarily attributed to the biases and sampling variability introduced by the neighborhood generation [ 15 , 16 ] . In this work, we bridge the gap between local and global surrogate methods by providing a comprehensive post-hoc explanation framework that: (i) overcomes the restrictions of global surrogates regarding their generalization capabilities, (ii) addresses the methodological issues of local surrogates going beyond neighborhood sampling, and (iii) supports any type of explanation format. Our proposed framework redefines the post-hoc explanation problem by operating in a feature space distinct from the input. Specifically, it transforms the data into a latent representation [ 17 ] that enhances the expressiveness of global surrogate explanations. Fig. 1 : Accuracy-interpretability trade-off for neural encoding. Typically, latent mappings [ 18 ] are produced by highly non-linear operations, such as neural networks (NNs), and present uninterpretable features, rendering any surrogate explanations that rely on these features ineffective. Conversely, creating interpretable embeddings is inherently challenging [ 19 ] and requires balancing accuracy with transparency [ 20 ] . Most straightforward interpretable encodings are achieved through linear transformations, e.g., implemented as single-layer NNs [ 21 , 22 ] without non-linear activations. As in Figure 1 , linear NNs (on the right) can be seen as interpretable considering the single-layer structure and the additive nature of output neurons when activation functions are not used. However, at the same time, they are also too restrictive due to their overly simplified architecture [ 23 ] . Specifically, they provide interpretable transformations both globally, since the single-layer network defines a linear function with a unique weights matrix W , and locally, since it applies linearly on each specific instance \mathbf{x} , resulting in the latent representation \mathbf{z}=W\mathbf{x} . In contrast, deep NNs achieve greater accuracy but are not interpretable, because applying \mathit{NN}(\mathbf{x}) involves obscure complex and stacked (global and local) nonlinear operations. Neural Additive Models (NAMs) [ 24 ] are possible candidates for balancing this trade-off. NAMs define the mapping as a sum of non-linear functions \mathit{NN}_{j}(x_{j}) , for each feature j , possibly including feature interactions \mathit{NN}_{jj^{\prime}}(x_{j},x_{j^{\prime}}) [ 25 ] . NAMs are human-readable by looking at visual plots of NN_{j} s and NN_{jj^{\prime}} s [ 24 ] . However, assuming only pairwise interactions, NAMs are restrictive and higher-order extensions lose interpretability and scalability. As an alternative solution to balance the trade-off, we introduce locally linear transformations as non-linear maps \eta , such that \eta(\mathbf{x})=W(\mathbf{x})\mathbf{x} , where W(\mathbf{x}) is a neural function returning a specific weight matrix once applied to any instance \mathbf{x} . We see that the output of the function \eta is linear when applied on instance \mathbf{x} , without being a linear model as a whole, i.e., globally non-linear. Intuitively, \eta acts as a meta -encoder, returning for each instance a proper linear encoding used to transform the instance itself. In combination with a global surrogate model, such meta-encoding approach can be remarkably effective. Specifically, we found that global explanations deriving from latent space surrogates can be turned into local explanations in the original space if the latent mapping is done with locally linear transformations . From a certain point of view, our proposal is inspired by HyperNetworks [ 26 ] , a class of NNs used to generate the weights for other NNs. However, in our case, the generated NN is single-layer perceptron without biases. To give an intuition, we examine the case of additive feature importance methods like lime [ 6 ] and shap [ 13 ] . Let \mathbf{x}=\{x_{1},\dots,x_{m}\} be one input to a black-box classifier b(\cdot) , where x_{j} is the value of j -th feature in \mathbf{x} . Local additive explainers fit an instance-specific linear model b(\mathbf{x})\approx\sum_{j}\psi_{j}(\mathbf{x})x_{j} , where each learned weight \psi_{j}(\mathbf{x}) is the contribution of feature j to the opaque prediction for instance \mathbf{x} . On the other hand, analogous global surrogates enable an additive expression of the log-odds as \log\frac{b(\mathbf{x})}{1-b(\mathbf{x})}\approx\sum_{j}\beta_{j}x_{j} [ 27 ] . Contrarily to local methods, here the weights \boldsymbol{\beta}=\{\beta_{1},\dots,\beta_{m}\} do not depend on the specific \mathbf{x} , failing to describe black-box behavior locally. In our approach, we fit a latent interpretable surrogate, e.g., the linear regressor \sum_{r}\beta^{L}_{r}z_{r} , whose variables are obtained through locally linear maps, i.e., z_{r}=\sum_{j}W_{j,r}(\mathbf{x})x_{j} . Because W is a linear operation depending on \mathbf{x} , the latent global weights can be pulled back to the original features \log\frac{b(\mathbf{x})}{1-b(\mathbf{x})}\approx\sum_{j}(W(\mathbf{x})^{\top}\cdot\boldsymbol{\beta}^{L})_{j}x_{j} , yielding local attribution scores valid in the input space. Similarly, the illustrated approach can be applied to any other surrogate explanations, including factual and counterfactual rules returned by lore [ 7 ] or decision trees adopted as global