Towards Interpretable Deep Neural Networks for Tabular Data

Khawla Elhadri, Jörg Schlötterer, Christin Seifert · 2025

Read Towards Interpretable Deep Neural Networks for Tabular Data by Khawla Elhadri, Jörg Schlötterer, Christin Seifert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08617.txt.

Introduction

Khawla Elhadri and 2 co-authors propose XNNTab in a 2025 paper on interpretable deep learning for tabular data. Tables drive finance and health care work, but neural networks for them are often black boxes. Users cannot see why a prediction was made.

XNNTab uses a sparse autoencoder, a network that learns a small set of active features, inside its latent space. An automated step gives those features plain human meanings. Predictions then become weighted sums of meaningful parts. Tests match or beat strong black box and classic models. The gain is full interpretability without giving up accuracy.

Catalog record

CREATORKhawla Elhadri, Jörg Schlötterer, Christin Seifert
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08617

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Interpretable Deep Neural Networks for Tabular Data Khawla Elhadri, Jörg Schlötterer, Christin Seifert Abstract Tabular data is the foundation of many applications in fields such as finance and healthcare. Although DNNs tailored for tabular data achieve competitive predictive performance, they are blackboxes with little interpretability. We introduce XNNTab , a neural architecture that uses a sparse autoencoder (SAE) to learn a dictionary of monosemantic features within the latent space used for prediction. Using an automated method, we assign human-interpretable semantics to these features. This allows us to represent predictions as linear combinations of semantically meaningful components. Empirical evaluations demonstrate that XNNTab attains performance on par with or exceeding that of state-of-the-art, black-box neural models and classical machine learning approaches while being fully interpretable. 1 Introduction Tabular data is the most common type of data in a wide range of industries, including advertising, finance and healthcare. While deep neural networks (DNNs) achieved major advances in computer vision, their performance on tabular data remained below that of Gradient Boosted Decision Trees (GBDTs) ( Chen and Guestrin 2016 ; Khan et al. 2022 ) . To improve the performance of DNNs on tabular data, several deep learning methods have been developed with specialized architectures that take into account the unique traits of tabular data (mixture of categorical, ordinal and continuous features) in order to be on par ( Huang et al. 2020 ) or even outperform GBDTs ( Chen et al. 2024 ) . While these methods addressed the limitations of DNNs in terms of performance, DNNs still remain blackboxes, whose decisions are hard to communicate to end users ( Schwalbe and Finzel 2023 ) . In this paper, we address the interpretability limitation of existing DNNs and present XNNTab , a deep neural network with a sparse autoencoder (SAE) component. The SAE learns a dictionary of monosemantic, sparse features that are used for outcome prediction. We take inspiration from the success of SAEs in learning interpretable features from LLM’s internal activations ( Huben et al. 2023 ; Yun et al. 2021 ) . We use an automated method to assign human-understandable semantics to the learned monosemantic dictionary features. Our method is illustrated in Figure 1 and described in Section 3 . We show that XNNTab outperforms both interpretable and classical blackbox models and has similar performance to GBDTs. Additionally, XNNTab is fully interpretable: the final prediction is a simple linear combination of the interpretable dictionary features, which have easily accessible human-understandable semantics. 2 Related Work Gradient boosted decision trees (GBDTs) ( Chen and Guestrin 2016 ; Khan et al. 2022 ) have shown state-of-the art performance on tabular data ( Grinsztajn et al. 2022 ) . To close this performance gap to GBDTs, neural architectures specifically designed for tabular data have been proposed, such as attention-based architectures ( Gorishniy et al. 2021 ; Somepalli et al. 2022 ; Yan et al. 2023 ) , retrieval-augmented models ( Somepalli et al. 2022 ; Gorishniy et al. 2023 ) . Additional techniques include tailored regularizations ( Jeffares et al. 2023 ) , deep ensembles ( Gorishniy et al. 2024 ) , attentive feature selection strategies ( Arik and Pfister 2021 ) , categorical feature embedding ( Huang et al. 2020 ) and reconstruction of binned feature indices ( Lee et al. 2024 ) . Recent methods focus not only on performance, but also aim to include interpretability. ProtoGate ( Jiang et al. 2024 ) is an ante-hoc interpretable architecture for tabular data, which learns prototypes of classes and predicts new instances based on their similarity to class prototypes. InterpreTabNet ( Si et al. 2024 ) , a variant of TabNet ( Arik and Pfister 2021 ) adds post-hoc explanations by learning sparse feature attribution masks and using LLMs to interpret the learned features from the masks. Similar to ProtoGate and different to InterpetTabNet, XNNTab is intrinsically interpretable, i.e., it uses interpretable features directly for prediction. While ProtoGate relies on class prototypes, XNNTab learns relevant feature combinations that describe parts of instances, similar to part-prototype models ( Elhadri et al. 2025 ) . 3 Method XNNTab consists of a standard neural blackbox (e.g., an MLP) to learn nonlinear latent features, and a sparse autoencoder (SAE) ( Huben et al. 2023 ) to decompose this latent polysemantic feature space into monosemantic features (cf. Figure 1 , A). The monosemantic features are in a latent space with unknown (but unique) semantics. To assign meaning to each feature, we learn rules that describe the subset of the training samples that highly activate each feature (cf. Figure 1 , B). Finally, we combine the last linear layers into a single linear layer by multiplying their weight matrices (cf. Figure 1 , C). Figure 1: Architecture overview. A. An MLP learns nonlinear features, which are decomposed into monosemantic dictionary features using an SAE. B. Dictionary features are assigned a human-interpretable meaning by learning rules for the subset of training instances that highly activate a specific feature. C. Predictions are linear combinations of monosemantic features by combining the linear model components (the decoder, M^{T} , and the linear layer of the MLP, W ). 3.1 Architecture The base blackbox model is an MLP and with multiple hidden layers and a softmax output. We denote the penultimate layer as l , and the representations of this layer as h_{l} . The MLP learns a function \hat{y}=f(x) . f(x) can be decomposed into a function g learning the hidden representations h_{l} and a linear model h predicting the target based on h_{l} , i.e., \hat{y}=h(h_{l})=h(g(x)) . g(\cdot) is characterized by the parameters \theta_{g} , and h(\cdot) is characterized by the weight matrix W . For the SAE, we use the architecture introduced by Huben et al. 2023 . The SAE consists of an input layer, a hidden layer and an output layer. The size of the hidden layer is d_{hid}=R\cdot d_{in} with d_{in} being the dimension of the MLP’s layer l , and R a hyperparameter controlling the size of the feature dictionary. The input to the SAE are the hidden representations of the blackbox MLP h_{l} . The weights of the encoder and decoder are tied, and given by the matrix M ( M^{T} for the decoder) 1 1 1 Additionally, the encoder has a bias vector b . . The output of the SAE is given by \hat{h}_{l}=M^{T}\Bigl(RELU(Mh_{l}+b)\Bigr) . By design, \hat{h}_{l} is a sparse linear combinations of (latent) dictionary features. 3.2 Training XNNTab is trained in four steps: i) training of the MLP’s representation, ii) training of the SAE, and iii) finetuning of the decision layer, iv) combining linear components. Step 1: MLP training. The MLP’s parameters \theta_{\text{MLP}} = ( \theta_{g} , W ) are trained using cross-entropy loss and L1 regularization. The SAE is not present in this step. Step 2: SAE Training. To learn a dictionary of sparse features we follow the training procedure by Huben et al. 2023 . The SAE is trained to reconstruct the hidden activations h_{l} of training samples x . The SAE uses a reconstructing loss and a sparsity loss on its hidden activations h_{SAE} to learn sparse dictionary features. Step 3: Finetuning the decision layer. We freeze the parameters \theta_{g} of

Read the complete text