Towards Better Generalization and Interpretability in Unsupervised Concept-Based Models
Francesco De Santis (✉), Philippe Bich, Gabriele Ciravegna, Pietro Barbiero, Danilo Giordano, Tania Cerquitelli · 2025
Read Towards Better Generalization and Interpretability in Unsupervised Concept-Based Models by Francesco De Santis (✉), Philippe Bich, Gabriele Ciravegna, Pietro Barbiero, Danilo Giordano, Tania Cerquitelli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02092.txt.
Introduction
Francesco De Santis led a team building an interpretable image classifier in a 2025 paper. Concept-based models explain their calls through human-sized ideas rather than raw pixels. Unsupervised versions avoid costly human labeling but often scale poorly. Their model treats concepts as random switches in a compact latent space, using fewer concepts without losing performance.
It beat existing unsupervised concept models on generalization and nearly matched black-box accuracy. Its concepts kept more information and lined up better with human understanding. A user study found the concepts more intuitive for people to read. A local linear mix of concepts keeps each call explainable.
Catalog record
| CREATOR | Francesco De Santis (✉), Philippe Bich, Gabriele Ciravegna, Pietro Barbiero, Danilo Giordano, Tania Cerquitelli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-02092
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Better Generalization and Interpretability in Unsupervised Concept-Based Models Francesco De Santis (✉), Philippe Bich, Gabriele Ciravegna, Pietro Barbiero, Danilo Giordano, Tania Cerquitelli Abstract To increase the trustworthiness of deep neural networks, it is critical to improve the understanding of how they make decisions. This paper introduces a novel unsupervised concept-based model for image classification, named Learnable Concept-Based Model (LCBM) which models concepts as random variables within a Bernoulli latent space. Unlike traditional methods that either require extensive human supervision or suffer from limited scalability, our approach employs a reduced number of concepts without sacrificing performance. We demonstrate that LCBM surpasses existing unsupervised concept-based models in generalization capability and nearly matches the performance of black-box models. The proposed concept representation enhances information retention and aligns more closely with human understanding. A user study demonstrates the discovered concepts are also more intuitive for humans to interpret. Finally, despite the use of concept embeddings, we maintain model interpretability by means of a local linear combination of concepts 1 1 1 Paper accepted at ECML-PKDD 2025. . 1 Introduction Understanding the reason why Deep Neural Networks (DNNs) make decisions is critical in today’s society, as these models are increasingly deployed and affect people’s lives. This concern has also led regulatory institutions to mandate interpretability and the possibility of challenging the decisions of deep neural networks as prerequisites for Artificial Intelligence (AI) systems [ 38 , 27 ] . EXplainable AI (XAI) methods have emerged to address this challenge [ 30 , 2 , 12 ] . However, several papers argue that feature importance explanations (such as saliency maps [ 45 , 33 ] ) have failed to achieve this goal, since showing where a network is looking is insufficient to explain the reasons behind its decisions [ 31 , 1 ] . To truly explain what the network has seen, many XAI methods are shifting toward explanations in terms of human-understandable attributes, or concepts [ 14 , 1 , 10 , 28 ] . Concepts can be either extracted post-hoc [ 11 ] or directly inserted within the network representation to create a so-called concept-based model (CBMs, [ 16 ] ). Figure 1 : Learnable Concept-Based Model (LCBM) learns a dictionary of unsupervised concepts. Unlike black-box models, LCBM classifies images interpretably using these concepts. Here, the image is correctly classified as Dark-eyed junco by leveraging concepts C48 (eyes/beak), C47 (wings), and C71 (trunk/tree). Notably, C71, while present, is less relevant to bird species classification. CBMs can be created in a supervised way [ 16 , 4 , 8 ] or through a dedicated unsupervised learning process [ 3 , 6 , 40 ] . The latter approach enables the use of CBMs in contexts where concept annotations are unavailable and large language models (LLMs) [ 41 , 26 ] lack sufficient knowledge. Yet, a fundamental challenge persists: standard unsupervised approaches rely on single-neuron activations to represent each concept, thereby limiting the amount of information that can be captured. This limitation creates a trade-off between interpretability and accuracy. The issue becomes even more pronounced when concise explanations are needed to avoid cognitive overload for users [ 24 , 19 , 7 ] . As demonstrated in our experiments, standard unsupervised approaches exhibit a significant performance gap compared to end-to-end methods in such scenarios, making unsuitable their effective deployment. In this paper, we demonstrate that by using unsupervised concept embeddings, we can create a highly effective Learnable Concept-Based Model (LCBM) employing a limited number of concepts. Our experiments show that this approach: i) overcomes the limited generalization of compared models, almost matching the performance of black-box models; ii) increases the representation capability of standard unsupervised concept layers in terms of information retention and alignment with human representation; iii) ensures that the extracted concepts are more interpretable, as highlighted by a user study; and iv) by providing the task prediction through a local linear combination of concepts, it retains task interpretability 1 1 1 Code to reproduce the proposed model is available at https://github.com/LCBM . . 2 Related Work Concept-based XAI (C-XAI) aims to provide human-understandable explanations by using concepts as intermediate representations [ 14 , 28 , 31 ] . While supervised approaches [ 16 , 8 ] rely on predefined symbols, unsupervised models autonomously extract concepts by modifying a network’s internal representation through unsupervised learning, prototypical representations, or hybrid techniques [ 3 , 16 ] . Unsupervised Concept Basis. These methods learn disentangled representations in the model’s latent space by grouping samples based on fundamental characteristics. They typically achieve this via input reconstruction [ 3 , 40 ] or unsupervised losses [ 46 , 40 ] . In [ 46 ] , convolutional filters act as unsupervised concepts, maximizing mutual information between images and filter activations. SENN [ 3 ] employs an autoencoder to derive clustered representations and generate class-concept relevance scores. BotCL [ 40 ] enhances SENN with attention-based concept scoring and contrastive loss. Compared to these, LCBM introduces concept embeddings for richer representations, improving the generalization-interpretability trade-off. Prototype Concepts. This approach encodes training example traits as prototypes within the network, comparing them to input samples for prediction. [ 21 ] explains predictions via prototype similarity, using an autoencoder for dimensionality reduction. ProtoPNet [ 6 ] extracts prototypes representing image subparts, while HPNet [ 13 ] organizes prototypes hierarchically for classification across taxonomy levels. Despite providing useful example-based explanations, these models constrain representation capacity. Our approach enhances performance by leveraging richer representations while retaining prototype-based interpretability, as shown in concept dictionaries. Hybrid Approaches. Recent research explores hybrid models that integrate supervised and unsupervised concepts [ 23 , 32 ] or leverage pre-trained LLMs [ 26 , 41 , 44 ] . The variational approach in [ 23 ] shares similarities with ours but relies on single neurons and partial supervision, limiting scalability. Methods leveraging LLMs assume sufficient knowledge for zero-shot concept annotations, yet this depends on the underlying model [ 35 ] . For instance, CLIP [ 29 ] , despite its popularity, exhibits low concept accuracy even in contexts similar to its pre-training, as confirmed by our experiments. 3 Methodology In an unsupervised concept-based setting, the objective is to make predictions using a set of abstract, human-interpretable concepts that are not predefined but must be directly inferred from the data. To address this challenge, we propose a set of desiderata that define the required properties of the learned concepts: • Representativity [ 5 ] : Concepts should capture key features of the input data. • Completeness [ 43 ] : Concepts should support strong task generalization. • Alignment [ 28 ] : Concepts should correspond to human-understandable constructs. If concepts do not accurately represent the input data, they cannot be trusted for either inference or explainability. As a result, Representativity , a common requirement in representation learning [ 5 ] , is a necessary but not sufficient condition for an interpretable unsupervised concept-based model: Completeness is also essential to ensure the concepts are useful for making task-specific predictions. Ultimately, interpretability is achieved only with an Alignment with a human-defined representation. While this property is always met in supervised CBMs, in unsupervised contexts it is a major challenge. 3.1 Learnable Concept-Based Model In