Clarity: The Flexibility-Interpretability Trade-Off in Sparsity-aware Concept Bottleneck Models
Konstantinos P. Panousis, Diego Marcos · 2026
Read Clarity: The Flexibility-Interpretability Trade-Off in Sparsity-aware Concept Bottleneck Models by Konstantinos P. Panousis, Diego Marcos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21944.txt.
Introduction
Konstantinos Panousis and Diego Marcos study concept bottleneck models, which force a vision system to decide through named concepts that humans can read. As vision-language models spread, worries about black-box decisions have grown, and these bottleneck designs promise a window into the reasoning.
Sparsity, using only a few concepts per decision, is meant to keep explanations clean. The authors examine the trade-off named in their title: flexibility against interpretability, in sparsity-aware versions of these models. Their 2026 preprint maps where the balance can be struck. The stakes are practical, since regulators and clinicians increasingly demand explanations that are not just plausible stories but faithful accounts of what a model used.
Catalog record
| CREATOR | Konstantinos P. Panousis, Diego Marcos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21944
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Clarity: The Flexibility-Interpretability Trade-Off in Sparsity-aware Concept Bottleneck Models Konstantinos P. Panousis, Diego Marcos Abstract The widespread adoption of Vision-Language Models (VLMs) across fields has amplified concerns about model interpretability. Distressingly, these models are often treated as black-boxes, with limited or non-existent investigation of their decision making process. Despite numerous post- and ante-hoc interepretability methods, systematic and objective evaluation of the learned representations remains limited, particularly for sparsity-aware methods that are increasingly considered to “induce interpretability”. In this work, we focus on Concept Bottleneck Models and investigate how different modeling decisions affect the emerging representations. We introduce the notion of clarity , a measure, capturing the interplay between the downstream performance and the sparsity and precision of the concept representation, while proposing an interpretability assessment framework using datasets with ground truth concept annotations. We consider both VLM- and attribute predictor-based CBMs, and three different sparsity-inducing strategies: per example ℓ 1 , ℓ 0 \ell_{1},\ell_{0} and Bernoulli-based formulations. Our experiments reveal a critical trade-off between flexibility and interpretability, under which a given method can exhibit markedly different behaviors even at comparable performance levels. The code will be made publicly available upon publication. 1 Introduction The recent advent of Vision-Language Models (VLMs) has driven an unprecedented adoption of modern deep architectures in a variety of applications and domains. Unfortunately, these models are frequently treated like black-boxes; they map inputs to outputs with little to no systematic analysis of their decision making process. This lack of transparency raises serious questions about their confident deployment in critical settings, further amplifying the need for transparent and interprertable architectures. Concept Bottleneck Models (CBMs) ( 7 ) , and concept-based models in general, aim at tackling this problem; these constitute ante-hoc methods, where the aim is to create inherently interpretable models by constructing a bottleneck , i.e., a human interpretable layer that is used to generate the final prediction towards the downstream task. CBMs were initially considered using hand-annotated concepts, which are labor intensive and costly or even unfeasible to produce; at the same time, their dependence on a restricted set of concepts led to significant performance degradation. To bypass this limitation, recent works leveraged VLMs, enabling the use of unrestricted concept sets either hand-crafted, automatically extracted or even machine generated via LLMs ( 26 ; 13 ) . While this shift paved the way for unrestricted concept sets that are shown to be quite effective for task performance ( 13 ) , it came at the expense of interpretability. Indeed, VLM-based approaches typically consider thousands of concepts, rendering the investigation of the bottleneck a challenging and unintuitive task, while other issues were further intensified, such as information leakage ( 12 ; 19 ) . Sparsity-aware methods aim at solving this issue ( 26 ; 13 ; 15 ) . However, these often fail to properly assess the actual impact on model interpertability, instead emphasizing metrics such as classification performance and overall sparsity, typically complemented by qualitative visualizations of the learned representations. Even when alignment with ground-truth information is explicitly evaluated, standard multi-label prediction metrics, typically binary accuracy, are often used despite their limitations in sparse settings ( 14 ) and without considering their suitability as a proxy to interpretability. In many settings, ground-truth attributes are highly sparse; consequently, methods that predict a large number of inactive concepts can achieve deceptively high binary accuracy. Instead, it is crucial to assess which concepts are correctly inferred as active relative to the total number of active concepts (i.e., the precision of the concepts used towards the downstream task) while simultaneously accounting for the imposed sparsity ratio and the performance of the model toward the downstream task. Thus, in this work, we argue for a return to the initial drive behind concept-based approaches by explicitly analyzing the effect of modeling choices on interpretability and performance. To this end, we propose a new metric to measure the clarity of a concept-based representation. This metric captures the interplay between three desiderata in CBMs: high sparsity , to enable per-example inspection of the used concepts; high concept prediction precision , to ensure that the selected concepts are semantically correct while allowing for the selection of informative but non-comprehensive concept-based descriptions; and strong downstream classification accuracy , so that interpretability does not come at the expense of the downstream task performance. We consider two distinct CBM formulations: one based on explicit attribute prediction and the other grounded in Vision-Language Models, and systematically evaluate the impact of sparsity across three different sparsity-aware methods. Our contributions can be summarized as follows: • We propose a systematic pipeline to objectively evaluate the interpretability-performance trade-off of concept-based representations that simultaneously considers: sparsity and correctness of the detected concepts, and task performance. • We introduce a novel amortization scheme to enforce sparsity on a per-example basis for both \ell_{0} and \ell_{1} based approaches by selecting only relevant concepts. • Through extensive experiments, we demonstrate that, contrary to claims that VLMs and sparsity inherently enhance interpretability, a trade-off exists between representational flexibility and interpretability in the learned concepts. 2 Related Work Concept Bottleneck Models. Given a classification problem characterized by a dataset \mathcal{D}=\{\boldsymbol{X}_{n},\hat{\boldsymbol{y}}_{n}\}_{n=1}^{N} comprising N image/label pairs, where \boldsymbol{X}_{n}\in\mathbb{R}^{I_{H}\times I_{W}\times c} and \hat{\boldsymbol{y}}_{n}\in\{0,1\}^{C} , CBMs ( 10 ; 7 ) aim at improving the interpretability of compute vision models solving this problem by first predicting a vector \mathbf{a}_{n}=f_{\theta}(\boldsymbol{X}_{n})\in[0,1]^{M} of concept scores; these correspond to a concept set A=\{a_{1},\dots,a_{M} }, where every element is associated with a human-understandable concept. The score is related to the likelihood of the presence of such concept in the image, followed by a linear layer that maps the concept scores to the downstream task, \mathbf{y}_{n}=\mathbf{W}_{c}^{\top}\mathbf{a}_{n} . Training the concept predictor requires a dataset of image-concept labels, which has motivated the emergence of label-free approaches ( 13 ; 26 ) that leverage pretrained VLMs, e.g., CLIP ( 16 ) , to estimate the presence of concepts in an image. Leakage in Concept Bottleneck Models. Information leakage, a phenomenon in which the model high jacks the concept bottleneck in order to directly encode information for the downstream task, is known to pose a big problem to the interpretability of CBMs ( 12 ; 19 ) , and can stem either from wrong concept predictions in the bottleneck or from nonsensical relations between the concepts and the downstream task. Leakage has been shown to be difficult to measure ( 27 ) , with some authors proposing to use occlusion of ground truth object parts to detect and correct it ( 4 ) . Some methods to prevent leakage involve adding a non-interpretable side channel to the model ( 3 ) , releasing pressure from the concept predictor but turning the model into a partial black-box, or carefully choosing the concept set ( 18 ) , which is not always an option in real-world applications. Sparsity in Concept Bottleneck Models. On top of raising concerns about the difficulty of learning a concept predictor, the authors of ( 17 ) point at another overlooked problem: large concept sets can render CBMs actually unintelligible to humans, with users preferring a handful of concepts per explanation. This has driven the development of sparsity-aware CBMs, where only a few concepts are selected to contribute