Uncertainty-aware Language Guidance for Concept Bottleneck Models
Yangyi Li, Mengdi Huai · 2026
Read Uncertainty-aware Language Guidance for Concept Bottleneck Models by Yangyi Li, Mengdi Huai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23495.txt.
Introduction
Yangyi Li and one co-author improve concept bottleneck models, which first map inputs to high-level meaning concepts and then combine those concepts for classification. Their clarity is attractive, but labeling concepts demands much expert labor, and language-model labels carry unmeasured uncertainty and hallucination risk.
The authors propose an uncertainty-aware method that strictly measures uncertainty in language-model concept labels with valid, distribution-free guarantees, then folds that measured uncertainty into training to reflect varying trust across concepts. Theory backs the method, and wide tests on real-world datasets confirm its desired traits. The work thus makes language-model-built concept bottlenecks both more trustworthy and more practical to adopt.
Catalog record
| CREATOR | Yangyi Li, Mengdi Huai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-23495
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Uncertainty-aware Language Guidance for Concept Bottleneck Models Yangyi Li, Mengdi Huai Abstract Concept Bottleneck Models (CBMs) provide inherent interpretability by first mapping input samples to high-level semantic concepts, followed by a combination of these concepts for the final classification. However, the annotation of human-understandable concepts requires extensive expert knowledge and labor, constraining the broad adoption of CBMs. On the other hand, there are a few works that leverage the knowledge of large language models (LLMs) to construct concept bottlenecks. Nevertheless, they face two essential limitations: First, they overlook the uncertainty associated with the concepts annotated by LLMs and lack a valid mechanism to quantify uncertainty about the annotated concepts, increasing the risk of errors due to hallucinations from LLMs. Additionally, they fail to incorporate the uncertainty associated with these annotations into the learning process for concept bottleneck models. To address these limitations, we propose a novel uncertainty-aware CBM method, which not only rigorously quantifies the uncertainty of LLM-annotated concept labels with valid and distribution-free guarantees, but also incorporates quantified concept uncertainty into the CBM training procedure to account for varying levels of reliability across LLM-annotated concepts. We also provide the theoretical analysis for our proposed method. Extensive experiments on the real-world datasets validate the desired properties of our proposed methods. 1 Introduction The impressive capabilities of deep neural networks (DNNs) have led to their successful deployment across a wide range of applications, but this success often comes at the expense of transparency, rendering them “black boxes” [ 24 ] . This opacity hinders their widespread adoption in high-stakes domains where the rationale behind a decision is crucial for both trust and accountability. In response to this need for inherent explainability, Concept Bottleneck Models (CBMs) have emerged as a promising solution [ 7 , 28 ] . CBMs integrate interpretability directly into their architecture by introducing an intermediate concept layer that forces the model to base its predictions on a set of human-understandable attributes, thus offering a transparent decision-making process. Despite their promise, the practical deployment of CBMs is often hindered by their reliance on concept annotations provided by human experts. This manual process is labor-intensive, costly, and a significant bottleneck to scalability. To overcome this, there are a few works that adopt Large Language Models (LLMs) [ 14 , 20 , 5 , 17 ] to automate concepts [ 23 , 27 ] . However, they suffer from two essential limitations. First, they overlook the uncertainty associated with the concepts annotated by LLMs, thereby increasing the risk of errors caused by hallucinations. These methods directly rely on LLMs to produce concept labels. However, due to the inherent possibility of hallucinations [ 22 ] , irrelevant and imprecise concepts may be generated, and the resulting concept annotations may be unreliable. Such noisy and unreliable concept labels can propagate through the CBM pipeline, degrading model reliability and interpretability. Additionally, when using large language models to annotate concepts in the training data, existing approaches fail to incorporate the uncertainty associated with these annotations into the learning process for concept bottleneck models. To train CBMs, they simply adopt the deterministic concept labels output by large language models, without modeling the confidence or variability of these labels. However, uncertainty-aware concept annotations inherently convey richer supervisory information, since they capture the varying degrees of unreliability in the concepts predicted by LLMs. When such uncertainty is ignored and annotations are reduced to deterministic labels, much of this informative signal is lost, which can ultimately hinder the effectiveness of CBM training. However, addressing these limitations presents several unique research challenges. First, it is inherently difficult to quantify the uncertainty of concepts annotated by LLMs in a principled manner with guarantees. Traditional uncertainty quantification methods [ 9 , 19 ] often assume that data is independent and identically distributed (i.i.d.), but such an assumption is difficult to justify for the LLM-based annotation process across concepts and inputs. Furthermore, prior works involving language-guided CBMs typically resort to simple and non-adaptive confidence thresholds without providing theoretical coverage guarantees. They fail to rigorously account for the hallucinations inherent in LLMs, leading to unreliable concept bottlenecks where irrelevant or imprecise concepts may propagate errors to the final prediction. Second, it is challenging to effectively incorporate quantified concept uncertainty into the CBM training pipeline. After leveraging LLMs to generate uncertainty-aware concept annotations, the training samples for specific generated concepts may become sparse based on varying reliability levels. If CBMs are trained directly on such data, the model tends to disregard the informative signals from these sparse uncertainty-aware concepts. Consequently, the CBM fails to fully learn the special knowledge embedded in these concepts, limiting the integration of uncertainty information and ultimately hindering improvements in model performance and interpretability. To bridge this gap, in this paper, we propose U ncertainty-aware L anguage Guidance for C oncept B ottleneck M odels ( ULCBM ), which can not only rigorously quantify the uncertainty of LLM-annotated concepts with distribution-free guarantees but also effectively incorporate quantified concept uncertainty into the CBM training procedure to account for varying levels of reliability across LLM-annotated concepts. Specifically, we first propose a novel uncertainty quantification method capable of evaluating the confidence of each annotated concept across three complementary dimensions. To address the challenges of distribution assumptions and the absence of theoretical guarantees, we propose to leverage Conformal Prediction (CP) [ 25 , 21 , 10 , 3 , 29 ] to calibrate a global acceptance threshold on a calibration set. This framework enables us to construct concept sets that provably satisfy user-specified risk levels over exchangeable samples, without the i.i.d. assumption on the concept annotation mechanism. We quantify these dimensions through three corresponding loss functions, including discriminability to measure the specificity of concepts to the image’s true class, coverage to ensure the selected subset represents the full semantic scope of candidate concepts, and diversity to penalize semantic redundancy among selected attributes. Additionally, based on the quantified uncertainty, we design a targeted data augmentation pipeline to integrate uncertainty information into the learning process. To address the challenge of sparse training samples caused by varying reliability levels, we propose to synthesize additional examples for specific sparse concepts by inserting reliable patches from source images into target samples. Crucially, this insertion process is strictly guided by the uncertainties derived from our defined criteria, ensuring the placement of new patches avoids overlapping with existing concepts chosen by our uncertainty threshold. This strategy effectively mitigates the data scarcity of high-reliability but rare concepts, ensuring the CBM does not overlook these informative signals. We also provide a theoretical analysis proving that our calibration procedure ensures the expected losses for these criteria satisfy their prescribed risk levels with distribution-free guarantees. Extensive experiments on real-world datasets validate the desired properties and superior performance of our proposed methods. 2 Related Work Concept Bottleneck Models (CBMs) are a class of self-explaining neural networks that force predictions through an intermediate layer of human-understandable concepts [ 7 , 13 , 18 ] . Importantly, CBMs play a pivotal role in various applications, including model debugging [ 6 ] , object tracking [ 15 ] , and human intervention on decisions [ 2 ] . For example, in the context of human intervention, experts can manually correct