Clustered Self-Assessment: A Simple yet Effective Method for Uncertainty Quantification in Large Language Models

Qi Cao, Takeshi Kojima, Andrew Gambardella · 2026

Read Clustered Self-Assessment: A Simple yet Effective Method for Uncertainty Quantification in Large Language Models by Qi Cao, Takeshi Kojima, Andrew Gambardella (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03846.txt.

Introduction

Cao and co-authors estimate language model uncertainty by clustered self-assessment. Models often answer with plausible but wrong text. Missing uncertainty scores leave users unable to judge trust. Entropy over sampled replies is the usual proxy, yet it is hard to read. It also wastes the model's own judgment skill.

Sampled replies are grouped into clusters that differ in meaning. The clusters become options in a structured multiple-choice question. The model's probability on each option serves as the confidence estimate. Tests across models and datasets beat baseline methods throughout. Two extra samples already give competitive performance. The method is both effective and cheap to run. Teams deploying language models get a clearer reliability dial. Self-assessment turns out to beat indirect entropy signals.

Catalog record

CREATORQi Cao, Takeshi Kojima, Andrew Gambardella
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03846

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Clustered Self-Assessment: A Simple yet Effective Method for Uncertainty Quantification in Large Language Models Qi Cao, Takeshi Kojima, Andrew Gambardella Abstract Large language models (LLMs) demonstrate remarkable performance across diverse tasks, but they often generate responses that appear plausible while being factually incorrect. This problem is compounded by the lack of explicit uncertainty estimates, which makes it difficult for users to judge the reliability of model outputs. Existing uncertainty quantification methods typically rely on indirect signals, such as entropy across sampled generations. These signals can be difficult to interpret and do not fully leverage the model’s ability to assess its own uncertainty. We propose a simple yet effective self-assessment method for uncertainty quantification in LLMs. Our approach groups sampled generations into semantically distinct clusters, converts them into answer options in a structured multiple-choice question, and uses the probability assigned by the LLM to each option as a confidence estimate. Experiments across multiple models and datasets show that our method consistently outperforms baseline approaches. Notably, it achieves competitive performance with as few as two additional samples, demonstrating both its effectiveness and efficiency. 1 1 1 Code will be available at https://github.com/ccqq77/clustered_self_assessment . 1 Introduction Large language models (LLMs) have achieved remarkable success across diverse applications. However, ensuring the reliability and factual accuracy of their outputs remains challenging, especially in high-stakes domains such as healthcare, law, and scientific research, where errors can have serious consequences. This issue is compounded by their ability to produce fluent, persuasive text that may obscure inaccuracies and mislead users Ji et al. 2023 ; Huang et al. 2025 . To mitigate these risks, it is crucial to develop effective methods for quantifying and communicating uncertainty in LLM-generated outputs. A natural approach is to let LLMs express uncertainty in natural language; however, prior work shows that they often exhibit overconfidence, giving overly confident assessments even when incorrect Xiong et al. 2024 ; Kadavath et al. 2022 . Researchers have therefore explored alternatives, such as estimating uncertainty from semantic divergence across multiple generations Kuhn et al. 2023 ; Lin et al. 2024 . While partially effective, these methods primarily measure output discrepancies without leveraging the LLMs’ internal understanding of their knowledge Kadavath et al. 2022 , leading to suboptimal performance. Moreover, many methods rely on indirect uncertainty metrics, such as entropy-based scores Kuhn et al. 2023 , which are difficult for users to interpret and thus limit practical utility Devic et al. 2025 . Therefore, there is a pressing need for uncertainty quantification methods that leverage the internal capabilities of LLMs while clearly communicating model confidence. To this end, we propose a simple yet effective method that fulfills these requirements. Our main contributions are as follows: Eliciting self-assessment. Our approach leverages the internal uncertainty representations of LLMs by using sampled generations to construct structured multiple-choice questions, thereby prompting the model to evaluate its own answers. Superior performance. Our method consistently outperforms existing baselines across diverse datasets and models. Notably, it achieves competitive performance with only two additional samples, whereas some baselines require up to sixteen, highlighting its effectiveness. Human-interpretability. We use the token probability of each choice as a confidence score, enabling users to intuitively assess the reliability of generated answers. Experimental results show that these confidence scores align well with actual correctness, demonstrating the practicality of our method. 2 Related Work The most relevant studies are sampling-based uncertainty quantification methods, such as Semantic Entropy Kuhn et al. 2023 , EigV, Deg, and Ecc Lin et al. 2024 , EigenScore Chen et al. 2024 , and SAR Duan et al. 2024 . While these methods differ in implementation, they all rely on sampling multiple generations and focus on measuring the discrepancies among sampled answers, without sufficiently leveraging the inherent capabilities of LLMs. This often leads to suboptimal performance. Additionally, the resulting indirect scores are difficult for humans to interpret, which limits their practical utility Devic et al. 2025 . Another line of work explores prompting LLMs to verbalize their uncertainty Xiong et al. 2024 . However, due to the well-documented overconfidence issue, such verbalized uncertainty estimates often perform poorly. An alternative approach, P(True) Kadavath et al. 2022 , queries the LLM about the truthfulness of its own answer and uses the probability of “True” as a confidence score, but its performance remains unsatisfactory. Our method integrates the strengths of sampling-based and self-assessment-based approaches by constructing a structured multiple-choice question for self-assessment, where the options are derived from clustered sampled responses. This design better promotes the model’s self-assessment ability and produces calibrated, human-interpretable confidence scores. The relevant methods includes T^{3} Li et al. 2024 and BSD Chen and Mueller 2024 . Compared with T^{3} , our method constructs semantically distinct options by clustering sampled generations, rather than relying on predefined labels. In contrast to BSD, our method derives the confidence score directly from the model’s self-assessment, instead of using a weighted aggregation of separate scores. 3 Methodology Figure 1: Demonstration of our method using an example from Farquhar et al. 2024 . Sampled generations are clustered based on their semantic compatibility and then used to construct a structured multiple-choice question (MCQ), which is presented as input to the LLM. The probability assigned to each choice serves as its confidence score. Figure 2: Performance comparison of our method and baseline approaches across different models and datasets. Sampling-based methods use eight additional samples. For clarity, each subfigure shows only the top eight methods ranked by performance, ordered in descending order. Metric: AUROC. As illustrated in Figure 1 , our method follows a two-stage process to quantify uncertainty. It first reformulates the question based on the sampled answers and then utilizes the model’s own probability estimates as a confidence measure: 3.1 Answer Clustering For each question, we sample multiple answers from the LLM. Following the answer-clustering procedure introduced in Semantic Entropy Kuhn et al. 2023 , we use an NLI model to estimate pairwise semantic relationships among the sampled answers. Specifically, for each ordered pair (a_{i},a_{j}) , the NLI model predicts a label \ell_{i\to j}\in\{\emph{entailment},\emph{neutral},\emph{contradiction}\} . Using the NLI model, we obtain bidirectional pairwise labels for each unordered pair \{i,j\} as the tuple (\ell_{i\to j},\ell_{j\to i}) . We then apply a rule-based filter to these bidirectional relationships to determine whether two answers should be grouped together. In more detail, during clustering, we maintain a set of clusters \mathcal{G}=\{G_{1},\ldots,G_{K}\} , each with a representative r_{k}\in G_{k} chosen as the first answer assigned to that cluster. We process the answers in a fixed order, beginning with the answer to be assessed, which in our setting is the greedy-decoded answer. For each answer a_{i} , we compare it with the current representatives \{r_{k}\}_{k=1}^{K} and assign it to the first cluster for which the representative and a_{i} satisfy the predefined bidirectional NLI-based grouping criterion. Specifically, two answers are grouped if the bidirectional NLI results contain no contradiction label or include at least one entailment label in both directions, ensuring that the resulting clusters correspond to semantically distinct answer choices. If no existing cluster satisfies this criterion, we create a new cluster with a_{i} as its representative. Finally, we group the answers into semantically compatible clusters, with each cluster corresponding to a distinct candidate answer among the model’s

Read the complete text