A Survey of Uncertainty Estimation Methods on Large Language Models
Zhiqiu Xia, Jinxuan Xu, Yuqian Zhang, Hang Liu · 2025
Read A Survey of Uncertainty Estimation Methods on Large Language Models by Zhiqiu Xia, Jinxuan Xu, Yuqian Zhang, Hang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00172.txt.
Introduction
Zhiqiu Xia, Jinxuan Xu, Yuqian Zhang, and Hang Liu survey ways to gauge doubt in large language models in a 2025 paper. Models can serve biased or made up answers in fluent dress, which hides the risk. Scoring a model's own doubt is the main counter, and work on it has swelled, yet no full map of the field existed for this model class.
The survey sorts methods into four big roads and walks each in turn. It then runs wide hands on tests of many methods across data sets, so the roads can be compared on shared ground. Gaps and dead ends are named along the way. The paper closes with the routes the authors judge most promising for doubt scoring that users can trust.
Catalog record
| CREATOR | Zhiqiu Xia, Jinxuan Xu, Yuqian Zhang, Hang Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-00172
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Survey of Uncertainty Estimation Methods on Large Language Models Zhiqiu Xia, Jinxuan Xu, Yuqian Zhang, Hang Liu Abstract Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty estimation is the key method to address this challenge. While research efforts in uncertainty estimation are ramping up, there is a lack of comprehensive and dedicated surveys on LLM uncertainty estimation. This survey presents four major avenues of LLM uncertainty estimation. Furthermore, we perform extensive experimental evaluations across multiple methods and datasets. At last, we provide critical and promising future directions for LLM uncertainty estimation. 1 Introduction Large Language Models (LLMs) have emerged as state-of-the-art solutions for a wide range of problems, mainly due to their unparalleled ability to generate coherent and contextually appropriate responses to diverse user prompts Ouyang et al. (2022) ; Zhao et al. (2024) . However, with the increasing adoption of LLMs, concerns have grown regarding their tendency to produce biased, hallucinated, non-factual, and misaligned outputs Zhang et al. (2023b) ; Huang et al. (2024b) . These issues are further exacerbated by the fact that such flawed responses often appear highly fluent and convincingly realistic, making them difficult to detect. A promising approach to addressing the challenge of misleading yet plausible responses is uncertainty estimation, which assigns an uncertainty or confidence score to the model’s output. Figure 1 provides an overview of this process. First, the LLM generates an initial response based on the input. Next, a confidence score is computed for this response. The score is then evaluated against a predefined threshold to determine the final output. If the confidence score meets or exceeds the threshold, the initial response is accepted; otherwise, the model outputs "I do not know," thereby reducing the risk of providing incorrect but convincingly realistic information to users. Figure 1: Illustration of uncertainty estimation. There is an urgent need for a comprehensive survey on LLM uncertainty estimation. Below, we highlight three of them: (i) Although uncertainty estimation has been extensively studied in traditional deep neural networks (DNNs)—with Bayesian and ensemble methods being notable examples Gawlikowski et al. (2023) )—these techniques are not easily transferable to LLMs, due to the large number of parameters in LLMs. (ii) LLMs significantly transform society, creating a strong demand for a thorough study of uncertainty estimation tailored to LLMs. While numerous uncertainty estimation methods exist, recent benchmark studies Fadeeva et al. (2023) ; Vashurin et al. (2025) have focused on their empirical evaluation rather than in-depth methodological discussions. Consequently, a survey of recent advances in LLM uncertainty estimation that synthesizes recent progress is crucial, offering a solid foundation for future development in the field. (iii) Besides surveys focusing on natural language processing Fomicheva et al. (2020) ; Baan et al. (2023) , there are three existing surveys concentrating on LLM uncertainty estimation. However, each has notable limitations. Specifically, Huang et al. (2024a) dedicates a substantial portion of its content to traditional DNN uncertainty estimation rather than focusing on LLMs. Geng et al. (2024) shifts its attention to uncertainty calibration and the applications of LLM uncertainty estimation, rather than providing a deep exploration of the core techniques. Similarly, Shorinwa et al. (2024) devotes much of its content to benchmarks and applications while lacking a complete view of the uncertainty estimation methods on LLMs. This work focuses on studying the uncertainty estimation methods within the context of LLMs, introducing a new taxonomy from the perspective of LLMs. We center our scope around techniques applicable during the inference stage. We focus on the uncertainty estimation methods, excluding confidence calibration methods Zhou et al. (2023) ; Detommaso et al. (2024) from our scope. Besides, we emphasize the methods that do not require additional data Ren et al. (2023) ; Kumar et al. (2023) ; Tonolini et al. (2024) or model modifications Huang et al. (2023a) ; Liu et al. (2024) , ensuring the broad applicability of this survey. Furthermore, this survey conducts a thorough evaluation of representative uncertainty estimation approaches across various datasets and domains. Built on the insights from our evaluations, we postulate two interesting future directions for LLM uncertainty estimation. 2 Uncertainty Sources in LLM There are two primary sources of uncertainty: aleatoric and epistemic uncertainties Kendall and Gal (2017) ; Hüllermeier and Waegeman (2021) . In the context of LLMs Gao et al. (2024) ; Ahdritz et al. (2024) ; Hou et al. (2024) , these sources manifest in the following ways: • Aleatoric uncertainty refers to the uncertainty inherent in the data. For LLMs, this arises from ambiguous or incomplete information and inherent properties of natural language itself. Examples include vague or contextually dependent prompts, as well as linguistic phenomena where multiple valid interpretations or responses naturally coexist. • Epistemic uncertainty reflects the model’s lack of knowledge or understanding. In LLMs, this occurs when the model encounters unfamiliar concepts or data that are underrepresented in its training set. This type of uncertainty can potentially be reduced by improving the training datasets and models. 3 Uncertainty Estimation in LLMs 3.1 Problem Definition and Overview Token generation in LLMs. LLMs output responses in an auto-regressive manner, predicting the probability distribution of the next token given the prompt and the previously generated tokens. We denote the model as \bm{f} , the prompt as \bm{x} , and the generated response (or the answer) as \bm{r} , which consists of N tokens, denoted as \{z_{1},z_{2},z_{3},\cdots,z_{N}\} . The tokens can be either words, subwords, or characters from a predefined vocabulary \bm{Z} . At each step of token generation, the model computes the conditional probability distribution over the vocabulary for the next token, based on the prompt \bm{x} and all previously generated tokens \bm{r_{<i}}=\{z_{1},z_{2},\cdots,z_{i-1}\} . The probability distribution for the i -th token is given by \bm{p_{i}}=\text{Softmax}(\bm{f}(\bm{x},\bm{r_{<i}})) . Here, \bm{p_{i}} is a vector of length |\bm{Z}| , with each entry representing the probability of a specific token in \bm{Z} being chosen as the next token. It allows strategies such as sampling or beam search to choose from these token candidates according to their probabilities. Such an auto-regressive process ends when # of generated tokens reaches a preset number or LLM generates the end-of-sequence (EOS) token. Figure 2: Illustration of uncertainty versus confidence. {forest} Figure 3: Taxonomy of uncertainty estimation methods on LLMs. It is important to note that uncertainty is the innate nature of LLMs, regardless of whether we estimate it. Now, we provide an intuitive understanding of uncertainty and how to estimate it. How to estimate uncertainty and confidence? Following the conceptualization by Lin et al. (2024) , we illustrate the process as shown in Figure 2 . For each input \bm{x} , an LLM model has an underlying response distribution for it ( 1 ). For ease of illustration, we assume the distribution is a normal distribution N(\mu,\sigma^{2}) . Uncertainty estimation is to estimate the underlying variance \sigma^{2} . For example, the sample variance of M different responses \bm{r_{1}},\cdots,\bm{r_{M}} ( 2 ) can be an estimator for the variance, which indicates the variations of responses ( U in Figure 2 ). There are generally two types of confidence, i.e., overall confidence C and