MCQA-Eval : Efficient Confidence Evaluation in NLG with Gold-Standard Correctness Labels

Xiaoou Liu*, Zhen Lin*, Longchao Da, Chacha Chen, Shubhendu Trivedi, Hua Wei · 2025

Read MCQA-Eval : Efficient Confidence Evaluation in NLG with Gold-Standard Correctness Labels by Xiaoou Liu*, Zhen Lin*, Longchao Da, Chacha Chen, Shubhendu Trivedi, Hua Wei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14268.txt.

Introduction

Xiaoou Liu and five co-authors propose a cleaner way to judge whether a language model knows when it is right, in a 2025 paper. Confidence estimates matter most where errors are costly, like medicine and law. But the benchmarks for testing them rely on automatic correctness checks that are noisy, expensive, and biased, which distorts rankings of methods.

Their framework, MCQA-Eval, borrows gold-standard answers from multiple-choice question datasets instead. No separate correctness function is needed. The setup allows fair comparison of white-box methods that read model internals and black-box methods that rely on answer consistency. Experiments across several models and question sets show the framework gives more efficient and more trustworthy assessments than existing approaches. The authors hope it becomes a standard yardstick for the field.

Catalog record

CREATORXiaoou Liu*, Zhen Lin*, Longchao Da, Chacha Chen, Shubhendu Trivedi, Hua Wei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14268

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MCQA-Eval : Efficient Confidence Evaluation in NLG with Gold-Standard Correctness Labels Xiaoou Liu*, Zhen Lin*, Longchao Da, Chacha Chen, Shubhendu Trivedi, Hua Wei Abstract Large Language Models (LLMs) require robust confidence estimation, particularly in critical domains like healthcare and law where unreliable outputs can lead to significant consequences. Despite much recent work in confidence estimation, current evaluation frameworks rely on correctness functions —various heuristics that are often noisy, expensive, and possibly introduce systematic biases. These methodological weaknesses tend to distort evaluation metrics and thus the comparative ranking of confidence measures. We introduce MCQA-Eval , an evaluation framework for assessing confidence measures in Natural Language Generation (NLG) that eliminates dependence on an explicit correctness function by leveraging gold-standard correctness labels from multiple-choice datasets. MCQA-Eval enables systematic comparison of both internal state-based white-box (e.g. logit-based) and consistency-based black-box confidence measures, providing a unified evaluation methodology across different approaches. Through extensive experiments on multiple LLMs and widely used QA datasets, we report that MCQA-Eval provides efficient and more reliable assessments of confidence estimation methods than existing approaches. 1 Introduction Large Language Models (LLMs) demonstrate strong performance across natural language processing tasks, yet their architectural complexity and limited interpretability can produce unreliable outputs. This presents significant challenges in critical domains such as healthcare, where output errors carry serious consequences. Confidence estimation methods have emerged to quantify output reliability. The field connects closely with uncertainty quantification in natural language generation, as both address output trustworthiness. Current approaches divide into consistency-based methods, which analyze agreement across multiple outputs, and internal-states methods that leverage model-specific features like output probabilities. Despite advances in these approaches, developing robust evaluation frameworks remains a central challenge. Current evaluation frameworks for NLG confidence measures rely on correctness labels to compute metrics such as AUROC and AUARC. These frameworks follow a three-step process: generating model predictions, labeling correctness via a function f(\cdot) , and calculating metrics. This label-dependent approach faces several constraints. While human evaluation provides reliable correctness ground truth, it cannot scale to large datasets. Metrics based on reference matching, such as BLEU and ROUGE, fail to recognize semantically equivalent responses phrased differently. LLM-based evaluators offer greater capability but remain noisy and may introduce systematic biases, such as favoring responses generated by themselves or similar LMs Panickssery et al. (2024) , or preferring longer responses Lin et al. (2022) . Moreover, running such evaluators could be expensive. Flaws in the correctness function f(\cdot) propagate through the evaluation pipeline, affecting metrics like AUROC. This sensitivity becomes particularly problematic when comparing confidence estimation methods with similar performance. Such limitations underscore the need for evaluation frameworks that establish correctness more reliably. In this paper, we propose MCQA-Eval , a simple, efficient yet effective evaluation framework that eliminates the dependence on unreliable correctness functions. The key insight is to leverage multiple-choice question-answering (QA) datasets, which inherently provide gold-standard answer choices at no cost. With these definitive labels, our framework bypasses the ambiguity of determining correctness via correctness function f(\cdot) and ensures an objective assessment of confidence estimation methods. Rather than replacing existing evaluation pipelines, our framework complements them, offering an additional lens to assess the discriminative power of confidence estimation methods. Fig. 1 shows how our proposal (green) and the existing evaluation pipeline (blue) differ, yet complement each other. Our contributions are summarized as follows: • We demonstrate that commonly used evaluation methods for NLG confidence measures are sensitive to noise in correctness labels, which can lead to misleading conclusions about evaluation metrics and rankings of different confidence estimation approaches. • We propose a simple yet effective method that utilizes multiple-choice QA datasets to evaluate confidence measures, supporting both internal-states-based white-box and consistency-based black-box methods. • Extensive experiments across recent LLMs and QA datasets verify that MCQA-Eval produces stable evaluations broadly consistent with existing methods, while eliminating the need for expensive correctness functions. 2 Related Work Confidence Estimation Confidence estimation is fundamental to machine learning, providing mechanisms to assess model reliability and guide decision-making across tasks. Early confidence estimation research concentrated on classification settings, where confidence scores enabled Selective Classification Geifman and El-Yaniv (2017) ; El-Yaniv et al. (2010) ; Feng et al. (2022) —allowing models to abstain from low-quality predictions. The rapid advancement of NLG and LLMs has brought renewed attention to confidence estimation. While NLG poses unique challenges due to semantic invariance and vast output spaces Kuhn et al. (2023) , recent works have advanced the field by measuring similarities among sampled responses Lin et al. (2024b) and deriving measures from LMs’ internal states Malinin and Gales () ; Lin et al. (2024a) ; Azaria and Mitchell (2023) . A related aspect is calibration. While extensively considered in classification Zhang et al. (2020) ; Kull et al. (2019) ; Ma and Blaschko (2021) , it has received lass attention in NLG. Since the distribution of confidence scores could vary significantly across different methods due to their underlying principles Geng et al. (2023) ; Da et al. (2024) , calibrated confidence measures align better with human intuition for probabilities and are more interpretable Guo et al. (2017) ; Cosmides and Tooby (1996) . While this paper focuses on evaluating confidence estimation methods, the same framework could be applied to evaluate future NLG calibration methods. We demonstrate this by including results using common calibration metrics like Expected Calibration Error (ECE). Evaluation of Confidence Measures While confidence estimation has received considerable attention, the evaluation of confidence measures remains under-explored. Many evaluation methods have been adapted from the classification literature, including Expected Calibration Error (ECE) Guo et al. (2017) ; Xiong et al. (2024) and Area Under the Receiver Operating Characteristic Curve (AUROC) Kuhn et al. (2023) . These metrics assess the relationship between confidence scores and prediction accuracy, typically requiring high-quality correctness labels for the evaluated responses. However, obtaining reliable correctness labels in NLG is challenging due to factors such as semantic variability and ambiguity in open-ended tasks Novikova et al. (2017) . Unlike classification where correctness is well-defined, NLG correctness is often determined through human annotation, LLM-based judges, or similarity-based comparisons between the generated and reference answers. These approaches are costly and often unreliable, as correctness judgments can be subjective and inconsistent Gatt and Krahmer (2018) . Recent works have attempted to mitigate these limitations. To allow for non-binary correctness measures, Rank Calibration Error (RCE) Huang et al. (2024) and AUARC Nadeem et al. (2009) ; Lin et al. (2024b) were introduced, both of which leverage continuous correctness scores. Other approaches focus on improving correctness scores themselves. For example, Lin et al. (2024a) aggregates predictions from multiple LLM-based judges and takes a consensus to enhance reliability. Unlike these methods, our proposed framework completely circumvents the need for correctness labels, making it more robust and scalable for evaluating confidence measures in NLG. Applications of Confidence Measures Confidence measures play a crucial role in several downstream research areas in NLG, particularly in conformalized NLG and selective generation or generation with abstention. Stemming from Conformal Prediction Papadopoulos et al. (2007) , in the context of NLG, conformalized methods typically aim to create a set of generation that satisfies a particular user-defined quality goal (e.g. “correct answers”) Quach et al. (2023) ; Gui et al. (2024) ; Lee et al.

Read the complete text