UncLE : Uncertainty Expressions in Long-Form Generation

Ruihan Yang, Caiqi Zhang, Zhisong Zhang, Xinting Huang, Dong Yu, Nigel Collier, Deqing Yang · 2025

Read UncLE : Uncertainty Expressions in Long-Form Generation by Ruihan Yang, Caiqi Zhang, Zhisong Zhang, Xinting Huang, Dong Yu, Nigel Collier, Deqing Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16922.txt.

Introduction

Ruihan Yang and six co-authors built a benchmark for how AI models express doubt in a 2025 paper. Language models often state false things with full confidence, above all in long answers. Teaching a model to say it is unsure could cut that harm, but no fair test of the skill existed.

Their benchmark, UNCLE, covers five domains and over a thousand topics. Each topic has a short question and a long-form one with matching gold answers, so honesty in both formats can be compared directly. New scoring rules check whether a model voices doubt exactly when it should. Current models did poorly at voicing doubt in long answers. Training-based fixes helped more than clever prompting. The authors also map the gap between short and long answers, which points to where future work should aim.

Catalog record

CREATORRuihan Yang, Caiqi Zhang, Zhisong Zhang, Xinting Huang, Dong Yu, Nigel Collier, Deqing Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16922

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UncLE : Uncertainty Expressions in Long-Form Generation Ruihan Yang, Caiqi Zhang, Zhisong Zhang, Xinting Huang, Dong Yu, Nigel Collier, Deqing Yang Abstract Large Language Models (LLMs) are prone to hallucination, particularly in long-form generations. A promising direction to mitigate hallucination is to teach LLMs to express uncertainty explicitly when they lack sufficient knowledge. However, existing work lacks direct and fair evaluation of LLMs’ ability to express uncertainty effectively in long-form generation. To address this gap, we first introduce UncLE , a benchmark designed to evaluate uncertainty expression in both long- and short-form question answering (QA). UncLE spans five domains and comprises 4k long-form QA instances and over 20k short-form QA pairs. Our dataset is the first to directly bridge short- and long-form QA with paired questions and gold-standard answers. Along with the benchmark, we propose a suite of new metrics to assess the models’ capabilities to selectively express uncertainty. Using UncLE , we then demonstrate that current models fail to convey uncertainty appropriately in long-form generation. We further explore both prompt-based and training-based methods to improve models’ performance, with the training-based methods yielding greater gains. Further analysis of alignment gaps between short- and long-form uncertainty expression highlights promising directions for future research using UncLE 1 1 1 Project page: https://github.com/rhyang2021/UNCLE . 1 Introduction Figure 1: Evaluating uncertainty in long-form generation is challenging: different models may express uncertainty across varying aspects, often focusing on less important ones. Restricting the key aspects in long-form generation helps ensure more consistent evaluation . Large Language Models (LLMs) exhibit strong text generation abilities across diverse tasks and domains. However, they often hallucinate by generating incorrect or fabricated information ( Zhang et al. 2023 ; Huang et al. 2023 ) , especially when lacking sufficient knowledge ( Gekhman et al. 2024a ; Li et al. 2023 ) . Enabling models to either refuse to answer or explicitly express uncertainty has emerged as a promising direction to reduce hallucinations and enhance trustworthiness ( Zhang et al. 2024a ; Zhang et al. 2024b ; Yang et al. 2024b ) . Current research on uncertainty expression in LLMs focuses primarily on short-form QA, where responses typically contain fewer than ten words ( Kuhn et al. 2023 ; Lin et al. 2023 ; Fadeeva et al. 2023 ; Wang et al. 2024 ) . However, real-world applications often require much longer outputs (exceeding 100 words) that may contain a mixture of correct and incorrect statements ( Zhang et al. 2024a ; Huang et al. 2024a ) . The challenge of estimating uncertainty in long-form generation remains under-explored. Unlike previous post-hoc methods for long-form uncertainty estimation ( Fadeeva et al. 2023 ; Zhang et al. 2024a ; Huang et al. 2024a ; Jiang et al. 2024 ) , which provide numerical estimates of output uncertainty, we explore the use of linguistic uncertainty expressions ( e . g ., “it is unclear whether” or “I am not sure”). These expressions are generated along with the output responses in a single decoding pass to convey uncertainty or lack of knowledge ( Zhou et al. 2023 ; Kim et al. 2024 ) . We argue that such explicit and interpretable expressions not only align more closely with human communication but also offer efficiency advantages, as they are produced on-the-fly with minimal additional computational cost. Regarding linguistic uncertainty expression in long-form generation, Yang et al. 2024b propose a two-stage training approach to address uncertainty suppression and alignment issues. Band et al. 2024 introduce linguistic calibration, enabling models to express uncertainty at different levels ( e . g ., I am 70% sure). However, due to the open-ended nature of long-form QA, different models may focus on different aspects and express uncertainty from different angles, making direct comparison challenging (upper; Figure 1 ). As a result, prior work does not answer a key research question: How can we fairly evaluate different models’ ability to accurately express uncertainty in long-form generation? In this work, we introduce UncLE ( Unc ertainty in L ong-form E xpressions), the first benchmark designed to comprehensively evaluate a model’s ability to accurately express uncertainty in both long-form and short-form generation (Contribution #1 ). Our dataset is the first to directly bridge short- and long-form QA with paired questions and gold answers. Each question contains one topic entity with multiple key aspects that models are expected to cover in their responses (Figure 1 bottom; more examples in Table 5 ). Each aspect is associated with a short-form question and a ground truth answer. The dataset spans five domains (biographies, companies, movies, astronomical objects, and diseases), containing approximately 4k long-form QA instances, together with more than 20k short-form QA pairs. We also propose a suite of novel metrics to provide a comprehensive evaluation of uncertainty expression (Section 3 ). Using UncLE as a unified testbed, we evaluate ten popular LLMs to assess their ability to accurately express uncertainty in long-form generation. We reveal three key findings (Contribution #2 ): (1) Although models can generally provide correct answers for known facts, current models show limited ability to accurately express uncertainty for unknown facts. (2) Closed-source models tend to use uncertainty expressions more frequently, while open-source models express uncertainty more accurately. (3) Models are more likely to use uncertainty expressions in short-form QA than in long-form QA (Section 5 ). Given that UncLE provides a direct comparison between short- and long-form uncertainty expressions, we investigate strategies to enhance model performance in both formats (Contribution #3 ; Section 6 ). We consider both prompt-based and training-based approaches. We experiment with various training settings: exclusively short-form QA, exclusively long-form QA, and a mixture of both. Our results demonstrate that both prompt-based and training-based approaches improve over the base model, with training-based methods generally achieving greater gains. Meanwhile, training on long-form tasks benefits short-form tasks, but not vice versa. Furthermore, we analyze the alignment between short- and long-form uncertainty expressions and reveal a significant alignment gap (Section 7 ). We encourage future research to develop methods with UncLE that perform robustly across both QA formats. 2 Related Work Evaluating Long-form Factuality and Uncertainty. The evaluation of factuality in long-form generation has been extensively studied ( Min et al. 2023a ; Wei et al. 2024b ; Zhao et al. 2024a ; Song et al. 2024 ; Chiang and Lee 2024 ) , typically by decomposing the text into atomic claims and verifying each claim using external knowledge sources. Existing LLMs have demonstrated strong performance in generating and verifying atomic claims, achieving low error rates compared to human annotation ( Min et al. 2023a ; Zhang et al. 2024a ) . However, none of these studies specifically examine whether model-generated responses contain uncertainty expressions or whether those expressions are accurate . On the other hand, existing studies on estimating uncertainty in long-form generation primarily focus on post-hoc methods ( Zhang et al. 2024a ; Zhang et al. 2024b ; Huang et al. 2024b ; Jiang et al. 2024 ) , where a confidence score is assigned to each response, and traditional metrics like Spearman correlation or AUROC are used for a response level evaluation. Limited work has been done to assess how accurately models express uncertainty in long-form generation for each

Read the complete text