Trusted Uncertainty in Large Language Models: A Unified Framework for Confidence Calibration and Risk-Controlled Refusal DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2025; Woodstock, NY Price: 15.00 ISBN: 978-1-4503
Markus Oehri, Giulia Conti, Kaviraj Pather, Alexandre Rossi, Laia Serra, Adrian Parody, Rogvi Johannesen, Aviaja Petersen, Arben Krasniqi · 2025
Read Trusted Uncertainty in Large Language Models: A Unified Framework for Confidence Calibration and Risk-Controlled Refusal DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2025; Woodstock, NY Price: 15.00 ISBN: 978-1-4503 by Markus Oehri, Giulia Conti, Kaviraj Pather, Alexandre Rossi, Laia Serra, Adrian Parody, Rogvi Johannesen, Aviaja Petersen, Arben Krasniqi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01455.txt.
Introduction
A deployed language model must know when to stay silent, not just what to say, since a confident wrong answer can do harm. Markus Oehri, with eight co-authors, presents UniCR, a framework that turns mixed uncertainty signals into one calibrated probability that an answer is right. Signals include sequence likelihoods, self-consistency spread, retrieval fit, and feedback from tools or verifiers.
A light calibration head, tuned with temperature scaling and proper scoring rules, produces that probability, and a refusal rule then enforces a user-set error budget. Distribution-free guarantees come from conformal risk control. For long answers, confidence is aligned with atomic factuality scores drawn from retrieved evidence, cutting confident hallucinations while keeping coverage. Tests span short questions, code with execution checks, and retrieval-based long-form tasks.
Catalog record
| CREATOR | Markus Oehri, Giulia Conti, Kaviraj Pather, Alexandre Rossi, Laia Serra, Adrian Parody, Rogvi Johannesen, Aviaja Petersen, Arben Krasniqi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-01455
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Trusted Uncertainty in Large Language Models: A Unified Framework for Confidence Calibration and Risk-Controlled Refusal DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2025; Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Machine learning CCS: Social and professional topics AI, robotics and automation Markus Oehri, Giulia Conti, Kaviraj Pather, Alexandre Rossi, Laia Serra, Adrian Parody, Rogvi Johannesen, Aviaja Petersen, Arben Krasniqi Abstract . Deployed language models must decide not only what to answer but also when not to answer . We present UniCR , a unified framework that turns heterogeneous uncertainty evidence—sequence likelihoods, self-consistency dispersion, retrieval compatibility, and tool/verifier feedback—into a calibrated probability of correctness and then enforces a user-specified error budget via principled refusal. UniCR learns a lightweight calibration head with temperature scaling and proper scoring, supports API-only models through black-box features, and offers distribution-free guarantees using conformal risk control. For long-form generation, we align confidence with semantic fidelity by supervising on atomic factuality scores derived from retrieved evidence, reducing confident hallucinations while preserving coverage. Experiments on short-form QA, code generation with execution tests, and retrieval-augmented long-form QA show consistent improvements in ECE/Brier, lower area under the risk–coverage curve, and higher coverage at fixed risk compared to entropy/logit thresholds, post-hoc calibrators, and end-to-end selective baselines. Analyses reveal that evidence contradiction, semantic dispersion, and tool inconsistency are the dominant drivers of abstention, yielding informative, user-facing refusal messages. The result is a portable recipe—evidence fusion → \rightarrow calibrated probability → \rightarrow risk-controlled decision—that improves trustworthiness without fine-tuning the base model and remains valid under distribution shift. 1. Introduction Large language models (LLMs) are increasingly deployed in safety–critical settings where answers must be correct—or else responsibly withheld. Yet modern neural predictors are notoriously miscalibrated, often assigning high confidence to wrong answers, a phenomenon documented from classic discriminative models through contemporary deep networks ( Gu et al. 2023a ; Platt 1999 ; Guo et al. 2017 ; Kull et al. 2019 ; Karandikar et al. 2021 ; Nixon et al. 2019 ; Minderer et al. 2021 ; Zhang et al. 2025a ) . Uncertainty estimation and ensembling help but degrade under dataset shift ( Lakshminarayanan et al. 2017 ; Zhang et al. 2025b ; Ovadia et al. 2019 ) , while evidence-based approaches such as prior networks, evidential learning, and deterministic surrogates provide complementary but still imperfect signals ( Malinin and Gales 2018 ; Sensoy et al. 2018 ; Mukhoti et al. 2023 ) . In generative LLMs, the miscalibration problem becomes more subtle: uncertainties are semantic rather than purely token–level, and surface probabilities can correlate weakly with factuality ( Kuhn et al. 2023 ; Band et al. 2024 ; Yang et al. 2024 ) . Recent work links hallucinations to entropy in meaning space ( Farquhar et al. 2024 ) and explores self-consistent decoding to stabilize reasoning traces ( Wang et al. 2023 ; Cui et al. 2025 ) . Complementary detection strategies probe black-box models via re-querying and agreement tests ( Manakul et al. 2023 ; Liu et al. 2024a ) , while truthfulness audits and long-form factuality measures stress-test factual precision beyond short answers ( Lin et al. 2022 ; Fan et al. 2024 ; Min et al. 2023 ) . A principled answer to “answer or abstain?” has deep roots in decision theory and selective prediction. The reject option dates back to the optimal error–reject tradeoff of Chow and classical treatments in nearest-neighbor classification ( Chow 1970 ; Hellman 1970 ) . Modern learning-theoretic formulations study learning with rejection and calibrated selective risk ( Cortes et al. 2016 ; Bates et al. 2021 ) , and neural instantiations integrate the rejector directly into the network ( Geifman and El-Yaniv 2019 ) . Foundational surveys and evaluations caution against common pitfalls in selective classification metrics and protocols ( Varshney et al. 2022 ; Vaz et al. 2024 ) , introduce robust risk curves and area-under-risk (AURC) analyses ( Ding et al. 2020 ; Zhou et al. 2022 ) , and benchmark misclassification/ood detectors that underlie many abstention policies ( Hendrycks and Gimpel 2017 ) . In NLP, selective QA formalizes the answer/refuse decision under distribution shift ( Kamath et al. 2020 ) , and datasets with unanswerable questions remain essential for calibrating refusal behavior ( Rajpurkar et al. 2018 ; Huang et al. 2020 ) . For LLMs specifically, a fast-growing body of work seeks calibrated confidences and distribution-free guarantees without intrusive access to model internals. Conformal risk control unifies coverage under user-specified risk, with extensions tailored to sequence generation ( Angelopoulos et al. 2022 ; Zhang et al. 2025a ; Quach et al. 2024 ) , factual guarantees for language models ( Mohri and Hashimoto 2024 ) , and API-only settings where logits are hidden ( Su et al. 2024 ; Liu et al. 2024b ) . Broader overviews distill the conformal toolbox for NLP and beyond ( Campos et al. 2024 ; Angelopoulos et al. 2025 ) , while recent theory strengthens validity and finite-sample properties for LLM outputs ( Cherian et al. 2024 ) . Orthogonal lines explore eliciting better confidences from the models themselves via prediction-based calibration, verbalized confidence, or prompt-time normalization ( Ulmer et al. 2024 ; Hu et al. 2025 ; Zhao et al. 2021 ) . Reliability under regression objectives, where scalar targets matter (e.g., risk scores), motivates regression-aware inference ( Lukasik et al. 2024 ) . Meta-analyses ask whether LLMs “know what they know” and how to quantify that self-knowledge robustly ( Kadavath et al. 2022 ; Liu et al. 2024b ; Yin et al. 2024 ) , and surveys synthesize refusal strategies and abstention behavior at scale ( Wang et al. 2024 ) . Together, these strands suggest a unified view where calibrated correctness probabilities drive a risk-controlled decision of answering vs. refusing. Our perspective is also informed by uncertainty and abstention in adjacent multimodal and edge-intelligent systems, where sensing noise, domain shift, and open-set conditions are endemic. For instance, open-set gesture recognition under Wi-Fi channel state information must combine uncertainty reduction with robust prototypes to avoid overconfident errors ( Zhang et al. 2025a ) . Wi-Fi–based human activity recognition likewise faces co-channel interference and benefits from correlation modeling and anti-interference selection . Commodity-device gesture recognition with attention and sensors highlights real-world noise and the need for reliable refusal when confidence is low . In affective computing, unobtrusive emotion recognition fused from Wi-Fi and vision calls for calibrated fusion to mitigate false positives ( Gu et al. 2023b ) , while label-noise suppression improves reliability in facial expression analysis—another facet of selective prediction ( Zhang et al. 2025b ) . Broader vision and multimedia work on audio–visual events, micro-action recognition, and video grounding underscores the prevalence of uncertainty-aware reasoning ( Guo et al. 2024 ; Zhang et al. 2024 ) . On the systems side, federated and edge learning raise additional risks from heterogeneity; experience-driven migration and hierarchical NAS for federated settings provide levers for reliable deployment , and robust sensing pipelines even enable keystroke inference from commodity microphones—an adversarial example of why calibrated abstention matters for safety . Recent advances in distributional robustness