Uncertainty Quantification of Large Language Models through Multi-Dimensional Responses

Tiejin Chen, Xiaoou Liu, Longchao Da, Jia Chen, Vagelis Papalexakis, Hua Wei · 2025

Read Uncertainty Quantification of Large Language Models through Multi-Dimensional Responses by Tiejin Chen, Xiaoou Liu, Longchao Da, Jia Chen, Vagelis Papalexakis, Hua Wei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16820.txt.

Description

Tiejin Chen and five co-authors present a 2025 method for measuring how unsure a large language model is about its own answers. Knowing when a model may be wrong matters most in high-stakes fields such as health care and finance. Older methods judge doubt by how alike the model's answers are in wording, which misses what the answers claim as fact.

The new framework draws several answers to one question, then uses helper models to pull out the facts inside each. It builds two maps of likeness, one for wording and one for facts, and blends them with a tensor method into one doubt score. The split keeps word changes apart from fact changes. In tests, the method flagged shaky answers better than prior tools, which the authors offer as a firmer base for trusting model output.

Catalog record

CREATORTiejin Chen, Xiaoou Liu, Longchao Da, Jia Chen, Vagelis Papalexakis, Hua Wei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-16820

Browse the full library · About the Tower of Babel