Uncertainty Quantification of Large Language Models through Multi-Dimensional Responses
Tiejin Chen, Xiaoou Liu, Longchao Da, Jia Chen, Vagelis Papalexakis, Hua Wei · 2025
Read Uncertainty Quantification of Large Language Models through Multi-Dimensional Responses by Tiejin Chen, Xiaoou Liu, Longchao Da, Jia Chen, Vagelis Papalexakis, Hua Wei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16820.txt.
Description
Tiejin Chen and five co-authors present a 2025 method for measuring how unsure a large language model is about its own answers. Knowing when a model may be wrong matters most in high-stakes fields such as health care and finance. Older methods judge doubt by how alike the model's answers are in wording, which misses what the answers claim as fact.
The new framework draws several answers to one question, then uses helper models to pull out the facts inside each. It builds two maps of likeness, one for wording and one for facts, and blends them with a tensor method into one doubt score. The split keeps word changes apart from fact changes. In tests, the method flagged shaky answers better than prior tools, which the authors offer as a firmer base for trusting model output.
Catalog record
| CREATOR | Tiejin Chen, Xiaoou Liu, Longchao Da, Jia Chen, Vagelis Papalexakis, Hua Wei |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-16820