GENUINE: Graph Enhanced Multi-level Uncertainty Estimation for Large Language Models

Tuo Wang, Adithya Kulkarni, Tyler Cody, Peter A. Beling, Yujun Yan, Dawei Zhou · 2025

Read GENUINE: Graph Enhanced Multi-level Uncertainty Estimation for Large Language Models by Tuo Wang, Adithya Kulkarni, Tyler Cody, Peter A. Beling, Yujun Yan, Dawei Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07925.txt.

Description

Knowing when a language model should not be trusted is the problem addressed by Tuo Wang and 5 co-authors in a 2025 paper. In high-stakes settings, a confident wrong answer is dangerous. Many uncertainty methods only look at token probabilities, the model's step-by-step word choices, and miss how meaning is structured across a whole answer.

Their framework, GENUINE, builds graphs from dependency parse trees, which map grammatical links between words, and pools them at several levels. Supervised learning then sharpens the confidence estimate using semantic and structural relationships. Tests reported in the study support the approach. Better uncertainty estimates let users and downstream systems decide when to accept an answer, double-check it, or hand the task to a person.

Catalog record

CREATORTuo Wang, Adithya Kulkarni, Tyler Cody, Peter A. Beling, Yujun Yan, Dawei Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07925

Browse the full library · About the Tower of Babel