Embedding Perturbation may Better Reflect the Uncertainty in LLM Reasoning

Qihao Wen, Jiahao Wang, Yang Nan, Pengfei He, Ravi Tandon, Han Xu · 2026

Read Embedding Perturbation may Better Reflect the Uncertainty in LLM Reasoning by Qihao Wen, Jiahao Wang, Yang Nan, Pengfei He, Ravi Tandon, Han Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02427.txt.

Description

Qihao Wen and 5 co-authors pinpoint where a language model's reasoning becomes uncertain, not just whether the final answer is shaky, in a 2026 arXiv paper. Uncertainty quantification estimates how likely an output is to be wrong. For multi-step reasoning, knowing the exact location of doubt could enable targeted fixes during generation.

The study finds that uncertain continuations tend to occur at tokens highly sensitive to small changes in the embeddings of earlier tokens. Embeddings are the model's internal numeric representations of words. Metrics built on that sensitivity located uncertain intermediate steps better than probability-based, sampling-based, and Bayesian baselines. The proposed measures are also simple and efficient to compute. The result gives practitioners a fine-grained warning light inside long reasoning chains.

Catalog record

CREATORQihao Wen, Jiahao Wang, Yang Nan, Pengfei He, Ravi Tandon, Han Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02427

Browse the full library · About the Tower of Babel