Embedding Perturbation may Better Reflect the Uncertainty in LLM Reasoning
Qihao Wen, Jiahao Wang, Yang Nan, Pengfei He, Ravi Tandon, Han Xu · 2026
Read Embedding Perturbation may Better Reflect the Uncertainty in LLM Reasoning by Qihao Wen, Jiahao Wang, Yang Nan, Pengfei He, Ravi Tandon, Han Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02427.txt.
Description
Qihao Wen and 5 co-authors pinpoint where a language model's reasoning becomes uncertain, not just whether the final answer is shaky, in a 2026 arXiv paper. Uncertainty quantification estimates how likely an output is to be wrong. For multi-step reasoning, knowing the exact location of doubt could enable targeted fixes during generation.
The study finds that uncertain continuations tend to occur at tokens highly sensitive to small changes in the embeddings of earlier tokens. Embeddings are the model's internal numeric representations of words. Metrics built on that sensitivity located uncertain intermediate steps better than probability-based, sampling-based, and Bayesian baselines. The proposed measures are also simple and efficient to compute. The result gives practitioners a fine-grained warning light inside long reasoning chains.
Catalog record
| CREATOR | Qihao Wen, Jiahao Wang, Yang Nan, Pengfei He, Ravi Tandon, Han Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02427