“I May Not Have Articulated Myself Clearly”: Diagnosing Dynamic Instability in LLM Reasoning at Inference Time
Jinkun Chen, Fengxiang Cheng, Sijia Han, Vlado Keselj · 2026
Read “I May Not Have Articulated Myself Clearly”: Diagnosing Dynamic Instability in LLM Reasoning at Inference Time by Jinkun Chen, Fengxiang Cheng, Sijia Han, Vlado Keselj (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02863.txt.
Description
Jinkun Chen and 3 co-authors ask whether a language model's reasoning breakdown can be spotted while it happens, in a 2026 paper. Most checks only grade the final answer. Yet many failures begin mid-answer, when the model loses the thread of its own argument.
The authors build a simple instability signal from token probabilities available in standard interfaces. It combines sudden shifts between steps with uncertainty at each step. Peak instability predicted wrong answers on math and multi-step question datasets. Timing mattered too. Early instability often recovered and ended correctly. Late instability more often led to failure. The method needs no training and works across model sizes.
Catalog record
| CREATOR | Jinkun Chen, Fengxiang Cheng, Sijia Han, Vlado Keselj |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02863