EDIS: Diagnosing LLM Reasoning via Entropy Dynamics

Chenghua Zhu, Siyan Wu, Xiangkang Zeng, Zishan Xu, Zhaolu Kang, Yifu Guo, Yuquan Lu, Junduan Huang, Guojing Zhou · 2026

Read EDIS: Diagnosing LLM Reasoning via Entropy Dynamics by Chenghua Zhu, Siyan Wu, Xiangkang Zeng, Zishan Xu, Zhaolu Kang, Yifu Guo, Yuquan Lu, Junduan Huang, Guojing Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01288.txt.

Description

Chenghua Zhu and co-authors read language-model thought through the path of doubt over time, not just its mean. Past doubt scores sum token doubt into one flat number, wasting doubt's shape as words unfold. Their read of token doubt paths finds wrong answers marked by wild swings: burst spikes of rising doubt and peak-valley spikes after brief calm. Those marks hold across models and train stages, hinting at deep failure traits. Their EDIS score sums path wobble and lifts pick accuracy at run time.

Catalog record

CREATORChenghua Zhu, Siyan Wu, Xiangkang Zeng, Zishan Xu, Zhaolu Kang, Yifu Guo, Yuquan Lu, Junduan Huang, Guojing Zhou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47381
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01288

Browse the full library · About the Tower of Babel