Can Aha Moments Be Fake? Identifying True and Decorative Thinking Steps in Chain-of-Thought
Jiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song, [4pt] Northeastern University · 2025
Read Can Aha Moments Be Fake? Identifying True and Decorative Thinking Steps in Chain-of-Thought by Jiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song, [4pt] Northeastern University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24941.txt.
Description
Jiachen Zhao, Yiyou Sun, Weiyan Shi, and Dawn Song ask if the bright aha flash in a model's thought chain is real thought or just show. Past work hints such chains can be post hoc tales, not a true log of the math the model did. Their score, TTS, weighs how much each step in fact sways the final call.
Across eleven models, from small to vast, on known thought sets, chains mixed true steps with show steps. Show steps look of use but sway the end next to none. Even top models had a large share of show steps on math sets. Cut of low score steps kept scores while chains shrank a lot.
Catalog record
| CREATOR | Jiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song, [4pt] Northeastern University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24941