Can Aha Moments Be Fake? Identifying True and Decorative Thinking Steps in Chain-of-Thought

Jiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song, [4pt] Northeastern University · 2025

Read Can Aha Moments Be Fake? Identifying True and Decorative Thinking Steps in Chain-of-Thought by Jiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song, [4pt] Northeastern University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24941.txt.

Description

Jiachen Zhao, Yiyou Sun, Weiyan Shi, and Dawn Song ask if the bright aha flash in a model's thought chain is real thought or just show. Past work hints such chains can be post hoc tales, not a true log of the math the model did. Their score, TTS, weighs how much each step in fact sways the final call.

Across eleven models, from small to vast, on known thought sets, chains mixed true steps with show steps. Show steps look of use but sway the end next to none. Even top models had a large share of show steps on math sets. Cut of low score steps kept scores while chains shrank a lot.

Catalog record

CREATORJiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song, [4pt] Northeastern University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24941

Browse the full library · About the Tower of Babel