LLMs are Single-threaded Reasoners: Demystifying the Working Mechanism of Soft Thinking

Chünhung Wu, Jinliang Lu, Zixuan Ren, Gangqiang Hu, Zhi Wu, Dai Dai, Hua Wu · 2025

Read LLMs are Single-threaded Reasoners: Demystifying the Working Mechanism of Soft Thinking by Chünhung Wu, Jinliang Lu, Zixuan Ren, Gangqiang Hu, Zhi Wu, Dai Dai, Hua Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03440.txt.

Description

Junhong Wu and co-authors probe a new way for language models to think in soft, blurred tokens in place of firm words. Hopes ran high that soft thought lets a model walk many paths at once. Their 2025 study peers inside models as they reason this way, with a kit of probe tests. The probes tell a plainer tale: the model leans on the top one soft pick at each step.

That lean makes a greedy loop: the top pick feeds the next step, which locks the path and starves the rest. Rich soft facts thus go to waste. Their fix stirs chance into each pick, which breaks the loop. Tests show gains from the stir. The work recasts soft thought as one-track by default, with chance as the switch to breadth.

Catalog record

CREATORChünhung Wu, Jinliang Lu, Zixuan Ren, Gangqiang Hu, Zhi Wu, Dai Dai, Hua Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-03440

Browse the full library · About the Tower of Babel