Tracing the Thought of a Grandmaster-level Chess-Playing Transformer

Rui Lin, Zhenyu Jin, Guancheng Zhou, Xuyang Ge, Wentao Shu, Jiaxing Wu, Junxuan Wang, Zhengfu He, Junping Zhang, Xipeng Qiu · 2026

Read Tracing the Thought of a Grandmaster-level Chess-Playing Transformer by Rui Lin, Zhenyu Jin, Guancheng Zhou, Xuyang Ge, Wentao Shu, Jiaxing Wu, Junxuan Wang, Zhengfu He, Junping Zhang, Xipeng Qiu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10158.txt.

Description

Lin and nine colleagues open up Leela Chess Zero, a top chess transformer whose inner workings are largely opaque. They take apart its MLP and attention modules with sparse stand-in layers that capture the main work. A close case study shows these pathways expose rich, checkable tactical ideas. Three numeric metrics further show side-by-side reasoning matching the policy head's built-in bias. This is the first breakdown of both module types for clarity, and causal tests complete the picture of super-human tactical reasoning.

Catalog record

CREATORRui Lin, Zhenyu Jin, Guancheng Zhou, Xuyang Ge, Wentao Shu, Jiaxing Wu, Junxuan Wang, Zhengfu He, Junping Zhang, Xipeng Qiu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66832
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10158

Browse the full library · About the Tower of Babel