Can Large Language Models Develop Strategic Reasoning? Post-training Insights from Learning Chess
Dongyoon Hwang Hojoon Lee Jaegul Choo Dongmin Park Jongho Park · 2025
Read Can Large Language Models Develop Strategic Reasoning? Post-training Insights from Learning Chess by Dongyoon Hwang Hojoon Lee Jaegul Choo Dongmin Park Jongho Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00726.txt.
Description
Dongyoon Hwang, Hojoon Lee, Jaegul Choo, Dongmin Park, and Jongho Park ask whether language models can learn strategy through chess training, in this 2025 study. Reward training has lifted math reasoning, but games of strategy were untested. The team trained models on chess, scoring each move with a chess-trained value network, a dense reward drawn from a teacher's judgment.
Dense rewards often beat sparse win-or-loss rewards. Yet every model stalled far below expert play. Tests that varied the training mix pointed to the root: the base models hold a thin inner grasp of chess itself, and reward training alone cannot fill that gap. The authors share their code and frame the ceiling as a lesson for strategy training at large.
Catalog record
| CREATOR | Dongyoon Hwang Hojoon Lee Jaegul Choo Dongmin Park Jongho Park |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00726