Chessformer: A Unified Architecture for Chess Modeling

Daniel Monroe, George Eilender, Philip Chalmers, Zhenwei Tang, Ashton Anderson · 2026

Read Chessformer: A Unified Architecture for Chess Modeling by Daniel Monroe, George Eilender, Philip Chalmers, Zhenwei Tang, Ashton Anderson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19091.txt.

Introduction

Daniel Monroe and four colleagues unify three chess-modelling goals, playing strength, human move prediction, and interpretability, in one architecture called Chessformer. It treats board squares as tokens, adds a geometric attention bias adapted to board geometry, and predicts moves with a source-destination policy head. A human-move model built on it matches human moves 57.1 percent of the time with under a quarter of earlier parameters. Integrated into Leela Chess Zero, it adds over 100 Elo and has beaten Stockfish in tournaments. Its square-based design supports interpretability.

Catalog record

CREATORDaniel Monroe, George Eilender, Philip Chalmers, Zhenwei Tang, Ashton Anderson
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66092
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.19091

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Chessformer: A Unified Architecture for Chess Modeling Daniel Monroe, George Eilender, Philip Chalmers, Zhenwei Tang, Ashton Anderson Abstract Chess has long served as a canonical testbed for artificial intelligence, but modeling approaches for its central tasks have diverged. Maximizing playing strength, predicting human play, and enabling interpretability are typically solved with disparate architectures, and these designs are often misaligned with the geometry of the domain. This raises the natural question of whether these objectives require separate modeling paradigms, or if there exists a single architecture that supports them simultaneously. We introduce Chessformer, a unified architecture that advances the state of the art on all three central goals in chess modeling. Chessformer is an encoder-only transformer that represents board squares as tokens, augments self-attention with a novel dynamic positional encoding called Geometric Attention Bias (GAB) that adapts to domain-specific geometry, and predicts actions with an attention-based source-destination policy head. We evaluate Chessformer on each front. First, we develop Maia-3 , a family of models for human move prediction that reaches 57.1% move-matching accuracy, significantly surpassing the previous state of the art with fewer than a quarter of the parameters. Second, we integrate Chessformer into Leela Chess Zero, a leading open-source engine, adding over 100 Elo of playing strength and resulting in tournament victories over Stockfish in major computer chess competitions. Third, we show that Chessformer’s square-token design makes attention patterns and activations directly attributable to board squares, enabling granular interpretability analyses that prior architectures do not naturally support. More broadly, our results demonstrate that aligning a model’s tokenization, positional encoding, and output design with the underlying structure of a domain can yield simultaneous gains in performance, human compatibility, and interpretability. 1 Introduction A central goal of artificial intelligence (AI) is to build systems that are simultaneously high-performing and human-compatible. Models that are both intelligent and intelligible promise to not only be powerful on their own, but to also augment human partners through collaboration, teaching, and mutual understanding. Chess is a particularly well-suited model system for this dual goal: while modern chess engines are decisively superhuman, their behavior often diverges significantly from human players and remains opaque even to experts. However, the current chess modeling literature is fragmented. Systems for raw strength include alpha-beta search engines, self-play policy-value networks with MCTS, and transformers with linearized board representations ( Campbell et al. 2002 ; Romstad et al. 2023 ; Silver et al. 2018 ; Ruoss et al. 2024 ) , while human move-prediction systems range from convolutional stacks over board images ( McIlroy-Young et al. 2020 ; Tang et al. 2024 ) to autoregressive models of move histories ( Zhang et al. 2025 ) . This raises a natural question: can one architecture support strength, human modeling, and interpretability simultaneously? We introduce Chessformer, a unified architecture that advances the state of the art on three fronts at once: it produces substantial gains over prior methods in raw chess-playing ability, it surpasses state-of-the-art human move-matching performance with a fraction of the parameter count, and it admits downstream interpretability analyses more naturally than previous models. Concretely, Chessformer is an encoder-only transformer that treats the 64 board squares as tokens, pairs this square-token body with an attention-based “source-destination” policy head, and equips the trunk with Geometric Attention Bias (GAB), a novel dynamic positional-bias generator that adapts attention to the geometry of a chess position. We demonstrate Chessformer’s performance on all three objectives. First, we report on integrating the Chessformer design into Leela Chess Zero, a leading open-source chess engine. Chessformer increased the playing strength of Leela by over 100 Elo points (for reference, major chess engine releases rarely surpass previous versions by more than 50 Elo points ( Stockfish Team 2026 ) ), which resulted in configurations that defeated the perennial world champion Stockfish in elite computer chess tournaments. Second, we use the Chessformer architecture to train Maia-3 , a series of models that represent the new state-of-the-art in human chess move prediction. Our 79M-parameter model achieves a move-matching accuracy of 57.1%, surpassing the previous best of 55.9%, which was attained by a prior method’s 355M-parameter model with search enabled ( Zhang et al. 2025 ) . Third, we present interpretability findings that are enabled by Chessformer’s domain-aligned architecture. Chessformer learns many fine-grained and interpretable features corresponding both to well-known chess concepts, such as forks and pins, and to lesser-known patterns that capture meaningful variation. Empirically, we find that GAB is a key driver of Chessformer’s generalist abilities. Our ablations show it contributes significant improvements over absolute and relative position encodings for Elo, puzzle accuracy, and policy and value accuracy, with sizable performance-per-compute efficiency gains. These results reinforce a broader lesson: adapting model architecture to a domain’s structure allows AI models to more flexibly adapt to both task mastery and human compatibility. In chess, this yields a single model family that improves engine strength, advances human move-matching, and enables square-level interpretability, all while being substantially more efficient than previous approaches. We open-source all code and data at https://github.com/CSSLab/maia3 . 2 Related Work Computational approaches to chess have traditionally focused on maximizing absolute playing strength by developing hand-crafted search heuristics and position evaluations. This approach gave rise to Deep Blue ( Campbell et al. 2002 ) , which in 1997 became the first computer to defeat a reigning human World Chess Champion in a match, and Stockfish ( Romstad et al. 2023 ) , which is generally considered the strongest chess engine available today. AlphaZero ( Silver et al. 2018 ) introduced a different recipe based on Monte Carlo tree search (MCTS) and reinforcement learning, training neural networks through self-play to predict state values and policy distributions over subsequent actions. The open-source re-implementation Leela Chess Zero ( Pascutto & Linscott 2019 ) refined this approach with new neural network architectures and search strategies and often ranks as a close runner-up to Stockfish in computer chess competitions. Even without search, transformer-based agents can achieve grandmaster-level strength when strong oracles are distilled into them ( Ruoss et al. 2024 ) . A more recent line of work aims to develop chess systems that are not only strong but also human-compatible, in the sense that they understand and are attuned to the behavior of humans, by modeling human play across skill levels. This was first explored by Maia ( McIlroy-Young et al. 2020 ) , which employed a set of convolutional neural networks, each trained to model players at a specific rating range. Jacob et al. 2022 showed how to adapt MCTS to produce slightly better move-matching performance. Maia-2 ( Tang et al. 2024 ) simplified Maia ’s approach with a unified model, introducing a skill-aware self-attention layer that tokenized the channels of the output of a stack of convolution layers. Allie ( Zhang et al. 2025 ) viewed this behavior replication task through the lens of language modeling, training a decoder-only transformer model on a move-based representation of the game trajectory to achieve state-of-the-art human move-matching. These human emulation methods were leveraged by Hamade et al. 2024 to investigate human-AI cooperation in chess. McIlroy-Young et al. 2021 demonstrated that individual human players can be reliably identified from just a few of their games, while McIlroy-Young et al. 2022 improved

Read the complete text