Boardwalk: Towards a Framework for Creating Board Games with LLMs

Álvaro Guglielmin Becker 1, Gabriel Bauer de Oliveira 1 · 2025

Read Boardwalk: Towards a Framework for Creating Board Games with LLMs by Álvaro Guglielmin Becker 1, Gabriel Bauer de Oliveira 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16447.txt.

Introduction

Álvaro Guglielmin Becker and Gabriel Bauer de Oliveira tested in 2025 whether large language models can write working board game software from written rules. Coding a board game by hand is slow, and language models have shown skill at code generation for narrow tasks. A framework that turns plain-language rules into playable games would speed up prototyping considerably.

The authors asked three leading models to implement a dozen popular and obscure games, both freely and inside Boardwalk, their proposed general game playing framework. Game names and parts were disguised so models could not lean on memorized knowledge. Programs were scored for playability and rule compliance. The approach proved viable: the best model produced over half the games with no errors at all, and the study catalogs success rates and the common mistakes each model made.

Catalog record

CREATORÁlvaro Guglielmin Becker 1, Gabriel Bauer de Oliveira 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16447

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Boardwalk: Towards a Framework for Creating Board Games with LLMs Álvaro Guglielmin Becker 1, Gabriel Bauer de Oliveira 1 Abstract Introduction : Implementing board games in code can be a time-consuming task. However, Large Language Models (LLMs) have been proven effective at generating code for domain-specific tasks with simple contextual information. Objective: We aim to investigate whether LLMs can implement digital versions of board games from rules described in natural language. This would be a step towards an LLM-assisted framework for quick board game code generation. We expect to determine the main challenges for LLMs to implement the board games, and how different approaches and models compare to one another. Methodology : We task three state-of-the-art LLMs (Claude, DeepSeek and ChatGPT) with coding a selection of 12 popular and obscure games in free-form and within Boardwalk, our proposed General Game Playing API. We anonymize the games and components to avoid evoking pre-trained LLM knowledge. The implementations are tested for playability and rule compliance. We evaluate success rate and common errors across LLMs and game popularity. Results: Our approach proves viable, with the best performing model, Claude 3.7 Sonnet, yielding 55.6% of games without any errors. While compliance with the API increases error frequency, the severity of errors is more significantly dependent on the LLM. We outline future steps for creating a framework to integrate this process, making the elaboration of board games more accessible. Keywords Board games, Large Language Models, Procedural Content Generation 1 Introduction Board games are an important object of study in the field of Artificial Intelligence (AI), with many works concerning themselves with developing algorithms for playing or modifying games [ Browne 2011 , Todd et al. 2024 ] . However, in order for such studies to be conducted, they first require the researchers to represent the game they’re studying in code. This can be a time-consuming task, especially for games of higher complexity with various different pieces and edge cases to consider. For this reason, several Game Description Languages (GDLs), such as Ludii [ Piette et al. 2020 ] , have been developed; these are domain-specific languages meant to facilitate the implementation and analysis of digital board games, by providing direct commands for defining the components and rules of such games. However, creating game descriptions with GDLs still requires knowledge of the language’s own syntax, which sometimes requires convoluted constructions for simple operations of specific games 1 1 1 For example, Ultimate Tic-Tac-Toe in Ludii’s GDL has 9 levels of nested tests to check move validity [ Ludii Portal 2020 ] . . Therefore, Large Language Models (LLMs) present themselves as highly appealing tools to aid in this task. Modern LLMs have shown great performance in code generation tasks [ Coignion et al. 2024 ] , adding significant efficiency to code-dependent workflows. One particularly interesting aspect of LLMs is their capacity for In-Context Learning (ICL), being able to perform tasks they had not been trained for simply from receiving additional information pertaining to those tasks as part of the prompt [ Brown et al. 2020 ] . In this work, we aim to answer the following research question: can LLMs implement digital versions of board games from rules described in natural language? To answer the question, we ask state-of-the-art LLMs (DeepSeekV3, Claude 3.7 Sonnet, and ChatGPT-4o) to code a selection of 12 games in Python, both in free-form and within Boardwalk, a standardized API we provide. We also request the LLMs to adapt their free-form implementations to the API. The games and their components are anonymized to evaluate the LLMs’ understanding of rules in natural language rather than evoking code associated with such names in pre-training data. Furthermore, 6 of the 12 games are rather obscure, such that it is even less likely that the LLMs evoke pre-training code associated with their rules. The resulting game implementations are tested for playability and rule compliance. We enumerate common errors across games and LLMs to better understand their relations. Our main findings are that LLMs are largely capable of implementing games from rule descriptions, both free-form and using the API, and that Claude is the best-performing of the evaluated models. Our main contributions can be summarized as follows: • A broad evaluation of LLM capabilities on generating digital versions of board games from rules in natural language; • Boardwalk, a standardized API for General Game Playing, easing the integration of game implementations and game-playing AIs. The API aims for simplicity by allowing the game definition in Python rather than a Game Description Language with its own learning curve. Boardwalk code is open-sourced at https://github.com/LabCRAIG/boardwalk . The remainder of this paper is organized as follows: Section 2 presents related work. Section 3 introduces the Boardwalk API. Section 4 details our evaluation methodology. Section 5 presents quantitative results of the error rates of each model and game, as well as a qualitative analysis of specific errors and recurring challenges observed. Finally, Section 6 summarizes our findings and outlines possible future work towards an AI-powered board game generation framework. 2 Related Work Most existing studies in LLM-oriented procedural content generation for games are centered on video games. [ Todd et al. 2023 ] were able to train LLMs to create novel and functional Sokoban levels. [ Sudhakaran et al. 2023 ] were able to fine-tune GPT2 to create Super Mario Bros levels with custom features defined by natural language prompts. LLMs have also been used to tell interactive narratives in games [ Sun et al. 2023 , Kumaran et al. 2023 ] . All of these focused on creating content for otherwise human-implemented games. Using a video game description language, [ Hu et al. 2024 ] had LLMs generate both rules and levels for maze-based games. They found that the models required context-rich prompts for optimal performance and faced greater challenges with the logical aspects of game design compared to the syntax of the language. [ Browne 2011 ] reports the seemingly first automated system to generate a commercial board game from scratch 2 2 2 Yavalath: https://boardgamegeek.com/boardgame/33767/yavalath . It uses evolutionary algorithms to evolve game rules on the Ludi (with one ‘i’) Game Description Language (GDL), combined with automated playtesting with general game playing (GGP) [ Genesereth et al. 2005 ] algorithms. However, the Ludi framework is not available for further experimentation. The second version of Ludii (now with two ‘i’) GDL [ Piette et al. 2020 ] , had an initial focus on game archaeology and not on automated game creation. However, recent work has managed to use Ludii in automated board game creation. For example, [ Todd et al. 2024 ] fine-tuned an LLM in the Ludii GDL. Using a fill-in-the-middle approach, the authors removed parts of pre-existing game descriptions and tasked the LLM with completing them, generating potentially different rules, without having to create new games from scratch. However, generated rules often contained introns, i.e. elements that were never used in gameplay. [ Tanaka and Simo-Serra 2024 ] used ICL to generate Ludii implementations from natural language rule descriptions. However, due to the complexity of the Ludii grammar, they followed a process for each game of iteratively finding a minimal valid subgrammar to describe the game, and

Read the complete text