Does Reasoning Help LLM Agents Play Dungeons and Dragons? A Prompt Engineering Experiment
Patricia Delafuente, Arya Honraopatil, Lara J. Martin · 2025
Read Does Reasoning Help LLM Agents Play Dungeons and Dragons? A Prompt Engineering Experiment by Patricia Delafuente, Arya Honraopatil, Lara J. Martin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18112.txt.
Introduction
Patricia Delafuente, Arya Honraopatil, and Lara J Martin test whether reasoning models play Dungeons and Dragons better than plain instruct models. The task is to predict what a player does next and write it as a bot command for the Avrae system on Discord. Two mid-size open models face each other on a public game data set.
Clear, specific instructions mattered more than model type, and one changed sentence could swing the output a lot. The instruct model proved sufficient for the job against the reasoning model. Game tool builders get a useful lesson: prompt wording can beat a fancier model.
Catalog record
| CREATOR | Patricia Delafuente, Arya Honraopatil, Lara J. Martin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18112
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Does Reasoning Help LLM Agents Play Dungeons and Dragons? A Prompt Engineering Experiment Patricia Delafuente, Arya Honraopatil, Lara J. Martin Abstract This paper explores the application of Large Language Models (LLMs) and reasoning to predict Dungeons & Dragons (DnD) player actions and format them as Avrae Discord bot commands. Using the FIREBALL dataset, we evaluated a reasoning model, DeepSeek-R1-Distill-LLaMA-8B, and an instruct model, LLaMA-3.1-8B-Instruct, for command generation. Our findings highlight the importance of providing specific instructions to models, that even single sentence changes in prompts can greatly affect the output of models, and that instruct models are sufficient for this task compared to reasoning models. 1 Introduction Dungeons & Dragons (DnD) is a cooperative role-playing game where players create unique characters that embark on exciting adventures in a fantasy world. One player takes on the role of the Dungeon Master (DM), a special role to narrate the game, guide the story, and control non-player characters. The players interact with the DM and each other using natural language, often describing their intended actions . The open-ended gameplay of DnD makes it an interesting and rich environment to test and challenge large language models (LLMs) Martin et al. 2018 ; Callison-Burch et al. 2022 . LLMs have shown to help with text generation within the space of DnD, either helping players with the game commands and narration Callison-Burch et al. 2022 , game design Liang et al. 2024 or helping solve game tasks Song et al. 2024 . For an AI system to play DnD effectively, it needs strong language understanding, along with the ability to learn and represent knowledge, track game states, and reason over decisions Callison-Burch et al. 2022 . Thanks to reasoning mechanics, LLMs have recently undergone a tremendous transformation in their capacity to solve more complex problems. Reasoning LLMs such as Deepseek R1 DeepSeek-AI et al. 2025 are finetuned models that perform chain-of-thought (CoT) reasoning Wei et al. 2022 iteratively. These models have evolved LLMs from token-level prediction to systems capable of multi-step thought—improving performance in arithmetic, logic and common sense reasoning tasks Shao et al. 2024 . In this paper, we explore the impact of prompt design on reasoning and instruction-tuned LLMs for predicting the generation of structured actions for players in the game of DnD. This work focuses on the generation of actions during combat, such as an attack on a non-player character or monster using an available weapon in the player’s inventory. This work is a stepping stone for future work on using LLMs to predict a recommended action for the current player at any point in the game. Specifically, we look at the capabilities of both types of LLMs for generating commands for the Avrae Discord bot. Avrae is a bot that enables players to play DnD virtually by allowing them to use commands to perform in-game actions, like rolling dice or casting spells, all while tracking the state of entities in the game world. The LLM is instructed to generate the recommended attack and applicable attributes such as the weapon and target as a structured Avrae command. In Avrae, if, for example, Fangling is a character who wants to attack a target with one of their available weapons such as a 2-Handed Longsword , an expected Avrae command would be !a 2-Hand . Avrae has been used in the past to look at how well LLMs can translate natural language narration to the structured representation needed to run Avrae and vice versa Papazov et al. 2022 ; Zhu et al. 2023 . We are extending this work by exploring whether this can be considered a “reasoning” problem appropriate for reasoning LLMs. This paper addresses the following questions: 1. Is reasoning an effective technique for generating game actions given a game state? 2. What types of prompting techniques make reasoning or instruct models better or worse for this task? Generating gameplay commands using LLMs helps models learn structured natural language grounding, intent recognition, and world-state reasoning. These skills can advance interactive storytelling by enabling more coherent, context-aware, and character-consistent narrative systems and game automation. 2 Related Work 2.1 Reasoning Models Early models used token prediction for knowledge retrieval but were limited in their ability to solve complex tasks Rae et al. 2021 . The transition towards reasoning began with Chain-of-Thought (CoT) prompting Wei et al. 2022 , which showed that LLMs could generate more accurate solutions by prompting the model to "think step by step". Building on this, Wang et al. 2023 , showed that sampling multiple reasoning paths and aggregating them yielded more reliable answers. Other approaches like Least-to-Most prompting Zhou et al. 2023 re-framed complex problems into simpler sub-problems, solved sequentially, and methods such as Tree-of-Thoughts Yao et al. 2023 and Graph-of-Thoughts Besta et al. 2024 formalize reasoning as an explicit exploration over possible inference paths. Modern reasoning models like OpenAI’s o1 & o3 and DeepSeek’s DeepSeek-R1 incorporate reinforcement learning and adaptive computation to allow for additional "thinking time" for complex queries OpenAI et al. 2024 ; DeepSeek-AI et al. 2025 . Reasoning models extend the CoT paradigm by fine-tuning the models so that they generate their reasoning automatically without being explicitly prompted to do so. Although reasoning models have shown improvements in performance on some tasks Shojaee et al. 2025 , it is still unknown what types of tasks they are well suited for, which inspires this work. As the complexity of the problem increases, the reasoning effort declines past a certain point and the performance of the model falls Shojaee et al. 2025 . 2.2 LLMs for DnD LLMs have played a crucial role in the development of interactive agents and text-based games Shuster et al. 2022 ; Ammanabrolu and Riedl 2021 ; Urbanek et al. 2019 . Early work on DnD by Zhu et al. 2023 showed that LLMs, such as GPT-3, can map natural language play descriptions to executable Avrae commands with moderate accuracy. We build on the work of Zhu et al. 2023 to demonstrate if reasoning models are required to automate command generation or if decoder models are sufficient for the task. Others have used LLMs to generate DnD components, such as spells Musacchio et al. 2024 . In their work, Musacchio et al. 2024 state that LLMs (such as GPT-2, OPT, LLaMA-2) were able to produce diverse and imaginative spell descriptions but often struggled with consistency, balance, and mechanical validity, thus underscoring the need for reasoning-oriented approaches for structured rule constraints. Similarly to Callison-Burch et al. 2022 , we use game state information to add context to the LLM prompt. However, instead of generating dialog, we are generating a character’s next action. 3 Experimental Setup We look at the task of generating game action commands for the DnD Discord bot Avrae. To answer our research questions (§ 1 ), we compare the output of two models – an instruct model and a reasoning model, both fine-tuned from the same original model (LLaMA-3.1-8B). To compare the two models, we performed a prompt engineering experiment with qualitative analysis and then compared the generated commands across the models and prompts using quantitative results. We explain the prompt engineering experiment in Section 4 and the quantitative measures in Section