UrzaGPT : LoRA-Tuned Large Language Models for Card Selection in Collectible Card Games
Timo Bertram · 2025
Read UrzaGPT : LoRA-Tuned Large Language Models for Card Selection in Collectible Card Games by Timo Bertram (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08382.txt.
Introduction
Timo Bertram, writing alone, adapts a language model to pick cards in a collectible card game in this 2025 paper. Such games are hard for AI, because players cannot see all cards, must plan far ahead, and face card sets that keep growing. The task here is drafting, choosing cards in real time to build a deck in Magic: The Gathering.
Starting from an open model, Bertram fine-tunes it on 10,000 steps of annotated draft records using a light method. Small untuned models could not draft at all, while a large commercial model scored 43 percent with no tuning. The tuned model reached 66.2 percent accuracy. It still trails models built just for this game.
Catalog record
| CREATOR | Timo Bertram |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08382
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UrzaGPT : LoRA-Tuned Large Language Models for Card Selection in Collectible Card Games Timo Bertram Abstract Collectible card games (CCGs) are a difficult genre for AI due to their partial observability, long-term decision-making, and evolving card sets. Due to this, current AI models perform vastly worse than human players at CCG tasks such as deckbuilding and gameplay. In this work, we introduce UrzaGPT , a domain-adapted large language model that recommends real-time drafting decisions in Magic: The Gathering . Starting from an open-weight LLM, we use Low-Rank Adaptation fine-tuning on a dataset of annotated draft logs. With this, we leverage the language modeling capabilities of LLM, and can quickly adapt to different expansions of the game. We benchmark UrzaGPT in comparison to zero-shot LLMs and the state-of-the-art domain-specific model. Untuned, small LLMs like Llama-3-8B are completely unable to draft, but the larger GPT-4o achieves a zero-shot performance of 43%. Using UrzaGPT to fine-tune smaller models, we achieve an accuracy of 66.2% using only 10,000 steps. Despite this not reaching the capability of domain-specific models, we show that solely using LLMs to draft is possible and conclude that using LLMs can enable performant, general, and update-friendly drafting AIs in the future. Institute for Machine Learning Johannes Kepler University Linz, Austria [email protected] 1 Introduction For decades, novel developments in artificial intelligence have been tested on games. Games provide structure, and games allow for easy comparison, but games can also be incredibly difficult. In the past, abstract board games were the prime target for AI ( Brown and Sandholm 2019 ; Silver et al. 2018 ) . More recently, video games and strategy games also have been explored as test environments ( Vinyals et al. 2019 ; OpenAI et al. 2019 ) . Modern games are varied in their rules, which can even change in expansions or updates. Video games require many actions per second, fine-grained control, and efficient image processing ( Pearce and Zhu 2022 ; Vinyals et al. 2019 ) . Strategy games often require language processing and long-horizon planning ( Hoover et al. 2020 ) . Despite AI having achieved expert-level or even superhuman performance in games like chess and Go ( Schaeffer et al. 2007 ; Schrittwieser et al. 2020 ) , only weak game agents exist for many contemporary games. Collectible card games (CCGs) are one of those genres for which currently, no agents exist that perform on the level of human experts. The recent explosion of language modelling due to transformers ( Vaswani et al. 2017 ) and large-scale pre-training ( Radford and Narasimhan 2018 ) may provide a solution for this. Large Language Models (LLMs) compress a vast amount of information into one model and thus learn about games and strategy. LLMs are inherently language-based, which makes it simple to describe rules and abilities. This is especially crucial for CCGs, where a large part of their complexity comes from the natural language used to describe the functions of cards (see Figure 1 ). In this work, we introduce UrzaGPT , a domain-adapted LLM for drafting Magic: The Gathering , and explore its utility. Specifically, we contribute the following: • An evaluation of the zero-shot drafting performance of popular LLMs. • We fine-tune LLMs to drafting Magic: The Gathering and show how models can quickly be adapted to this domain. • An ablation on the impact of fine-tuning parameters on the performance. We begin by discussing related work (Section 2 ) and briefly explaining the most critical game concepts (Section 3 ) before outlining the specifics of our method in Section 4 and discussing the results in Section 7 . All code will be released upon acceptance. Figure 1: Magic: The Gathering cards come in various levels of complexity, which makes it difficult to process them in a model. While it is straightforward to numerically represent the card on the left, representing the card on the right requires a semantic understanding of the game-specific language. Therefore, large language models are a natural fit to evaluate collectible cards. Figure 2: High-level overview of the UrzaGPT pipeline. Pack and deck information is extracted from the game, cards are transformed into a natural language representation, and an LLM is prompted with this information. The LLM responds with a single card name, which is fed back into the game environment to take an action. 2 Related Work Artificial Intelligence in Competitive Games. In the past, artificial intelligence for games was often restricted to structured board and card games such as chess ( Silver et al. 2018 ; Campbell, Hoane, and Hsu 2002 ) , Go ( Silver et al. 2016 ; Silver et al. 2017 ) , checkers ( Schaeffer et al. 2007 ) , or poker ( Moravčík et al. 2017 ; Brown and Sandholm 2019 ) . This extended to faster, commercial games like Doom ( Lample and Chaplot 2017 ) , Starcraft II ( Vinyals et al. 2019 ) , Dota 2 ( OpenAI et al. 2019 ) , and Gran Turismo ( Wurman et al. 2022 ) . The majority of these use some variant of reinforcement learning to train from scratch, requiring no human data but fast simulation environments and a large amount of computation. The majority of agents are completely domain-specific, offering no way to adapt to a similar environment and require complete retraining on a new task. LLM-based GameAI. The recent advancements in natural language processing have led to a large interest in using language models as game agents ( Hu et al. 2025 ; Gallotta et al. 2024 ; Sweetser 2024 ; Yang, Kleinman, and Harteveld 2024 ) . Game environments have been used to benchmark LLM and VLM reasoning ( Paglieri et al. 2025 ; Costarelli et al. 2024 ) , and TextStarcraft II adapts the real-time strategy game into a text format for LLMs ( Ma et al. 2024 ) . Additionally, work in LLMs for games has tackled Pokémon ( Hu, Huang, and Liu 2024 ) , Slay the Spire ( Bateni and Whitehead 2024 ) , Werewolf ( Xu et al. 2024 ) , and Minecraft ( Zhu et al. 2023 ; Wang et al. 2024 ) . Despite all of this work, the performance of LLM-based agents is often subpar when not making further adjustments to their actions. For example, modern LLMs still fail to play TicTacToe perfectly, with the exact prompt used and model choice having a large influence ( Topsakal and Harper 2024 ) . In the BALROG benchmark, many models achieve some progress on the easier games, but more complicated environments like NetHack ( Küttler et al. 2020 ) are currently out of reach. Drafting and Deckbuilding in Collectible Card Games. Research on game agents for collectible card games is mostly focused on using reinforcement learning or genetic algorithms ( Dockhorn and Mostaghim 2019 ; Kowalski and Miernik 2023 ) . In both cases, heuristic agents are used to evaluate decks, while decks are either created sequentially ( E Silva Vieira, Rocha Tavares, and Chaimowicz 2023 ; Yang, Yeh, and Chiang 2021 ) or evolved ( Kowalski and Miernik 2020 ; García-Sánchez et al. 2016 ) . When a fast simulator exists, a playing policy