GAMEBoT: Transparent Assessment of LLM Reasoning in Games

Wenye Lin, Jonathan Roberts, Yunhan YangSamuel Albanie, Zongqing Lu, Kai Han · 2024

Read GAMEBoT: Transparent Assessment of LLM Reasoning in Games by Wenye Lin, Jonathan Roberts, Yunhan YangSamuel Albanie, Zongqing Lu, Kai Han (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13602.txt.

Introduction

Wenye Lin and colleagues built GAMEBoT in 2024, an arena for testing how well large language models actually reason. Existing reasoning benchmarks are hard to interpret, quickly saturate, or risk leaking into training data. Games offer a cleaner testbed, because strong play demands planning that can be checked step by step against the rules.

GAMEBoT breaks the reasoning inside games into predefined modular subproblems. For each subproblem the designers wrote chain-of-thought prompts that feed the model the relevant domain knowledge before it chooses an action, and rule-based algorithms that compute the correct answer for every subproblem. That makes it possible to grade not only the final moves but the intermediate reasoning itself. The setup also reduces contamination risk, giving a transparent way to compare models' reasoning quality.

Catalog record

CREATORWenye Lin, Jonathan Roberts, Yunhan YangSamuel Albanie, Zongqing Lu, Kai Han
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE102 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-13602

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GAMEBoT: Transparent Assessment of LLM Reasoning in Games Wenye Lin, Jonathan Roberts, Yunhan YangSamuel Albanie, Zongqing Lu, Kai Han Abstract Large Language Models (LLMs) are increasingly deployed in real-world applications that demand complex reasoning. To track progress, robust benchmarks are required to evaluate their capabilities beyond superficial pattern recognition. However, current LLM reasoning benchmarks often face challenges such as insufficient interpretability, performance saturation or data contamination. To address these challenges, we introduce GAMEBoT ( GAME B attle o f T actics), a gaming arena designed for rigorous and transparent assessment of LLM reasoning capabilities. GAMEBoT decomposes complex reasoning in games into predefined modular subproblems. This decomposition allows us to design a suite of Chain-of-Thought (CoT) prompts that leverage domain knowledge to guide LLMs in addressing these subproblems before action selection. Furthermore, we develop a suite of rule-based algorithms to generate ground truth for these subproblems, enabling rigorous validation of the LLMs’ intermediate reasoning steps. This approach facilitates evaluation of both the quality of final actions and the accuracy of the underlying reasoning process. GAMEBoT also naturally alleviates the risk of data contamination through dynamic games and head-to-head LLM competitions. We benchmark 17 prominent LLMs across eight games, encompassing various strategic abilities and game characteristics. Our results suggest that GAMEBoT presents a significant challenge, even when LLMs are provided with detailed CoT prompts. Project page: https://visual-ai.github.io/gamebot 1 Introduction LLMs have demonstrated remarkable capabilities across a diverse range of tasks, including translation, question answering, and coding ( Achiam et al., 2023 ; Reid et al., 2024 ; Anthropic, 2024a ) . This burgeoning proficiency has fueled their rapid integration into real-world AI-assisted applications, necessitating robust benchmarks for evaluating their reasoning abilities. Existing efforts have focused on creating benchmarks that move beyond superficial pattern recognition and delve into the profound reasoning skills required for problem-solving. For instance, GSM8K ( Cobbe et al., 2021 ) and MATH ( Hendrycks et al., 2021 ) target mathematical reasoning, HumanEval ( Chen et al., 2021 ) and MBPP ( Austin et al., 2021 ) assess code generation abilities, and StrategyQA ( Geva et al., 2021 ) focuses on multi-hop reasoning. Figure 1: Overall evaluation framework of GAMEBoT . The framework comprises three key components: (1) diverse game environments; (2) curated CoT prompts to elicit complex reasoning; (3) rule-based algorithms for verifying the intermediate results. We also develop a visualization module for tracking the gameplay (Refer to Appendix F ). During a competition, the selected game environment (left) dynamically generates the current game state. Two competing LLMs are then presented with CoT prompts (right), requiring them to leverage human expert knowledge to answer all subproblems before choosing the action. Rule-based algorithms subsequently generate ground truth and verify the LLMs’ responses to these subproblems, enabling rigorous performance evaluation. Despite their widespread utility, these established benchmarks are confronted by two challenges: performance saturation and data contamination. First, performance saturation hinders the ability to differentiate top-performing models. For instance, Qwen2-Math-72B-Instruct achieves 96.7% accuracy on GSM8k, leaving minimal room for further improvement. Second, the static nature of these datasets increases the risk of data contamination. As LLMs are pre-trained on massive web-scale corpora, they may inadvertently encounter and memorize test instances from these benchmarks. LLMs are thus potentially achieving inflated performance scores, undermining the validity to assess genuine reasoning abilities. Recently, strategic gaming has emerged as a valuable testbed, offering more challenging and dynamic environments with clear objectives for evaluating LLMs. Existing work ( Liu et al., 2023 ; Huang et al., 2024 ; Duan et al., 2024b ; Chalamalasetti et al., 2023 ; Chen et al., 2024 ; Wu et al., 2023 ) leveraging this paradigm can thus utilize metrics like win rate or game score to assess performance. However, a natural question arises: are LLMs winning the game because they truly understand the game logic and strategy? For instance, an LLM might produce nonsensical reasoning yet select the correct action, leading to a fortuitous victory. Reliance solely on game outcomes as a performance measure limits the interpretability and robustness of these benchmarks. Furthermore, only evaluating the final outcomes—the culmination of many individual decisions—neglects the rich information embedded within each step of the game. Therefore, a comprehensive assessment of LLM capabilities in strategic environments necessitates evaluating not only the ultimate outcome but also the intermediate reasoning processes underpinning each action. In this paper, we introduce GAMEBoT , a benchmark for evaluating LLMs in competitive gaming environments (Shown in Figure 1 ). We develop a whole suite including (1) diverse game environments; (2) curated CoT prompts to elicit complex reasoning; (3) rule-based algorithms for verifying the intermediate results. We also develop a visualization module for tracking the gameplay. GAMEBoT decomposes complex game decisions into modular subproblems, each addressing a distinct factor relevant to the decision-making process. Rather than relying on generic “think step by step” prompting ( Wei et al., 2022 ; Kojima et al., 2022 ) , we employ strategically-guided CoT prompts infused with domain knowledge, eliciting explicit intermediate reasoning steps alongside final actions. LLMs are required to summarize the answers to every subproblems in the format “[Intermediate Thinking Result: XXX]”. This allows automated validation against the ground truth generated by programmatic solvers, enabling fine-grained analysis beyond win/loss rates. In this way, GAMEBoT provides valuable interpretability, necessitating genuine understanding of game logic and strategy for an LLM to achieve victory, thus minimizing the impact of fortuitous outcomes. To comprehensively assess LLMs, GAMEBoT includes 8 games spanning four distinct categories: board games (e.g., Othello, Checkers, TicTacToe, Connect4), action games (e.g., Pong, Surround), card games (e.g., Texas Hold’em), and games in game theory (e.g., Negotiation v2) . These games are selected to target distinct strategic abilities and encompass diverse game characteristics: zero-sum vs. non-zero-sum ; perfect information vs. imperfect information ; and turn-based vs. simultaneous move . Introduction to games can be found in Appendix C . This diverse collection requires LLMs to demonstrate a wide range of cognitive abilities, including spatial reasoning, strategic collaboration and competition, mathematical equation solving, information extraction, risk management, and pattern recognition. Games Game Properties Representative Abilites Avg. Turns Action Space State Space Type Information Simul. Zero-sum Othello Board Game Perfect No Yes Spatial Reasoning 63 64 10^{28} Pong Action Game Perfect Yes Yes Mathematical Reasoning 144 3 3^{300} Surround Action Game Imperfect Yes Yes Long-Term Path Planning 84 4 4^{400} Checkers Board Game Perfect No Yes Spatial Reasoning 76 144 10^{18} TicTacToe Board Game Perfect No Yes Pattern Recognition 7 9 5478 Connect4 Board Game Perfect No Yes Pattern Recognition 19 7 10^{12} Texas hold’em Card Game Imperfect No Yes Risk Management 9 5 10^{25} Negotiation v2 Game Theoretic Imperfect No No Competitive Collaboration 8 105 10^{20} Table 1: Eight games for evaluation. This benchmark incorporates 4 game types with distinct properties to provide a broad coverage of LLM reasoning skills. To ensure a large state space, we make a slight modification to Negotiation ( Lewis et al., 2017 ) (See the detail in Appendix B ). Despite the relatively small state space of TicTacToe, LLMs still surprisingly struggle to perform well on this seemingly simple game (Refer to Section 3.1.2 ). ‘Simul.’ is the abbreviation for simultaneous. ‘Info. Extract’ is the abbreviation for Information Extraction. We

Read the complete text