Merge and Conquer: Evolutionarily Optimizing AI for 2048
Maggie Bai, Ava Kim Cohen, Eleanor Koss, Charlie Lichtenbaum · 2025
Read Merge and Conquer: Evolutionarily Optimizing AI for 2048 by Maggie Bai, Ava Kim Cohen, Eleanor Koss, Charlie Lichtenbaum (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20205.txt.
Introduction
Maggie Bai and three co-authors test evolutionary ways to train an artificial intelligence player for the sliding tile game 2048. The game mixes careful planning with random tile arrivals, which makes it a useful testbed for decision making under uncertainty. Two systems are compared: a two-agent setup where one language model refines strategy prompts for another that plays, and a single-agent setup that refines a value function for limited search.
The single-agent system improves steadily, gaining on average more than four hundred points per training cycle with a clear upward trend, and its strategies grow more advanced over time. The two-agent system gains little, which the authors read as a limit of meta-prompting. Rollback features were also tried to guard against declines.
Catalog record
| CREATOR | Maggie Bai, Ava Kim Cohen, Eleanor Koss, Charlie Lichtenbaum |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20205
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Merge and Conquer: Evolutionarily Optimizing AI for 2048 Maggie Bai, Ava Kim Cohen, Eleanor Koss, Charlie Lichtenbaum Abstract Optimizing artificial intelligence (AI) for dynamic environments remains a fundamental challenge in machine learning research. In this paper, we examine evolutionary training methods for optimizing AI to solve the game 2048, a 2D sliding puzzle. 2048, with its mix of strategic gameplay and stochastic elements, presents an ideal playground for studying decision-making, long-term planning, and dynamic adaptation. We implemented two distinct systems: a two-agent metaprompting system where a “thinker" large language model (LLM) agent refines gameplay strategies for an “executor" LLM agent, and a single-agent system based on refining a value function for a limited Monte Carlo Tree Search. We also experimented with rollback features to avoid performance degradation. Our results demonstrate the potential of evolutionary refinement techniques in improving AI performance in non-deterministic environments. The single-agent system achieved substantial improvements, with an average increase of 473.2 points per cycle, and with clear upward trends (correlation ρ \rho =0.607) across training cycles. The LLM’s understanding of the game grew as well, shown in its development of increasingly advanced strategies. Conversely, the two-agent system did not garner much improvement, highlighting the inherent limits of meta-prompting. 1 Introduction 2048, a simple 2D sliding game, has gained immense popularity due to its engaging gameplay and deceptively complex strategy despite its simple mechanics. The game involves sliding numbered tiles on a 4×4 grid, merging same-value tiles with the ultimate goal of creating a tile with the value of 2048. While players control the movement of the tiles, new tiles appear randomly each move with values of 2 (90% of the time) or 4 (10% of the time), meaning that players must constantly adapt. This unpredictability means that optimal play requires both probabilistic reasoning and adaptability. LLMs have demonstrated remarkable abilities across a variety of reasoning and comprehension tasks. However, their aptitude for solving complex, strategic environments (such as chess, Go, or poker) is limited when no task-specific finetuning or guidance is provided [ 8 ] . This limitation prompts important questions about the nature of "improvement" in AI systems. Since reaching 2048 requires significant depth and complexity in strategy, the game is a rich environment for studying machine-learning challenges in optimization and decision-making algorithms. Games are also long, requiring hundreds of moves to reach 2048, forcing any solver to use a reliable, reproducible strategy instead of relying on luck. Over the years, researchers have applied traditional ML techniques such as expectimax, minimax, and deep reinforcement learning to explore optimal play in 2048 [ 1 ] [ 4 ] . In this paper, we investigate evolutionary training methods for optimizing AI to solve the game of 2048. We present two distinct systems: (1) a two-agent “metaprompting” framework, where a “thinker” LLM refines gameplay strategies for an “executor” LLM, and (2) a single-agent system that refines a value function for a limited Monte Carlo Tree Search. Crucially, our approach uses closed-source base models without fine-tuning or RL, thereby probing the extent to which purely prompt-based iterative improvement can enhance an LLM’s decision-making. Our results show that the single-agent system achieved substantial gains, with an average increase of 473.2 points per training cycle and a strong positive correlation ( \rho =0.607) indicating consistent upward improvement. We further observe that the LLM’s strategic reasoning evolved over time, developing increasingly sophisticated gameplay tactics. Conversely, the two-agent system did not demonstrate significant gains, illustrating important limits of meta-prompting for self-refinement. By comparing these two evolutionary approaches, we shed light on the trade-offs and constraints of self-improvement methods when neither fine-tuning nor traditional RL is available. 2 Related Works The intersection of artificial intelligence (AI) and game-play optimization has spurred advancements in decision-making algorithms [ 6 ] [ 7 ] . Within them, there are contributions in AI optimization for the game of 2048, the application of Monte-Carlo Tree Search (MCTS), iterative training with rollback, and AI for games. 2.1 Monte Carlo Tree Search Monte Carlo Tree Search (MCTS) has been extensively used in optimizing strategies for games that require sequential planning. This balance has positioned MCTS as a widely used technique in areas such as board games, video games, and decision making under uncertainty. Recent advancements have further enhanced MCTS by integrating deep learning techniques, enabling improved generalization and adaptation to complex scenarios. 2.2 Iterative Training Iterative training methods, particularly those combining optimization and regression prevention, can be used to directly improve LLM performance without human grading or input. One famous example of this is from 2017, when Silver et al. introduced AlphaGo Zero [ 6 ] , a reinforcement learning framework that achieved superhuman performance in the game of Go using iterative self-play and continuous optimization. Unlike its predecessor, AlphaGo, which relied on human expert games for initial training, AlphaGo Zero started with randomly initialized parameters and improved solely through self-play. Further, it uses a single neural network as well as a tree search to evaluate positions and moves without executing any Monte Carlo rollouts. This was done through a reinforcement learning program that resulted in significant improvements [ 6 ] . Similarly, AlphaEvolve was recently presented in June 2025, where Novikov et al. [ 5 ] used a combination of evolutionary computation and LLM-based coding. AlphaEvolve is an autonomous system that employs a system of LLMs to directly modify and improve on algorithms. Through an evolutionary process, it incorporates continuous feedback from one or more evaluators to progressively improve performance. This approach was described to have the potential to drive both scientific breakthroughs and practical advancements. To demonstrate its broad applicability, they applied AlphaEvolve to various critical computational challenges, and it outperformed current solutions for problems in math and computer science [ 5 ] . Another evolutionary training approach, the Darwin Gödel Machine (DGM), builds self-improving AI. DGMs use foundation models to propose it’s own agentic code improvements. Experiments demonstrate that DGMs improve their performance as more computational resources are allocated [ 9 ] . The conceptual underpinnings of AlphaEvolve and DGM raise the question of what method of self-improvement is the most effective and reliable way for a model to improve itself while keeping the base model unchanged. Thus, in this paper, we explore iterative methodologies to evaluate the comparative performance of two evolutionary frameworks in controlled environments emphasizing strategy, decision-making, and optimization under uncertainty. By examining the strengths and weaknesses of metaprompting and code-based refinement, we aim to identify which evolutionary strategy yields better outcomes in terms of adaptability and reliability. 2.3 AI Optimization for 2048 The game of 2048 is an effective benchmark for AI due to its combination of deterministic mechanics and random tile generation, presenting challenges in long-term planning. Traditional methods for solving 2048 often rely on heuristic-based techniques. As an example, Kohler et al. [ 3 ] in 2019 tested the efficacy of basic heuristics in a 2048 solver. They designed a system that starts with a set of predefined heuristic evaluation functions, created new compositions of these functions based on guidelines, and then evaluated them by running a number of games. Ultimately, they found that value functions that maximize empty spaces and monotonicity of tiles perform the most optimally out of other compositions.