CogniPlay: a work-in-progress Human-like model for General Game Playing

Rautureau Aloïs, Piette Éric · 2025

Read CogniPlay: a work-in-progress Human-like model for General Game Playing by Rautureau Aloïs, Piette Éric (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05868.txt.

Introduction

Aloïs Rautureau and Éric Piette introduce CogniPlay, an early-stage model for game-playing agents that act more like people. Their progress report appeared in twenty twenty-five. Machines now match or beat humans at chess, Go, and Dota 2, yet they do not think the way humans do.

People decide in games by spotting patterns and following quick intuition. The authors review what cognitive psychology says about that style, and what earlier projects did to copy it. They then ask how those ideas fit general game playing, where one agent must face many unknown games. CogniPlay is their work-in-progress answer, built on those lessons. The report lays out the model and the thinking behind it.

Catalog record

CREATORRautureau Aloïs, Piette Éric
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05868

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CogniPlay: a work-in-progress Human-like model for General Game Playing Thanks: GameTable COST CA22145 Action Rautureau Aloïs, Piette Éric Abstract While AI systems have equaled or surpassed human performance in a wide variety of games such as Chess, Go, or Dota 2, describing these systems as truly "human-like" remains far-fetched. Despite their success, they fail to replicate the pattern-based, intuitive decision-making processes observed in human cognition. This paper presents an overview of findings from cognitive psychology and previous efforts to model human-like behavior in artificial agents, discusses their applicability to General Game Playing (GGP) and introduces our work-in-progress model based on these observations: CogniPlay. I Introduction Although AI systems have surpassed human performance in games such as Chess [ 5 ] , Go [ 14 ] , and competitive games like Dota 2 [ 2 ] , describing them as "human-like" would be an overstatement. Despite their exceptional performance, these systems fail to accurately replicate the selective, pattern-based decision-making that characterizes human cognition [ 12 , 8 ] . Designing agents that model or mimic this behavior could have a wide range of applications. In online environments such as video games, human-like agents can replace disconnected players in multiplayer settings or enhance the realism of non-player characters (NPCs) [ 28 ] . The perceived human-likeness of an agent has also been recognized as a crucial factor in cooperative environments [ 6 ] , driving interest in such models within the field of Human-Robot Interaction (HRI) [ 40 ] . Beyond interactive applications, human-like agents can serve as experience gatherers, accumulating strategic insights that can later be distilled for human use. Unlike super-human agents, which often rely on strategies that disregard cognitive and memory limitations inherent to human cognition, human-like agents would offer replicable approaches, making their strategies more accessible for practical application. This work explores existing methods for developing human-like agents and examines their applicability to General Game Playing (GGP), a field that, to our knowledge, has not yet been studied from this perspective. GGP aims to create agents capable of playing games effectively using only a formal game description, with limited time for familiarization with the environment [ 17 ] . Adapting such methods for GGP would offer greater control over an agent’s strength and playstyle addressing a common issue with strong AI opponents—namely, the artificial tuning of difficulty through methods such as depth limiting or reduced search time. Such models would also enable the automatic generation of more believable game-playing data, benefiting tabletop game platforms and designers by automating playtesting for early prototypes. This last point would also be particularly valuable for reconstructing traditional games within the Ludii game-playing system [ 31 ] . It currently relies on Monte Carlo Tree Search (MCTS) [ 24 ] and expert iteration [ 1 ] to produce plausible gameplay data for partially recovered tabletop games [ 4 , 3 ] . While this approach has shown promise [ 9 ] , its plausibility could be enhanced by incorporating a model that considers psychological and cognitive factors, as well as diverse motivations beyond merely winning, to more accurately replicate human gameplay. In Section II , we expose key observations from psychology and cognitive science that outline features of human decision-making, as well as previous works applying these observations to various fields. This helps identify the gap between state-of-the-art game-playing agents and human players, which our work aims to fill, and motivate our model through past results. Section III introduces CogniPlay, our work-in-progress model for GGP, based on the Double-Process Theory of Cognition (DPTC), a chunk-based representation of the game state and a selective search algorithm. II Features of human decision-making Unlike machines, which process millions of board states per second and store large game trees in memory, humans are inherently limited in both memorization and processing speed. Our memorization of game states is optimized through a chunking mechanism [ 11 , 8 , 34 , 41 , 19 , 20 ] , grouping related pieces—connected by attack, defense, spatial proximity, or similarity in color or type—as a single perceptual unit. Levinson and Snyder successfully implemented this approach in the MORPH Chess engine [ 25 ] . They represent board states as graphs of attack-defend relationships between pieces, deriving patterns from graph cuts associated to learned estimations of their Minimax evaluation. Despite being weaker than GnuChess (rated 1600 Elo), MORPH’s learning rate and playstyle were described as promising. A major challenge of their approach was combining multiple pattern weights. Models able to learn non-linear functions, such as Deep Neural Networks (DNNs) have been applied to Connect-4 [ 26 ] , incorporating spatial-locality and a pattern-based representation. Atomic patterns derived from game rules are grouped into overlapping spatial frames, each processed by a shared-weight neural network. The outputs are then combined in a final hidden layer, generating a policy that significantly outperformed classical architectures in predicting optimal moves without search. As a result of our low memorization capabilities, we were also found to perform shallow searches, plateauing an average depth of 4.8 to 5.3 plies for expert Chess players ( \simeq 2000 Elo) [ 11 , 7 , 18 ] . These searches are also highly selective, as human players prune a large chunk of the game tree intuitively instead of exploring it exhaustively [ 11 ] . This aligns with Kahneman’s Double-Process Theory of Cognition (DPTC) [ 23 ] . This theory posits that humans employ two different and co-dependent processes of thinking: • System 1 (intuitive brain) is fast, biased, based on intuition and the recognition of memorized patterns. • System 2 (analytical brain) is slow, based on logical inference. The interaction between these systems explains key aspects of human decision-making. In familiar situations—like responding to known Chess openings—, System 1 provides immediate responses. For novel situations, System 1 triggers System 2 for deeper analysis. This analysis is then gradually internalized by the intuitive brain. Importantly, once internalized, patterns become difficult to override, a mechanism that plays a key role in explaining cognitive biases in human decision-making. Efforts to adapt tree search algorithms like Minimax [ 35 ] and MCTS [ 24 ] to better reflect this aspect of human cognition typically incorporate a policy heuristic—often a neural network—to direct a tree search algorithm. We refer to these approaches as focused search algorithms. One such adaptation is focused Minimax search [ 29 ] , where a neural network is used to discard a subset of actions at each depth of the search. In experiments using Othello, focused Minimax was found to outperform full-width search, but no comments were made on the resulting agent’s playing style. A similar idea was applied by He et al. [ 21 ] to improve proactivity in Large Language Model (LLM) conversational agents. Their approach, explicitly based on DPTC, combines a small language model for policy evaluation with an MCTS-based search. Experimental results, including both quantitative metrics and human feedback, showed their system outperforming a competitive policy planner for conversational agents, Plug-and-Play Dialogue Policy Planner (PPDPP) [ 15 ] , across three proactive conversation datasets. Focused search and pattern-based approaches can be extended to GGP agents using Spatial State-Action Features [ 36 ] . This approach has the advantage

Read the complete text