Valet : A Standardized Testbed of Traditional Imperfect-Information Card Games
Mark Goadrich, Achille Morenville, Éric Piette · 2026
Read Valet : A Standardized Testbed of Traditional Imperfect-Information Card Games by Mark Goadrich, Achille Morenville, Éric Piette (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03252.txt.
Introduction
Mark Goadrich, Achille Morenville, and Éric Piette build a card table where game AI can be compared fairly. Algorithms for imperfect-information games are usually judged game by game, hiding whether a method is robust or just lucky. Card games are a natural testbed because hands are hidden and draws are random.
Their testbed, Valet, packages twenty-one traditional card games spanning genres, cultures, player counts, and deck types. Every game's rules are encoded in one description language, so different systems play identical games. Random simulations characterize each game's branching and length, and baseline scores for a Monte Carlo tree search player against random opponents show the suite is usable. The standard setup should sharpen future comparisons.
Catalog record
| CREATOR | Mark Goadrich, Achille Morenville, Éric Piette |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22413 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03252
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Valet : A Standardized Testbed of Traditional Imperfect-Information Card Games Mark Goadrich, Achille Morenville, Éric Piette Abstract AI algorithms for imperfect-information games are typically compared using performance metrics on individual games, making it difficult to assess robustness across game choices. Card games are a natural domain for imperfect information due to hidden hands and stochastic draws. To facilitate comparative research on imperfect-information game-playing algorithms and game systems, we introduce Valet , a diverse and comprehensive testbed of 21 traditional imperfect-information card games. These games span multiple genres, cultures, player counts, deck structures, mechanics, winning conditions, and methods of hiding and revealing information. To standardize implementations across systems, we encode the rules of each game in RECYCLE , a card game description language. We empirically characterize each game’s branching factor and duration using random simulations, reporting baseline score distributions for a Monte Carlo Tree Search player against random opponents to demonstrate the suitability of Valet as a benchmarking suite. 1 Introduction Tabletop card games have been played worldwide for centuries and remain a rich domain for studying decision-making under uncertainty. Unlike perfect-information games, they naturally incorporate hidden hands, stochastic draws, and information revelation through play, requiring players to reason about beliefs, deception, and risk. These properties make imperfect-information card games a compelling benchmark for Game AI, yet evaluations are often performed on only a few games, leaving the effect of game choice on reported performance largely unexplored. Card games are a canonical class of imperfect-information games [ 3 ] , in which players cannot observe the full game state because key information is hidden in private hands and revealed progressively as play unfolds. This partial observability makes traditional game-playing techniques such as alpha-beta pruning [ 10 ] difficult to apply directly, motivating specialized approaches that reason under uncertainty, including Monte Carlo Tree Search [ 19 ] and Counterfactual Regret Minimization [ 22 ] . In empirical evaluations of imperfect-information game-playing algorithms, researchers have primarily focused on a small set of individual games, often drawn from three recurring genres of card games: trick-taking games (such as Hearts [ 9 ] , Spades [ 1 ] , Doppelkopf [ 18 ] , Skat [ 5 ] , Jass [ 15 ] , and Bridge [ 8 ] ), climbing games (such as Dou Di Zhu [ 20 ] and Big 2 [ 6 ] ), and betting games (most commonly variants of Poker [ 4 ] ). In many cases, the choice of game is justified by regional popularity or simply taken for granted. As a result, the extent to which reported performance depends on the selected game remains unclear, motivating the need for a systematic understanding of how game mechanics influence algorithm behaviour. Several general game-playing (GGP) and game AI frameworks support research on imperfect-information games through collections of implemented domains, including card games, but none provides a shared set implemented consistently across systems. RLCard [ 21 ] is a reinforcement-learning toolkit, offering ten games across six genres, while OpenSpiel [ 11 ] provides a broader suite for game-theoretic and reinforcement-learning research, including seventeen card games alongside many non-card domains. CardStock [ 2 ] provides over 70 traditional and modern card games encoded in RECYCLE [ 2 ] , and supports agents based on determinization within Monte Carlo methods. TAG [ 7 ] similarly targets comparative research across modern board and card games, including fifteen card games, and Belief-Stochastic Game Framework (BSG) [ 13 , 14 ] centralizes belief modelling in the game engine and includes five games, four of which are card games. Despite this progress, cross-system comparisons remain difficult: no single game is implemented in all frameworks, and overlapping games often differ in rules or conventions. This motivates the need for a shared and diverse testbed for imperfect-information card games. To support comparative research on imperfect-information game-playing algorithms and systems, we introduce Valet , a diverse testbed of fixed rule-sets for twenty-one traditional card games, developed in the context of the GameTable COST Action [ 17 ] to facilitate collaboration and shared evaluation practices. Valet enables systematic comparisons across different GGP and game AI frameworks by providing a common suite of games with varying information structures and stochasticity. It also supports fairer and more reproducible agent evaluation by reducing reliance on small, selective benchmark sets, thereby limiting the influence of game selection and allowing performance differences to be attributed more confidently to algorithmic design choices. In this paper, we first detail the curation of the games in Valet , describing their diversity in genre and cultural heritage, and how we stabilize their rule sets within a card game description language. Next, we present an empirical analysis demonstrating how the games vary in information flow branching factor, game length, and scoring distributions. We conclude by outlining avenues for future work that use Valet to advance research on imperfect-information games. Table 1: Valet includes twenty-one games that represent a variety of genres, the number of players, deck compositions, mechanics, and winning conditions, along with different methods of hiding and revealing information. Game Genre Origin Date Players Deck Scoring Information Tricks Sets/Runs Teams Agram Last Trick Niger 2000 3 Unique One Winner P, D ✓ BlackJack Banking France 1930 1 French High Score Crazy Eights Shedding USA 1940 3 French Low Score P Cribbage Adding England 1600 2 French High Score P, T, S, D ✓ Cuckoo Exchange France 1490 6 French One Loser P, S, D Euchre Euchre USA 1820 4 Unique High Score P, T, S, D ✓ ✓ Go Fish Quartet USA 1850 4 French High Score P, T, D ✓ Golf-6 Draw & Discard USA ?? 4 French Low Score P Goofspiel Collect USA 1930 2 French High Score P, B Hearts Avoidance USA 1880 4 French Low Score P, D ✓ Klaverjassen Jack-Nine Netherlands 1890 4 Piquet High Score P, D ✓ ✓ ✓ Leduc Hold’em Poker Canada 2005 2 Unique High Score P Pitch High-Low-Jack England 1800 4 French High Score P, D ✓ ✓ President Climbing China 1960 5 French High Score P ✓ Rummy Rummy Mexico 1900 2 French Low Score P, T ✓ Scarto Tarot Italy ?? 3 Tarot High Score P, D ✓ Schwimmen Commerce Austria 1718 5 Piquet High Score P, T, S ✓ Scopa Fishing Italy 1700 2 Italian High Score P Skitgubbe Beating Sweden 1949 3 French One Loser P, D Sueca Ace-Ten Portugal 1800 4 Spanish High Score P, D ✓ ✓ Whist Trick Taking England 1880 4 French High Score P, D ✓ ✓ 2 Testbed Curation The Valet testbed 1 1 1 https://mgoadric.github.io/valet/ is composed of twenty-one traditional card games, listed in Table 1 . McLeod [ 12 ] distinguishes between traditional (popular in specific regions with traditional card decks), invented (played with traditional decks but without a wide following), and commercial (which require purchasing a specialized deck) card games. We focus our work on traditional card games, as their mechanics are often foundations of modern commercial card games. We used the categorizations and classifications from McLeod’s Pagat Card Game Rules website [ 12 ] and Parlett’s The Penguin Book of Card Games [ 16 ] to guide our selection of distinct genres, mechanics, and player counts.