Watermarking Game-Playing Agents in Perfect-Information Extensive-Form Games
Juho Kim, Fei Fang, Tuomas Sandholm · 2026
Read Watermarking Game-Playing Agents in Perfect-Information Extensive-Form Games by Juho Kim, Fei Fang, Tuomas Sandholm (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14283.txt.
Introduction
Kim, Fang and Sandholm study watermarking game-playing agents in perfect-information extensive-form games. LLM watermarks hide information in output so its source can be verified, aiding misuse detection. Game-playing faces similar misuse, such as unauthorized AI tools on gaming platforms. The KGW watermark for LLMs is adapted to watermark game-playing agents, detected by a stats test. Quality loss in the watermarked strategy can be bounded, but detectability trades off against quality. Chess-engine experiments show negligible quality impact and detection with a handful of games.
Catalog record
| CREATOR | Juho Kim, Fei Fang, Tuomas Sandholm |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40232 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14283
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Watermarking Game-Playing Agents in Perfect-Information Extensive-Form Games Juho Kim, Fei Fang, Tuomas Sandholm Abstract Watermarking techniques for large language models (LLMs), which encode hidden information in the output so its source can be verified, have gained significant attention in recent days, thanks to their potential capability to detect accidental or deliberate misuse. Similar challenges involving model misuse also exist in the context of game-playing, such as when detecting the unauthorized use of AI tools in gaming platforms ( e.g. , cheating in online chess). In this paper, we initiate the study of how game-playing strategies can be watermarked. We show how the KGW watermark for LLMs can be adapted to watermark game-playing agents in perfect-information extensive-form games. The watermark can then be detected using a statistical test. We show that the degradation in the quality of the watermarked strategy profile, quantified by the expected utility, can be bounded, but there is a tradeoff between detectability and quality. In our experiments, we bootstrap the watermarking framework to various chess engines and demonstrate that a) the impact of the watermark on the quality of the strategy is negligible and b) the watermark can be detected with just a handful of games. 1 Introduction In the past decades, breakthroughs in the field of artificial intelligence (AI) led to the development of superhuman AI agents capable of beating top human experts in games like chess [ 3 ] , Go [ 18 ] , poker [ 1 , 2 ] , and dark chess [ 23 ] . As strong as they are in performance, game-playing AI agents can potentially grow even stronger as new algorithms develop and computing power increases. As such, there have been growing concerns about their unauthorized usage, presenting the need for the means to embed and detect a robust, unique signature, i.e. , a watermark, in their gameplay. Watermarking techniques can be useful to communities for games like chess and poker, which face a rampant cheating problem [ 6 , 8 ] , especially online, as it can be used to detect improper usage of AI. Additionally, the developers of AI tools themselves can use a watermark for license enforcement and intellectual property (IP) protection . In 2021, the development team behind the open-source chess engine Stockfish filed a lawsuit against the developers of Houdini 6, a proprietary chess engine, accusing them of code plagiarism and license non-compliance [ 21 ] . One central piece of evidence included Houdini’s leaked source code; however, had a hidden watermark been used beforehand, they would have had another, potentially more irrefutable evidence of IP theft. A watermark can also deter other types of model theft, such as distillation learning, thanks to its radioactive nature [ 15 ] : a watermark remains detectable in the outputs of student models trained from a watermarked teacher model. In another use case, AI researchers interested in mimicking human behavior in games can use a watermark detector for data cleaning to sanitize datasets that are contaminated with AI gameplays. There exists a vast literature [ 7 , 12 ] for watermarking texts generated by large language models (LLMs), that is, encoding hidden signals in LLM outputs so their source can be verified. In this paper, we propose adapting LLM watermarks for game playing. Specifically, we explore adapting the KGW watermark, which is the most prominent and widely established method (later in our discussions, we justify this choice and discuss adapting alternative LLM watermarks). LLM watermarks were developed in response to the meteoric rise of LLMs in popularity and their strong performance in broad natural language processing tasks to address concerns about the potential risks of their accidental or deliberate misuse. Real-life examples of this include LLM-operated bot networks in social media platforms [ 14 ] , large-scale phishing scams [ 16 ] , and the spread of misinformation [ 20 ] . Additionally, revelations about the collapse of AI models when trained repeatedly on synthetic data [ 17 ] present the necessity to detect LLM-generated outputs in LLM training sets. Curiously, text generation and game-playing have striking similarities , as summarized in Table 1 , which allow LLM watermarks to be readily adapted to game-playing. Just as LLMs model the probability distribution over tokens given a context or a prompt as a prior, a strategy profile provides the probability distribution over the set of available actions at a particular history or information set (infoset). The text generation process ends upon sampling the end-of-sequence (EOS) token. This is analogous to how game-playing agents apply actions until they reach a terminal history. Table 1 : Analogies between text generation and game playing. Text generation Game playing LLM \longleftrightarrow Strategy profile Token \longleftrightarrow Action Context/Prompt \longleftrightarrow History/Infoset EOS token \longleftrightarrow Terminal history Text quality \longleftrightarrow Expected utility /Exploitability Sentence entropy \longleftrightarrow Mobility/Purity In LLM watermarking, a watermark distorts the LLM’s modeled probability distribution and thus can potentially degrade the quality of the generated text, typically quantified by calculating the perplexity cost [ 12 ] or conducting user feedback studies [ 7 ] . Naturally, such a concern carries over to game playing as well, where a watermark’s distortion of action probabilities can reduce an agent’s expected utility or make the agent vulnerable to exploitation. There are certain situations in text generation where watermarking must be forgone, namely when dealing with low sentence entropy. As an example, consider the Python code snippet ‘ print("Hello, ’, which is most likely followed by ‘ World!") ’. Here, the LLM watermark should more or less preserve the LLMs’ original probability distributions. Similarly, a watermarked strategy profile should retain its original strategy in situations with low mobility or when the action probability distribution is pure or almost pure. A real-life example of this would be in chess openings or endgames, where the set of correct actions is limited and playing incorrect actions can be detrimental. However, notable differences exist between text generation and game playing. Whereas in text generation, a single LLM generates the text, in game-playing, multiple players, each employing their own strategies, apply actions sequentially. Also, while an attacker in text generation can attempt to remove the watermark as a post-processing step, an analogous attack in game playing is impractical because a) undoing an action is usually not allowed in competitive settings, b) other players and, if present, a neutral observer can record the gameplay, and c) utilities are typically realized to players as soon as the game ends. In short, offline watermark removal attacks, although technically possible, are not relevant in game playing. Therefore, the attacker is limited to online attacks only, that is, removing the watermark for a single pending action each time the attacker is in turn to act. That said, game playing also introduces new challenges that are not present in text generation. While a typical LLM user may be satisfied with simply having the tokens sampled to them, a user of a game solver or an engine may not be content with simply having actions sampled to them. Indeed, they may also be interested in exploring alternative actions and comparing them with the recommended action using (estimated) expected utilities. Thus, for our use case, the watermark must be