Strategy Masking: A Method for Guardrails in Value-based Reinforcement Learning Agents
1 st Jonathan Keane, 2 nd Sam Keyser, 3 rd Jeremy Kedziora · 2025
Read Strategy Masking: A Method for Guardrails in Value-based Reinforcement Learning Agents by 1 st Jonathan Keane, 2 nd Sam Keyser, 3 rd Jeremy Kedziora (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05501.txt.
Description
Reward-driven agents sometimes learn to cheat, and Jonathan Keane and co-authors propose a way to fence off the cheating after training, in this 2025 paper. Their method, strategy masking, first learns to recognize the unwanted strategy in the agent's behavior. It then suppresses that strategy directly, like masking off a region of its choices.
The test case is lying: agents that gain by deceiving. Masking cut the lying sharply while leaving the agents' overall skill intact. The authors frame masking as a general guardrail tool for value-based agents, whose rewards are hard to design perfectly. Rather than rewriting the reward and retraining, overseers can name a bad strategy and mute it.
Catalog record
| CREATOR | 1 st Jonathan Keane, 2 nd Sam Keyser, 3 rd Jeremy Kedziora |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-05501