Sparse Masked Attention Policies for Reliable Generalization
Caroline Horsch, Laurens Engwegen, Max Weltevrede, Matthijs T. J. Spaan, Wendelin Böhmer · 2026
Read Sparse Masked Attention Policies for Reliable Generalization by Caroline Horsch, Laurens Engwegen, Max Weltevrede, Matthijs T. J. Spaan, Wendelin Böhmer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-19956.txt.
Description
Reinforcement learning policies often generalize better when irrelevant detail is stripped from observations, but the stripping function itself may fail on unseen states. A 2026 arXiv paper by Caroline Horsch and four co-authors tackles that weakness with sparse masked attention policies.
Their method learns a masking function that works on, and is woven into, the attention weights of an attention-based policy network. By removing information through the attention mechanism itself, the policy's reduced view generalizes more reliably to new states. Tests on the Procgen benchmark show significantly better generalization to unseen tasks than standard proximal policy optimization and than earlier masking approaches. The paper thus strengthens abstraction-based generalization at its weakest link.
Catalog record
| CREATOR | Caroline Horsch, Laurens Engwegen, Max Weltevrede, Matthijs T. J. Spaan, Wendelin Böhmer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-19956