Sparse Masked Attention Policies for Reliable Generalization

Caroline Horsch, Laurens Engwegen, Max Weltevrede, Matthijs T. J. Spaan, Wendelin Böhmer · 2026

Read Sparse Masked Attention Policies for Reliable Generalization by Caroline Horsch, Laurens Engwegen, Max Weltevrede, Matthijs T. J. Spaan, Wendelin Böhmer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-19956.txt.

Description

Reinforcement learning policies often generalize better when irrelevant detail is stripped from observations, but the stripping function itself may fail on unseen states. A 2026 arXiv paper by Caroline Horsch and four co-authors tackles that weakness with sparse masked attention policies.

Their method learns a masking function that works on, and is woven into, the attention weights of an attention-based policy network. By removing information through the attention mechanism itself, the policy's reduced view generalizes more reliably to new states. Tests on the Procgen benchmark show significantly better generalization to unseen tasks than standard proximal policy optimization and than earlier masking approaches. The paper thus strengthens abstraction-based generalization at its weakest link.

Catalog record

CREATORCaroline Horsch, Laurens Engwegen, Max Weltevrede, Matthijs T. J. Spaan, Wendelin Böhmer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-19956

Browse the full library · About the Tower of Babel