Beyond Rewards in Reinforcement Learning for Cyber Defence

2026

Read Beyond Rewards in Reinforcement Learning for Cyber Defence (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04809.txt.

Description

Elizabeth Bates, Chris Hicks, and Vasilios Mavroudis ask whether richly built rewards actually help cyber defence agents, in a 2026 study. Such agents are often trained in fake networks with dense rewards mixing many penalties and incentives, which eases exploration but may bias agents toward risky shortcuts.

The team compared sparse and dense reward designs across two known cyber gyms, several network sizes, and two reinforcement learning families. A novel ground-truth scoring method allowed direct comparison between reward functions. Sparse rewards, when aligned with the goal and met often enough, trained more reliably. They also yielded more effective defenders with lower-risk policies. Those agents used costly defence actions sparingly with no explicit numeric penalties.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04809

Browse the full library · About the Tower of Babel