A New Framework for Cybersecurity Refusals in AI Agents
Eliot Krzysztof Jones, Mateusz Dziemian, Matt Fredrikson, J Zico Kolter · 2026
Read A New Framework for Cybersecurity Refusals in AI Agents by Eliot Krzysztof Jones, Mateusz Dziemian, Matt Fredrikson, J Zico Kolter (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02644.txt.
Description
Jones and co-authors set out when AI agents should refuse cybersecurity tasks. Agent scaffolds have boosted performance on long, complex tasks. Offensive security gains both benefits and risks. Current benchmarks measure proficiency at attack tasks. They skip the refusal question. This work presents the first framework for refusal boundaries in offensive security.
Three parts define the framework. Principled criteria say when tasks should be refused. Categories list which tasks warrant refusal. An evaluation method measures robustness under benign and adversarial conditions. The framework is applied to web-based offensive security scenarios. Six of eight frontier models show near-zero refusal rates. Only GPT-5.2 and GPT-5.1 Codex refuse in any meaningful way. The gap between skill and restraint is stark. The framework gives the field a way to measure both at once.
Catalog record
| CREATOR | Eliot Krzysztof Jones, Mateusz Dziemian, Matt Fredrikson, J Zico Kolter |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02644