A New Framework for Cybersecurity Refusals in AI Agents

Eliot Krzysztof Jones, Mateusz Dziemian, Matt Fredrikson, J Zico Kolter · 2026

Read A New Framework for Cybersecurity Refusals in AI Agents by Eliot Krzysztof Jones, Mateusz Dziemian, Matt Fredrikson, J Zico Kolter (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02644.txt.

Description

Jones and co-authors set out when AI agents should refuse cybersecurity tasks. Agent scaffolds have boosted performance on long, complex tasks. Offensive security gains both benefits and risks. Current benchmarks measure proficiency at attack tasks. They skip the refusal question. This work presents the first framework for refusal boundaries in offensive security.

Three parts define the framework. Principled criteria say when tasks should be refused. Categories list which tasks warrant refusal. An evaluation method measures robustness under benign and adversarial conditions. The framework is applied to web-based offensive security scenarios. Six of eight frontier models show near-zero refusal rates. Only GPT-5.2 and GPT-5.1 Codex refuse in any meaningful way. The gap between skill and restraint is stark. The framework gives the field a way to measure both at once.

Catalog record

CREATOREliot Krzysztof Jones, Mateusz Dziemian, Matt Fredrikson, J Zico Kolter
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.02644

Browse the full library · About the Tower of Babel