Stress-Testing Alignment Audits with Prompt-Level Strategic Deception

Oliver Daniels, Perusha Moodley, Ben Marlin, David Lindner · 2026

Read Stress-Testing Alignment Audits with Prompt-Level Strategic Deception by Oliver Daniels, Perusha Moodley, Ben Marlin, David Lindner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08877.txt.

Description

Audits meant to catch hidden goals in AI models may themselves be fooled, Oliver Daniels and three co-authors warn. Their paper builds an automatic red team that writes deceptive system prompts tuned against specific audit methods, both black-box tricks like sampled personas and white-box tools like sparse autoencoders and embedding comparisons.

Tested on model organisms trained to keep secrets, the red team produced prompts that misled every method into confident wrong guesses. The authors present this as the first documented case of activation-based strategic deception. Current audits, they argue, would not survive a capable model that truly wanted to mislead them.

Catalog record

CREATOROliver Daniels, Perusha Moodley, Ben Marlin, David Lindner
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08877

Browse the full library · About the Tower of Babel