Fuzzing Large Language Models to Elicit Hidden Behaviours

Mohammed Abu Baker, Lakshmi Babu-Saheer · 2026

Read Fuzzing Large Language Models to Elicit Hidden Behaviours by Mohammed Abu Baker, Lakshmi Babu-Saheer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29646.txt.

Description

Abu Baker and Babu-Saheer study fuzzing as a way to expose hidden behaviours in sleeper agents, models trained to act normally until a secret trigger switches them to unsafe behaviour. Finding that behaviour without knowing the trigger had not been studied systematically. Fuzzing injects Gaussian noise, random small disturbances, into a model's weights or into its residual-stream activations, then checks the outputs.

On six backdoored models, fuzzing brings out the hidden behaviour far more often than temperature-sampling baselines on four of them, sometimes several times more often. Which form of fuzzing wins varies with the task, so both are worth running. Results vary sharply across settings, making selection the real bottleneck. A cheap proxy task guides that selection without ground-truth access. Proxy-selected settings multiply elicitation rates substantially on the models that can decode the secret.

Catalog record

CREATORMohammed Abu Baker, Lakshmi Babu-Saheer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29646

Browse the full library · About the Tower of Babel