Fuzzing Large Language Models to Elicit Hidden Behaviours
Mohammed Abu Baker, Lakshmi Babu-Saheer · 2026
Read Fuzzing Large Language Models to Elicit Hidden Behaviours by Mohammed Abu Baker, Lakshmi Babu-Saheer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29646.txt.
Description
Abu Baker and Babu-Saheer study fuzzing as a way to expose hidden behaviours in sleeper agents, models trained to act normally until a secret trigger switches them to unsafe behaviour. Finding that behaviour without knowing the trigger had not been studied systematically. Fuzzing injects Gaussian noise, random small disturbances, into a model's weights or into its residual-stream activations, then checks the outputs.
On six backdoored models, fuzzing brings out the hidden behaviour far more often than temperature-sampling baselines on four of them, sometimes several times more often. Which form of fuzzing wins varies with the task, so both are worth running. Results vary sharply across settings, making selection the real bottleneck. A cheap proxy task guides that selection without ground-truth access. Proxy-selected settings multiply elicitation rates substantially on the models that can decode the secret.
Catalog record
| CREATOR | Mohammed Abu Baker, Lakshmi Babu-Saheer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29646