Detecting Sleeper Agents in Large Language Models via Semantic Drift Analysis
Shahin Zanbaghi, Ryan Rostampour, Farhan Abid, Salim Al Jarmakani · 2025
Read Detecting Sleeper Agents in Large Language Models via Semantic Drift Analysis by Shahin Zanbaghi, Ryan Rostampour, Farhan Abid, Salim Al Jarmakani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-15992.txt.
Description
Shahin Zanbaghi and three co-authors present a real time system to detect sleeper agents in large language models through semantic drift analysis. Sleeper models behave safely in training but turn malicious under deployment triggers. Prior work showed such backdoors survive safety training, yet practical detectors were missing. Their dual method compares response meaning against safe baselines continuously.
Sentence embeddings measure semantic deviation from baseline behavior. Injected canary questions monitor response consistency as a second signal. On an official sleeper agent model, the combined system reports high accuracy with no false positives in tests. Detection runs in under a second per query without modifying the model. The approach offers deployers a first practical screening layer against hidden backdoors.
Catalog record
| CREATOR | Shahin Zanbaghi, Ryan Rostampour, Farhan Abid, Salim Al Jarmakani |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-15992