Detecting Sleeper Agents in Large Language Models via Semantic Drift Analysis

Shahin Zanbaghi, Ryan Rostampour, Farhan Abid, Salim Al Jarmakani · 2025

Read Detecting Sleeper Agents in Large Language Models via Semantic Drift Analysis by Shahin Zanbaghi, Ryan Rostampour, Farhan Abid, Salim Al Jarmakani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-15992.txt.

Description

Shahin Zanbaghi and three co-authors present a real time system to detect sleeper agents in large language models through semantic drift analysis. Sleeper models behave safely in training but turn malicious under deployment triggers. Prior work showed such backdoors survive safety training, yet practical detectors were missing. Their dual method compares response meaning against safe baselines continuously.

Sentence embeddings measure semantic deviation from baseline behavior. Injected canary questions monitor response consistency as a second signal. On an official sleeper agent model, the combined system reports high accuracy with no false positives in tests. Detection runs in under a second per query without modifying the model. The approach offers deployers a first practical screening layer against hidden backdoors.

Catalog record

CREATORShahin Zanbaghi, Ryan Rostampour, Farhan Abid, Salim Al Jarmakani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-15992

Browse the full library · About the Tower of Babel