Nautilus Compass: Black-box Persona Drift Detection for Production LLM Agents
Chunxiao Wang · 2026
Read Nautilus Compass: Black-box Persona Drift Detection for Production LLM Agents by Chunxiao Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09863.txt.
Introduction
Wang built Nautilus Compass, a black-box detector for persona drift in production LLM coding agents. Over long sessions, agents forget user constraints, repeat mistakes users already flagged, and confabulate prior agreements. White-box tools like persona vectors need model weights, so they cannot run on closed APIs such as Claude and GPT-4 that most users actually use.
Compass works purely at the prompt-text layer: cosine similarity between user prompts and behavioral anchor texts, pooled by a weighted top-k mean over BGE-m3 embeddings. It is, as far as the author knows, the only public agent memory layer that calls no LLM at index time to extract facts or build a graph. On held-out Claude Code traces judged by an independent LLM, it reached ROC AUC 0.83 for drift detection, with end-to-end reproduction costing 3.50 dollars.
Catalog record
| CREATOR | Chunxiao Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09863
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nautilus Compass: Black-box Persona Drift Detection for Production LLM Agents Chunxiao Wang Abstract Production LLM coding agents drift over long sessions: they forget user-specified constraints, slip into mistakes the user already flagged, and confabulate prior agreements. White-box approaches such as persona vectors require model weights and so cannot be applied to closed APIs (Claude, GPT-4) that most users actually interact with. We present Nautilus Compass , a black-box persona drift detector and agent memory layer for production coding agents. The method operates entirely at the prompt-text layer: cosine similarity between user prompts and behavioral anchor texts, aggregated by a weighted top- k k mean using BGE-m3 embeddings. Compass is, to our knowledge, the only public agent memory layer (among Mem0, Letta, Cognee, Zep, MemOS, smrti verified May 2026) that does not call an LLM at index time to extract facts or build a graph; raw conversation text is embedded directly. The system ships as a Claude Code plugin, an MCP 2024-11-05 A2A server (Cursor, Cline, Hermes), a CLI, and a REST API on one daemon, with a Merkle-chained audit log for tamper-evident anchor updates. On a held-out test set built from real Claude Code session traces and labeled by an independent LLM judge, Compass reaches ROC AUC 0.83 for drift detection. The embedded retrieval pipeline scores 56.6% on LongMemEval-S v0.8 and 44.4% on EverMemBench-Dynamic (n=500), topping the four published EverMemBench Table 4 baselines. LongMemEval-S 56.6% is ~30 points below recent white-box leaders (90+%); we treat that as the architectural ceiling of the no-extraction design. End-to-end reproduction cost is $3.50 (~14 × \times cheaper than GPT-4o-judged stacks). A paired cross-vendor behavior A/B accompanies these numbers as preliminary system-level evidence. Code, anchors, frozen test data, and audit-log tooling are MIT-licensed at github.com/chunxiaoxx/nautilus-compass . 1 Introduction Modern coding agents based on Large Language Models (LLMs) such as Claude Code, Cursor, and Continue.dev sustain dialogue sessions spanning hundreds to thousands of turns. Within such sessions, a recurring failure mode is persona drift : the assistant gradually forgets user-specified constraints (“always verify before claiming success”), slips into bad habits the user explicitly flagged earlier (“don’t fabricate prior agreements”), or confabulates having reached agreements that were never made. These behaviors are not failures of factual recall—retrieval-augmented memory plugins ( 11 ; 13 ) successfully retrieve the relevant memos—but failures of behavioral consistency : the assistant has the information but does not act on it. Existing approaches fall into two categories. (a) Memory plugins like mem0 ( 11 ) , Letta ( 13 ) , and Zep ( 15 ) focus on retrieval quality: finding the right memory entries to inject into the prompt. While these systems produce strong retrieval metrics (e.g., on LongMemEval ( 18 ) ), they leave open the question of whether the LLM honors the retrieved content. (b) White-box safety methods , exemplified by Persona Vectors ( 7 ) , identify directions in the model’s activation space corresponding to specific traits and enable monitoring or steering of trait shifts. However, these methods require access to model weights or hidden states, putting them out of reach of the typical end-user who interacts with proprietary LLMs through black-box APIs. Our contribution. We present Nautilus Compass , a black-box persona drift detection system that runs entirely in user-space hooks of an LLM coding agent. The reference implementation ships as a Claude Code plugin and as a generic MCP 2024-11-05 server (compatible with Cursor, Cline, Hermes, OpenClaw, and any other MCP client), with a CLI and a REST endpoint backed by the same BGE-m3 daemon—a single embedder service amortized across every entry point. The system is the first product in the Nautilus open agent platform, designed so that any coding agent runtime can obtain drift telemetry without weight access. At each user-issued prompt, we compute the cosine similarity between the prompt and a small set of behavioral anchor texts , aggregated via weighted top- k mean. Anchors come in two flavors: positive (desired task patterns) and negative (mistakes the user has flagged). The difference between aggregated positive and negative similarity yields a continuous drift score , which we threshold into a three-band output ( aligned / neutral / deviation ) and inject into the LLM’s context for the current turn. Methodological insight. Our central finding is that the design of the anchor set, not the choice of embedder or aggregation function, is the dominant factor determining detection accuracy. We document a four-step iteration that improves ROC AUC from 0.51 (random) to 0.92 on a 100-prompt synthetic test set (Figure 1 ), and report negative results (e.g., that substituting a cross-encoder reranker for the bi-encoder cosine yields no measurable improvement at 36\times the latency). Figure 1: Drift detection ROC AUC across the four-step methodology evolution. Each step is a controlled change with all other variables fixed; aggregate improvement is from random ( 0.5056 ) to strong ( 0.9232 ). The largest single jump comes from rewriting abstract maxim anchors as task-shaped sentences matching the prompt distribution. Open source and reproducibility. All code, anchor sets, evaluation scripts, and benchmark data are released under MIT (anchors under CC0) at https://github.com/chunxiaoxx/nautilus-compass . The four-step ablation, the head-to-head comparison with mem0 on LongMemEval-S, and the negative cross-encoder result are all reproducible from the repository in under one hour on a CPU-only machine. Relation to Persona Vectors. Our work is complementary, not competing , with 7 . Persona Vectors operates in activation space (white-box), giving more fine-grained signal but requiring model weights. nautilus-compass operates in prompt-text space (black-box), giving coarser signal but deployable by anyone with hook-level access to the agent. We argue that a robust safety posture for production LLM agents will combine both layers. Scope and limits of claims. This paper makes a claim about detection accuracy : given a user-issued prompt and a curated anchor set, our method classifies whether the prompt aligns with task-shaped positive patterns or deviates toward known failure modes, with held-out AUC reported in Section 4.7 . We additionally report a cross-vendor behavior-steering A/B (Section 6 ) across six production LLMs (Google Gemini-2.5 {pro, flash}, MiniMax M2.7, ByteDance doubao-seed-2.0-pro, DeepSeek v3.2, Zhipu GLM-5.1) judged by an independent seventh (Moonshot Kimi-k2.6). The cross-vendor result is mixed but informative: drift injection produces a statistically significant improvement on fabrication-resistance ( p<0.05 , n=120 ) and no significant aggregate effect on the other three axes; one axis (refuse-destructive) trends nominally negative, which we attribute to the alert text verbalizing the matched negative anchor. Readers expecting “nautilus-compass causally improves Claude’s safety” should treat this paper as preliminary evidence with axis-specific effects, not as a uniform guarantee. 2 Related Work 2.1 Memory Systems for LLM Agents A growing line of work addresses the limited context window of LLMs through external memory. mem0 ( 11 ) stores key-value memories extracted from conversations and retrieves them via dense embeddings; the system targets production agent use cases and reports retrieval Recall@5 in the 0.5–0.6 range on LongMemEval-S. Letta (formerly MemGPT) ( 13 ) introduces a hierarchical memory architecture with archival storage and core memory, modeling LLM context management as an operating-system problem. Zep ( 15 ) adds temporal knowledge-graph structure on top of dense retrieval, optimizing for multi-session temporal reasoning. A-MEM ( 1 ) introduces