Poisoned Identifiers Survive LLM Deobfuscation: A Case Study on Claude Opus 4.6

Luis Guzmán Lorenzo · 2026

Read Poisoned Identifiers Survive LLM Deobfuscation: A Case Study on Claude Opus 4.6 by Luis Guzmán Lorenzo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04289.txt.

Introduction

Guzmán Lorenzo asks whether poisoned identifier names can survive when a language model deobfuscates JavaScript code. Across 192 runs with Claude Opus 4.6 on graph simulation and pathfinding code, poisoned names persisted in every baseline run, even for terms with no semantic fit. Oddly, the model often wrote wrong names while correctly describing the operation in comments. Check prompts did not help, but asking for a fresh implementation instead of a deobfuscation cut propagation to near zero while keeping the checked structure.

Catalog record

CREATORLuis Guzmán Lorenzo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45943
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.04289

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Poisoned Identifiers Survive LLM Deobfuscation: A Case Study on Claude Opus 4.6 Luis Guzmán Lorenzo Abstract When an LLM deobfuscates JavaScript, can poisoned identifier names in the string table survive into the model’s reconstructed code, even when the model demonstrably understands the correct semantics? Using Claude Opus 4.6, we found that explicit verification prompts (“verify each name matches the math”) failed to prevent propagation (12/12), while task reframing (“write from scratch”) substantially reduced propagation on the physics artifact (from 100% to 20%) and eliminated it on the pathfinding artifact (0%). In our tested setting, the implicit frame of the task changed naming accuracy where explicit instructions did not. We tested this across 192 repeated inference runs on two code archetypes (a force-directed graph simulation and an A* pathfinding algorithm, 50 conditions, N=3–6) and observed three consistent patterns within the tested conditions: 1. Wrong decoded identifiers persisted. Poisoned names appeared in the model’s deobfuscated code in every baseline run tested on both artifacts (physics: 8/8; pathfinding: 5/5). Matched controls showed this extends to terms with zero semantic fit ( combustion for repulsion, invoice for heuristic) when the string table does not form a coherent alternative domain. 2. Persistence coexisted with correct semantic commentary. In 15/17 runs on the physics artifact, the model wrote wrong variable names in code while correctly describing the actual operation in comments (manually scored, unblinded, single author; see Section 3.3 for limitations). 3. Task framing changed persistence. Reframing from “deobfuscate this” to “write a fresh implementation” reduced propagation from 100% to 0–20% on the physics artifact (N=5) and to 0% on the pathfinding artifact (N=5), while an algorithmic consistency check confirmed the generated implementations preserved the checked structure (Appendix F). Explicit verification instructions had no effect (12/12 across 4 prompt variants). Matched-control experiments showed that terms with zero semantic fit persist at the same rate when the string table does not form a recognizable alternative domain. Per-term variation observed in earlier domain-gradient experiments is confounded with domain-level coherence and recoverability (Section 6). These observations are from two code archetypes on one model family (Opus 4.6 primary; Haiku 4.5 limited spot-check). Broader model and archetype generalization is needed. 1 Introduction When Claude Opus 4.6 deobfuscates JavaScript containing poisoned identifier names, explicit verification instructions (“verify each name matches the math”) do not prevent the wrong names from appearing in the output (12/12 runs). Reframing the task as generation (“write a fresh implementation from scratch”) substantially reduces propagation while preserving the checked algorithmic structure (Appendix F). The implicit frame of the task changed naming accuracy where explicit instructions did not. Here is what the output looks like: ⬇ attraction : 4000, // Repulsion force strength ---------- --------------------- | | identifier : WRONG comment : CORRECT amplification : 0.92, // Velocity damping ( friction ) ------------- ---------------------- | | identifier : WRONG comment : CORRECT Figure 1: The dual-representation pattern (Phase B, R1 run 1, Opus 4.6). Wrong identifier in code, correct description in comment. Observed in 15/17 Phase B runs where the primary endpoint was positive (at least one poisoned identifier in code blocks). Scored manually by the first author without blinding; see Section 3.3. There are two ways to read this. Source recovery: decoded string-table names are the closest available ground truth, and a well-calibrated model should use them. Alternatively: the model does not apply a capability it shows in other settings (name correction on readable code, Section 5.1), even when explicitly told to. A pure inability-to-verify account does not explain these results well, though the data do not isolate the underlying mechanism. The strongest defensible claim is: task framing changes naming behavior without altering the checked algorithmic structure. We frame the practical implication as cost multiplication, not protection. Any browser-delivered code is ultimately inspectable (see Section 8.3). Scope. This is a case study on two code archetypes (a JavaScript force-directed graph simulation and an A* pathfinding algorithm) tested primarily on Claude Opus 4.6 (Haiku 4.5 limited spot-check). Phase A (exploratory, N=1) used Claude Code CLI with tool use. Phase B (replicated, N=3–6) used the Anthropic Messages API without tool use. Results may reflect model-specific or interface-specific behaviors. We do not claim generality beyond these tested conditions. 2 Related Work 2.1 Code obfuscation and deobfuscation Pre-LLM baselines. Lu, Coogan, and Debray [ 17 ] describe semantics-based automatic deobfuscation of JavaScript using dynamic analysis and slicing (2011). Their approach recovers functionally equivalent code without requiring knowledge of the obfuscation scheme, establishing the pre-LLM baseline for automated JS deobfuscation. The transition from such deterministic approaches to LLM-based deobfuscation introduces the identifier-naming question central to this paper: deterministic tools recover whatever literals the code contains, while LLMs reconstruct names that may reflect training priors, decoded string tables, or both. CASCADE [ 1 ] : Google’s hybrid LLM + compiler deobfuscator. Uses Gemini for prelude function identification (99.56% accuracy via few-shot prompting), then hands off to JSIR for deterministic constant propagation, with sandboxed V8/QuickJS for dynamic execution. Achieves 98.93% success on standard obfuscator.io output. CASCADE’s JSIR constant propagation recovers the original string literals (before obfuscation encoded them), not semantically meaningful names derived from algorithmic analysis. If the original names were poisoned before obfuscation (our attack model), we predict but did not test that JSIR would recover those poisoned names faithfully, since it restores original literals regardless of semantic correctness. webcrack [ 4 ] : Purpose-built AST-level deobfuscator for javascript-obfuscator output. Supports string array decoding (base64, RC4), control flow unflattening, and dead code elimination via pattern matching. Issue history indicates failure cases under some transform combinations (e.g., CFF + dead code injection, issue #44). Our RC4-encoded production build was not fully decoded by webcrack’s automated pipeline in Phase A testing. JS-Confuser [ 6 ] : Alternative obfuscator using state-machine CFF (explicit state transitions instead of dispatch strings). We expect webcrack cannot reverse this pattern (untested; webcrack’s source matches only the split-string dispatch pattern). 2.2 Identifier naming and LLM code understanding Wang et al. [ 10 ] measure the impact of misleading variable names on LLM code analysis tasks (using CodeBERT-family models), finding that shuffled or misleading names degrade performance more than random strings because they actively misdirect the model. This supports the general premise that identifier names influence LLM code processing, though the setting (analysis tasks on code models) differs from our deobfuscation setting. “The Code Barrier” [ 11 ] introduces semantics-preserving obfuscations including cross-domain term substitution, finding that removing meaningful names severely degrades intent-level tasks. Their cross-domain renaming experiments provide relevant background for our domain-gradient observations. Our contribution is specific to the deobfuscation string-table setting: we observe that wrong-but-plausible names are actively preserved in reconstructed code, not merely that they degrade understanding. CoTDeceptor [ 5 ] demonstrates that multi-stage obfuscation strategies can evade CoT-enhanced LLM vulnerability detectors, in line with the general finding that adversarial content can bypass model analysis. 2.3 Obfuscation vs. LLM code analysis Li et al. [ 12 ] categorize obfuscation techniques (layout, data flow, control flow) against LLM vulnerability detection, finding both degradation and, in some cases, unexpected improvements. “Digital Camouflage” [ 13 ] tests Claude, Gemini, and GPT-4o against compiler-level obfuscation (CFF, bogus control flow) on LLVM-obfuscated C functions, confirming cross-model degradation. FORGEJS [ 14 ] benchmarks LLM

Read the complete text