SCI-Defense: Defending Manipulation Attacks from Generative Engine Optimization
Xucheng Yu, Haibo Jin, Huimin Zeng, Haohan Wang · 2026
Read SCI-Defense: Defending Manipulation Attacks from Generative Engine Optimization by Xucheng Yu, Haibo Jin, Huimin Zeng, Haohan Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21948.txt.
Introduction
Xucheng Yu and co-authors present SCI-Defense, a defense for ranking systems based on large language models against Generative Engine Optimization attacks. Attackers inject meaning signals into product descriptions to lift rankings falsely, and current filters miss such tricks. SCI-Defense combines perplexity checks, semantic integrity scoring, and inter-candidate detection. Tests show perplexity-only filters, content classifiers, and paraphrasing score zero recall against such tricks, while new attacks expose it as a structural blind spot.
Catalog record
| CREATOR | Xucheng Yu, Haibo Jin, Huimin Zeng, Haohan Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63666 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.21948
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SCI-Defense: Defending Manipulation Attacks from Generative Engine Optimization Xucheng Yu, Haibo Jin, Huimin Zeng, Haohan Wang Abstract LLM-based ranking systems are vulnerable to Generative Engine Optimization (GEO) attacks, where adversaries inject semantic signals into product descriptions to artificially boost rankings. We propose SCI-Defense , a three-component defense framework combining Perplexity detection (PPL), Semantic Integrity Scoring (SIS), and Inter-Candidate Detection (ICD). SIS evaluates four manipulation dimensions: Authority Attribution (AA), Narrative Purposiveness (NP), Comparative Claims (CA), and Temporal Claims (TC). Evaluated on 600 Amazon product descriptions across 6 categories, SCI-Defense achieves Precision = 1.000 =1.000 and FPR = 0.000 =0.000 , with Recall of 1.000 1.000 , 0.952 0.952 , and 0.830 0.830 against String, Reasoning, and Review attacks respectively. On 600 MS MARCO web passages, String attacks are blocked with perfect recall while Review attacks yield near-zero recall, as web passages lack the persuasion-oriented signals (authority stacking, comparative claims, temporal urgency) that SIS targets in product descriptions. We demonstrate that existing defenses—PPL-only filters, SafetyClf content classifiers, and paraphrasing—achieve zero recall against semantic manipulation attacks, as ranking manipulation differs fundamentally from jailbreaking in its threat model. We further demonstrate new attacks such as Specification Amplification and Use-Case Saturation can expose semantic relevance manipulation as a structural defense blind spot that suggests directions for future research. 1 Introduction Large language models (LLMs) are fundamentally transforming how consumers discover products online. Modern generative search engines (Amazon Rufus, Google Shopping AI, and Perplexity Commerce) no longer rank results through keyword matching; they ask an LLM to reason about which product best satisfies a user’s query 17 ; 21 . This shift opens an entirely new attack surface: sellers who control product descriptions can now craft text specifically designed to exploit LLM reasoning patterns, a practice known as Generative Engine Optimization (GEO) . GEO occupies a uniquely challenging position in the threat model because it must satisfy two audiences simultaneously: the LLM ranker, which must be persuaded to rank the product highly, and the human customer, who must find the description credible enough to complete a purchase. This dual-audience constraint distinguishes GEO fundamentally from jailbreaking. A jailbreak can afford to be incoherent, whereas a GEO attack must remain semantically natural to human readers while covertly manipulating LLM judgment. The CORE framework 3 demonstrates that this attack surface is practically exploitable. It proposes GEO attacks including String injection, Reasoning manipulation, and Review-style persuasion, each reliably elevating a target product’s rank in LLM-based systems across multiple state-of-the-art models. This motivates a critical question: can existing LLM defenses protect against GEO attacks? We evaluate three representative baselines (perplexity-based filters, content safety classifiers, and paraphrasing defenses) and find that all achieve zero recall against semantic GEO attacks. The failure is structural: perplexity filters are blind to fluent manipulation; safety classifiers scan for harmful intent that GEO attacks do not contain; paraphrasing preserves the manipulation intent it was meant to remove. None of these addresses the persuasion-oriented semantic structure that defines GEO. This motivates SCI-Defense. We identify three necessary properties for an effective defense: (a) Semantic sensitivity to detect persuasion signals invisible to perplexity or safety classifiers; (b) Zero false positives since incorrect suppression causes real commercial harm; (c) Attack-agnostic coverage to generalize across diverse adversarial strategies. We propose SCI-Defense ( S emantic C ontent I ntegrity Defense), combining PPL (property c for String attacks), SIS via GPT-4o scoring (property a), and ICD for cross-candidate anomaly detection (property c), achieving FPR =0.000 across 1,200 evaluations. We also contribute six novel black-box GEO attacks. Specification Amplification and Use-Case Saturation are our principal attack contributions: they exploit a structural blind spot in SIS-based detection by inflating factual relevance signals rather than persuasion signals. Our contributions are: • A taxonomy of GEO manipulation signals in four detectable semantic dimensions (AA, NP, CA, TC), with weights empirically justified by ablation. • The SCI-Defense framework achieving Precision =1.000 and FPR =0.000 across 600 Amazon product descriptions and 600 MS MARCO web passages. • Two novel black-box GEO attacks identifying semantic relevance manipulation as a structural defense blind spot, confirmed across two product categories. 2 Related Work LLM-based ranking and generative search. LLMs are widely deployed as zero-shot rankers 17 ; 21 ; 7 : RankVicuna 17 and RankGPT 21 outperform BM25 without task-specific training; PRP 19 uses pairwise comparisons; RankZephyr 18 matches proprietary models in listwise reranking. Unlike traditional rankers, LLM rankers consume raw text and are influenced by its rhetorical structure—a vulnerability amplified by commercial engines (Amazon Rufus, Google Shopping AI, Perplexity Commerce) that expose ranking decisions to sellers who control product descriptions. Generative Engine Optimization (GEO). GEO optimizes content for LLM-based ranking, targeting neural rather than lexical signals. Early work 1 studies how citations and authoritative language influence LLM citation frequency. Concurrent work 16 ; 14 shows adversarial injections promote attacker-chosen products in conversational search. CORE 3 demonstrates systematic ranking manipulation via String, Reasoning, and Review injection. Our work defends against such attacks. Adversarial attacks on retrieval systems. Corpus poisoning 24 injects adversarial passages to hijack dense retrievers; HotFlip 5 optimizes retrieval scores but produces perplexity-detectable text; prompt injection 15 ; 6 hijacks RAG pipelines via embedded instructions. GEO attacks differ: they target the ranking decision , must remain natural to human readers, and are constrained to the attacker’s own description. Defenses against adversarial NLP. Perplexity filtering 2 catches String-style GEO attacks but is blind to fluent manipulation. Safety classifiers 8 ; 23 target harmful intent—mismatched to GEO, where “ISO 9001 certified, trusted by professionals” is neither harmful nor a violation yet constitutes an attack. Paraphrasing 9 preserves semantic intent, leaving GEO signals intact. DataSentinel 22 addresses prompt injection in system prompts—distinct from manipulation in retrieved content. Text quality and integrity detection. Watermarking 12 requires the generating model’s cooperation—violated when attackers use their own pipeline. DetectGPT 13 distinguishes machine from human text, but GEO attacks may be human-authored. In contrast, our proposed method asks whether text semantic structure exhibits GEO persuasion patterns—well-defined regardless of origin. 3 SCI-Defense 3.1 Background: GEO Attacks We consider a ranking system where an LLM receives a query q and a set of n product descriptions \{d_{1},\ldots,d_{n}\} and produces a ranking \pi . An adversary controlling description d_{t} appends injected text \delta to form d_{t}^{\prime}=d_{t}\oplus\delta , aiming to move d_{t}^{\prime} to rank 1. CORE 3 has demonstrated three attack strategies that reliably achieve this goal under realistic black-box conditions, where the adversary has no access to model internals and can only observe input–output behavior. A key distinction from traditional jailbreak attacks 15 ; 6 ; 25 ; 4 is the dual-readership constraint inherent to GEO. Jailbreak attacks are designed to fool only the model 10 : they can afford to inject surplus scenario text, meaningless token strings 11 , or adversarial suffixes 25 that look bizarre to human readers, because no human needs to find the jailbreak plausible. GEO attacks, by contrast, must satisfy two audiences simultaneously—the LLM ranker and the human customer who will ultimately decide whether to purchase. An injection that reads as incoherent or unnatural would undermine buyer trust and defeat the commercial purpose of the attack. This constraint rules out gradient-optimized token sequences and other approaches that produce text unreadable to humans, and forces GEO adversaries