StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectors

Suraj Ranganath, Atharv Ramesh · 2026

Read StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectors by Suraj Ranganath, Atharv Ramesh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08934.txt.

Introduction

Tools that spot AI-written text look sturdy until an attacker rewrites the text to slip past them. Suraj Ranganath and one co-author build StealthRL, a reinforcement-learning attacker that trains a paraphrase policy against four detectors at once, balancing evasion against keeping the meaning intact. The policy uses a small adapter on the Qwen3-4B model.

Tested on over 15,000 human and 14,000 AI passages, it drives detection near zero on three of four detectors, with a 97.6 percent attack success rate. Worse, the tricks transfer to two detectors never seen in training, pointing to shared weaknesses. The authors release code and call for stronger evaluation standards.

Catalog record

CREATORSuraj Ranganath, Atharv Ramesh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08934

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectors Suraj Ranganath, Atharv Ramesh Abstract AI-text detectors face a critical robustness challenge: adversarial paraphrasing attacks that preserve semantics while evading detection. We introduce StealthRL , a reinforcement learning framework that stress-tests detector robustness under realistic adversarial conditions. StealthRL trains a paraphrase policy against a multi-detector ensemble using Group Relative Policy Optimization (GRPO) with LoRA adapters on Qwen3-4B, optimizing a composite reward that balances detector evasion with semantic preservation. We evaluate six attack settings (M0–M5) against three detector families (RoBERTa, Fast-DetectGPT, and Binoculars) at the security-relevant 1% false positive rate operating point. StealthRL achieves near-zero detection (0.001 mean TPR@1%FPR), reduces mean AUROC from 0.74 to 0.27, and attains a 99.9% attack success rate. Critically, attacks transfer to a held-out detector family not seen during training, revealing shared architectural vulnerabilities rather than detector-specific brittleness. We additionally conduct LLM-based quality evaluation via Likert scoring, analyze detector score distributions to explain why evasion succeeds, and provide per-detector AUROC with bootstrap confidence intervals. Our results expose significant robustness gaps in current AI-text detection and establish StealthRL as a principled adversarial evaluation protocol. Code and evaluation pipeline are publicly available at https://github.com/suraj-ranganath/StealthRL . 1 Introduction Large language models (LLMs) produce text that is increasingly indistinguishable from human writing, raising urgent concerns about academic integrity, misinformation, and content provenance [ 21 ] . In response, a growing ecosystem of AI-text detectors has been deployed in educational institutions, publishing platforms, and content moderation systems. These detectors span diverse architectures, from fine-tuned classifiers [ 21 ] to zero-shot statistical methods [ 15 , 1 ] and paired-LM approaches [ 8 ] , yet their robustness to adversarial manipulation remains poorly understood. Standard detector evaluations measure performance on clean distributions, where AI-generated text is presented without any evasion attempt. However, real-world adversaries are adaptive: they can iteratively refine paraphrases, query detector APIs, and exploit known weaknesses. This gap between clean-distribution evaluation and adversarial robustness is critical. A detector that achieves 95% accuracy on clean text may fail catastrophically when an attacker deliberately targets its decision boundary. The choice of operating point further complicates evaluation. Most prior work reports AUROC or accuracy at default thresholds, but deployed detectors must operate at low false positive rates (e.g., 1% FPR) to avoid falsely accusing human writers. At these strict operating points, the gap between clean and adversarial performance is even more pronounced, as detectors sacrifice recall to maintain precision. We introduce StealthRL , a reinforcement learning framework that systematically evaluates detector robustness under adaptive adversarial conditions. StealthRL trains a paraphrase policy against a multi-detector ensemble, using GRPO [ 17 ] with LoRA adapters [ 9 ] on Qwen3-4B-Instruct, to produce semantically faithful paraphrases that minimize detection confidence. By evaluating at the 1% FPR operating point and testing transfer to a held-out detector family, we provide a rigorous robustness assessment that complements standard benchmarks. Our contributions are as follows: • We implement black-box adaptive paraphrasing attacks via multi-detector RL training with semantic constraints, one of the first works to apply RL for adversarial detector evasion across multiple detector families simultaneously. • We demonstrate catastrophic robustness failure: 0.001 mean TPR@1%FPR across three detector architectures, with strong cross-architecture transfer to a held-out detector. • We provide comprehensive analysis including detector score distributions (explaining why evasion succeeds), LLM-based quality evaluation, and per-detector AUROC with bootstrap confidence intervals. • We establish an evaluation protocol measuring evasion, transfer, and fidelity at security-relevant operating points, and release complete training and evaluation code for reproducible robustness benchmarking at https://github.com/suraj-ranganath/StealthRL . 2 Related Work 2.1 AI-Text Detection Methods AI-text detection methods can be broadly categorized into three families. Fine-tuned classifiers train discriminative models on labeled human and AI text; the RoBERTa-based OpenAI detector [ 21 ] is a widely used example. Zero-shot statistical methods exploit properties of language model probability distributions without requiring labeled data. DetectGPT [ 15 ] uses probability curvature, while Fast-DetectGPT [ 1 ] achieves similar accuracy with substantially reduced computational cost via conditional probability curvature. Ghostbuster [ 22 ] combines features from multiple weaker models. Paired-LM detectors such as Binoculars [ 8 ] compare log-likelihoods across two language models to detect statistical anomalies. The MAGE benchmark [ 14 ] provides standardized evaluation data, while RAID [ 6 ] offers a shared benchmark for robust detector evaluation across domains and attacks. Despite diverse architectures, Sadasivan et al. [ 18 ] provide theoretical arguments that reliable detection may be fundamentally impossible as language models improve, motivating empirical robustness evaluation like ours. 2.2 Adversarial Attacks on Detectors Evasion attacks on AI-text detectors range from simple paraphrasing to sophisticated adaptive methods. Krishna et al. [ 13 ] demonstrate that paraphrasing with their DIPPER model [ 12 ] effectively evades detectors, though retrieval-based defenses can mitigate the attack. Cheng et al. [ 2 ] study adversarial paraphrasing as a universal attack, using detector-guided candidate selection to humanize AI-generated text. Character-level attacks such as homoglyph substitution (SilverSpeak [ 3 ] ) achieve strong evasion by replacing characters with visually similar Unicode glyphs, but often degrade readability and are detectable by normalization. Most relevant to our work, AuthorMist [ 4 ] applies reinforcement learning to train an evasion policy against a single detector. StealthRL extends this approach to multi-detector ensemble training with held-out evaluation, strict low-FPR operating points, and comprehensive quality analysis. Watermark-based detection [ 11 ] represents an orthogonal approach where the text generator embeds a statistical signal during generation. While watermarks can provide stronger guarantees, they require control over the generation process and are outside the scope of post-hoc detection methods we evaluate. A natural defensive response to paraphrasing attacks is adversarial training, where detectors are fine-tuned on adversarially generated examples to improve robustness. However, adversarial training faces a fundamental scalability challenge: the space of possible paraphrasing strategies is vast, and a detector hardened against one attack family may remain vulnerable to novel attack methods. The RAID benchmark [ 6 ] evaluates detectors across diverse attack types and finds that no single detector achieves robust performance against all attacks, underscoring the difficulty of building universally robust defenses. Our work focuses on the attack side of this arms race to quantify the current robustness gap and motivate the development of stronger defensive strategies. 2.3 Reinforcement Learning for Text Generation Reinforcement learning from human feedback (RLHF) [ 16 ] has become the standard approach for aligning language models with human preferences. Proximal Policy Optimization (PPO) [ 19 ] was the original RL algorithm used for RLHF, but recent work has introduced more efficient alternatives. Group Relative Policy Optimization (GRPO) [ 17 , 20 ] eliminates the need for a separate value network by using group-level relative rewards, reducing memory requirements and enabling efficient training. Parameter-efficient fine-tuning methods, particularly LoRA [ 9 ] and QLoRA [ 5 ] , enable RL training of large language models with limited compute by adapting only low-rank weight matrices. StealthRL combines GRPO with LoRA on Qwen3-4B-Instruct, demonstrating that efficient RL fine-tuning suffices for learning effective evasion policies. 3 Method 3.1 Threat Model We consider an adversary who has produced AI-generated text and seeks to modify it to evade detection while preserving semantic content. Formally: • Attacker capability : Black-box

Read the complete text