AuthorMist: Evading AI Text Detectors with Reinforcement Learning
Isaac David Arthur Gervais University College London · 2025
Read AuthorMist: Evading AI Text Detectors with Reinforcement Learning by Isaac David Arthur Gervais University College London (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08716.txt.
Introduction
Isaac David and Arthur Gervais build a system that rewrites AI-generated text so detectors judge it human. They frame detection as a privacy problem: people who write with AI help may be flagged unfairly. Writing in twenty twenty-five, their approach fine-tunes a mid-sized language model with reinforcement learning, using commercial detector services themselves as the scorekeepers. Each rewrite earns reward when detectors such as the ones named in the study rate it less machine-like. The loop teaches the model which edits fool the judges while keeping the meaning intact.
Across data sets and detectors, the tuned rewriter beat ordinary paraphrasing tools, succeeding in a large majority of attempts while keeping the rewritten text very close in meaning to the original. The authors use the result to question how long detector technology can stay ahead in this arms race.
Catalog record
| CREATOR | Isaac David Arthur Gervais University College London |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08716
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AuthorMist: Evading AI Text Detectors with Reinforcement Learning Isaac David Arthur Gervais University College London Abstract In the age of powerful AI-generated text, automatic detectors have emerged to identify machine-written content. This poses a threat to author privacy and freedom, as text authored with AI assistance may be unfairly flagged. We propose AuthorMist , a novel reinforcement learning-based system to transform AI-generated text into human-like writing. AuthorMist leverages a 3-billion-parameter language model as a backbone, fine-tuned with Group Relative Policy Optimization (GPRO) to paraphrase text in a way that evades AI detectors. Our framework establishes a generic approach where external detector APIs (GPTZero, WinstonAI, Originality.ai, etc.) serve as reward functions within the reinforcement learning loop, enabling the model to systematically learn outputs that these detectors are less likely to classify as AI-generated. This API-as-reward methodology can be applied broadly to optimize text against any detector with an accessible interface. Experiments on multiple datasets and detectors demonstrate that AuthorMist effectively reduces the detectability of AI-generated text while preserving the original meaning. Our evaluation shows attack success rates ranging from 78.6% to 96.2% against individual detectors, significantly outperforming baseline paraphrasing methods. AuthorMist maintains high semantic similarity (above 0.94) with the original text while successfully evading detection. These results highlight limitations in current AI text detection technologies and raise questions about the sustainability of the detection-evasion arms race. 1 Introduction The rise of large language models (LLMs) capable of producing human-like text has led to increased use of AI assistants in writing. Students, content creators, and professionals now often rely on AI-generated drafts for efficiency. However, this has spurred the development of AI text detectors – tools that attempt to distinguish AI-written text from human-written text. Systems like GPTZero and WinstonAI claim high accuracy in flagging machine-generated content [ 27 , 30 ] . Their widespread use in education and publishing poses a challenge to authorship privacy: an author who uses AI assistance might be unfairly scrutinized or penalized if their text is marked as “AI-generated.” This encroaches on author freedom and could discourage beneficial uses of AI in writing. Recent studies have shown that current detectors are far from foolproof. Detectors often rely on statistical signatures of AI text (e.g., likelihood under a language model or the presence of out-of-distribution tokens). Yet, even simple transformations to the text can significantly degrade detector performance. For example, adding extraneous spaces, introducing misspellings, or replacing characters with look-alike symbols can drop detection accuracy by over 30%. Paraphrasing the content in different words can often render AI-generated text “undetectable” to many models [ 20 ] . This cat-and-mouse dynamic highlights a need for robust methods to evade detection, both to test detector reliability and to empower users to protect their privacy. In this paper, we introduce AuthorMist , a reinforcement learning (RL) approach to automatically disguise AI-generated text as human-written. Rather than relying on crude text perturbations, AuthorMist learns a policy to paraphrase text into a more human-like style while preserving its meaning. We use RL with external AI detectors in a loop: the model is rewarded when the output text is rated as human-written by detectors. Over time, the model learns to produce texts that systematically fool detectors into low “AI likelihood” scores. Our contributions are as follows: • We formulate the evasion of AI text detectors as a reinforcement learning problem. We pioneer a novel “API-as-reward” methodology, being the first to integrate external detector APIs directly into the reinforcement learning loop with Group Relative Policy Optimization (GRPO) [ 22 ] for NLP tasks. • Our system, AuthorMist, is designed and built on a 3B-parameter Transformer model fine-tuned with this innovative approach. • We thoroughly evaluate AuthorMist on benchmark datasets of AI-generated text. We test against popular blackbox detectors (GPTZero, WinstonAI, Originality.ai, Sapling) and popular open-source models (HelloSimpleAI [ 8 ] and OpenAI’s Roberta Detector [ 25 ] ). Results show AuthorMist dramatically reduces detection rates compared to baseline AI text, outperforming conventional paraphrasers. 2 Background 2.1 AI Text Detectors and Adversarial Evasion The concern over machine-generated misinformation and academic dishonesty has led to a proliferation of AI text detectors . These tools use various strategies to identify telltale signs of AI authorship. Some detectors are neural classifiers trained on human vs. AI text examples (e.g., fine-tuned RoBERTa models), while others use statistical metrics like entropy or perplexity (e.g., GLTR [ 5 ] and DetectGPT [ 16 ] ). Commercial services such as GPTZero [ 27 ] and WinstonAI [ 30 ] combine multiple features and claim high accuracy and precision. For instance, GPTZero has been noted for its robustness to character-level attacks, and WinstonAI advertises > 99% accuracy on certain benchmarks. Perplexity, in particular, has emerged as a key statistical signature that differentiates AI-generated from human-written text. AI-generated content typically exhibits lower perplexity (higher predictability) than human writing, as language models tend to produce more statistically likely token sequences. This predictability pattern is a common detection vector that many AI text detectors exploit. Human writing, in contrast, often contains more surprising word choices and unusual constructions, resulting in higher perplexity scores. Despite these claims, detectors are inherently engaged in an arms race with generation methods. Researchers have demonstrated that even straightforward adversarial attacks can significantly lower detector confidence. Creo et al. (2024) [ 1 ] showed that inserting innocuous Unicode homoglyphs or random punctuation can break detectors, causing their performance to degrade sharply. In academic contexts, Perkins et al. [ 20 ] evaluated six major detectors and found their average accuracy (already a modest 39.5%) dropped to 17.4% when faced with texts lightly modified to evade detection. A study from Google Research (Krishna et al. , 2023) [ 11 ] introduced a paraphrasing model called Dipper that rewrote AI text and was able to bypass many detectors nearly universally. Dipper demonstrated impressive evasion capabilities, reducing DetectGPT’s detection accuracy from 70.3% to just 4.6% at a constant false positive rate of 1%. However, Dipper relies on a one-step paraphrasing approach rather than an iterative optimization process, potentially limiting its ability to adapt to evolving detection methods. These so-called “AI humanizer” tools have proliferated online [ 15 ] , offering students and writers the means to automatically transform AI outputs to evade detection. However, naive adversarial tricks often come at the cost of readability or fidelity. Text with missing articles or odd spellings might evade an algorithm yet appear obviously flawed to a human reader. What is needed is a method to paraphrase AI content into a form that both preserves its meaning and appears human-crafted and natural in style. This is a non-trivial task: it requires altering the subtle statistical signature of the text without introducing errors or unnatural phrasing. Semantic preservation is particularly challenging, as even small changes in wording can significantly alter meaning, especially in technical or specialized domains. 2.2 Reinforcement Learning in Text Generation Reinforcement learning has emerged as a powerful paradigm to fine-tune language models for objectives that are difficult to express with direct supervision. RL from human feedback (RLHF) has been used to align LLMs with human preferences, using methods like Proximal Policy Optimization (PPO) [ 21 ] to adjust a model based on reward signals from human evaluators or