T-Detect: Tail-Aware Statistical Normalization for Robust Detection of Adversarial Machine-Generated Text

Alva West, Luodan Zhang, Liuliu Zhang, Minjun Zhu, Yixuan Weng, Yue Zhang · 2025

Read T-Detect: Tail-Aware Statistical Normalization for Robust Detection of Adversarial Machine-Generated Text by Alva West, Luodan Zhang, Liuliu Zhang, Minjun Zhu, Yixuan Weng, Yue Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23577.txt.

Introduction

Alva West and five co-authors present T-Detect, in a 2025 preprint, a sturdier detector for machine-written text that has been tampered with. Paraphrasing and other attacks bend a text's statistics into heavy-tailed shapes. Curvature-based detectors that assume tidy bell curves then misfire. The authors swap the bell curve for a Student's t-distribution, built for fat tails. The score compares a passage's log-likelihood against that distribution's expected moments. Texts from non-native writers also show the fat-tail trait, so the fix helps beyond attack settings.

On a hard adversarial benchmark and a broad second dataset, T-Detect beat strong baselines. Gains in ranking quality reached a few points in targeted domains. Plugged into a two-part detection framework, it set the best mark on the books domain of the adversarial set. Ablation tests support each design choice. Code is public for verification.

Catalog record

CREATORAlva West, Luodan Zhang, Liuliu Zhang, Minjun Zhu, Yixuan Weng, Yue Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23577

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

T-Detect: Tail-Aware Statistical Normalization for Robust Detection of Adversarial Machine-Generated Text Alva West, Luodan Zhang, Liuliu Zhang, Minjun Zhu, Yixuan Weng, Yue Zhang Abstract The proliferation of sophisticated text generation models necessitates the development of robust detection methods capable of identifying machine-generated content, particularly text designed to evade detection through adversarial perturbations. Existing zero-shot detectors often rely on statistical measures that implicitly assume Gaussian distributions, a premise that falters when confronted with the heavy-tailed statistical artifacts characteristic of adversarial or non-native English texts. This paper introduces T-Detect, a novel detection method that fundamentally redesigns the statistical core of curvature-based detectors. Our primary innovation is the replacement of standard Gaussian normalization with a heavy-tailed discrepancy score derived from the Student’s t-distribution. This approach is theoretically grounded in the empirical observation that adversarial texts exhibit significant leptokurtosis, rendering traditional statistical assumptions inadequate. T-Detect computes a detection score by normalizing the log-likelihood of a passage against the expected moments of a t-distribution, providing superior resilience to statistical outliers. We validate our approach on the challenging RAID benchmark for adversarial text and the comprehensive HART dataset. Experiments show that T-Detect provides a consistent performance uplift over strong baselines, improving AUROC by up to 3.9% in targeted domains. When integrated into a two-dimensional detection framework (CT), our method achieves state-of-the-art performance, with an AUROC of 0.926 on the Books domain of RAID. Our contributions are a new, theoretically-justified statistical foundation for text detection, an ablation-validated method that demonstrates superior robustness, and a comprehensive analysis of its performance under adversarial conditions. Ours code are released at https://github.com/ResearAI/t-detect . WARNING : We hereby declare that ours AI SCIENTIST system performed approximately 95% of the work presented in this paper. This includes the initial ideation, the design and execution of comparative experiments, the analysis of results, the literature review, the composition of the manuscript, the creation of the main figures, and the organization of the accompanying code repository. The role of the human authors was to supervise the AI’s operations. While we have diligently worked to minimize AI hallucinations and ensure the validity of the experimental results, we cannot fully guarantee against potential unintended outputs, system failures, or misleading conclusions. We therefore advise readers to approach this work with caution and to critically evaluate its findings before application. 1 Introduction The rise of powerful large language models (LLMs) ( Ouyang et al. 2022 ; Yang et al. 2025 ) has ignited a critical arms race between text generation and detection ( You et al. 2023 ; Moraffah et al. 2024 ) . While these models fuel innovation, they also carry risks like misinformation and academic dishonesty, making reliable detection essential ( Kumarage et al. 2024 ) . However, this is not a static battlefield. A more dangerous front has opened: malicious actors are no longer just using LLMs, but are actively studying our detectors to craft adversarial attacks that can evade them ( You et al. 2023 ; Lee et al. 2023 ) . These evolving strategies, from simple paraphrasing to subtle manipulations ( Li 2024 ) , demand a new generation of detectors built not just for accuracy, but for fundamental resilience. The vulnerability of many current zero-shot detectors lies not on the surface, but deep in their statistical core. Leading methods like DetectGPT ( Mitchell et al. 2023 ) and Fast-DetectGPT ( Bao et al. 2023 ) are built on a seemingly innocuous assumption: that their statistical scores follow a standard bell curve, or Gaussian distribution ( Rousseeuw & Hubert 2011 ) . This is their Achilles’ heel. Our empirical analysis reveals that adversarial texts are designed to break this premise. They produce score distributions with extreme outliers, resulting in "heavy-tailed" statistical properties ( Dugan et al. 2024 ) . The critical research problem, therefore, is that this violation of the Gaussian assumption makes detectors catastrophically sensitive to adversarial attacks, causing their performance to become unstable and unreliable. When faced with the very texts they are designed to catch, their statistical foundation crumbles. To this end, we introduce T-Detect, a novel method that redesigns the detector’s statistical core by replacing the flawed Gaussian assumption with a robust, "tail-aware" normalization based on the Student’s t-distribution. This single, principled change is grounded in robust statistics ( Rousseeuw & Leroy 2005 ) and allows our method to gracefully handle the statistical outliers common in adversarial text without being destabilized. By computing a "heavy-tailed discrepancy score," T-Detect provides an inherently more stable and reliable signal for distinguishing human from machine-generated text. We validate T-Detect through a comprehensive suite of experiments, demonstrating its practical advantages. As summarized in Figure 1 , T-Detect offers a superior trade-off between performance and computational efficiency compared to strong baselines. On the challenging RAID benchmark for adversarial text, our method, particularly when integrated into a two-dimensional (CT) framework ( Bao et al. 2025 ) , achieves state-of-the-art performance with an overall AUROC of 0.876. Our contributions are threefold: (1) We are the first to empirically prove that adversarial text detection scores follow heavy-tailed distributions and propose a theoretically-justified t-distribution-based normalization to address this. (2) We present an ablation-validated method that demonstrates superior robustness and performance on adversarial benchmarks. (3) We provide a comprehensive analysis of our method’s practical benefits, including its computational stability and exceptional hyperparameter robustness, offering a more reliable and deployable solution for AI safety. Figure 1: The ’ALL’ Performance (AUROC) vs. Speed (Throughput) on the RAID benchmark. T-Detect consistently provides a better Pareto frontier, offering higher performance for its computational cost. In the two-dimensional setting (c), CT(T-Detect) achieves state-of-the-art accuracy while being 1.8x faster than the competitive CT(Binoculars) baseline. 2 Related Work The task of distinguishing machine-generated text from human-written content has evolved significantly, moving from early statistical methods to sophisticated zero-shot classifiers. Early approaches focused on identifying statistical artifacts in generated text. For instance, methods based on simple metrics like likelihood, log-rank, and entropy ( Guo et al. 2023 ; Li et al. 2022 ) were proposed to capture the unusually predictable nature of text from older generative models ( Gehrmann et al. 2019 ) . A significant breakthrough came with the introduction of curvature-based detection by Mitchell et al. 2023 in their seminal work, DetectGPT. This method was the first to hypothesize that text sampled from a large language model tends to occupy regions of high negative curvature in the model’s log-probability space. DetectGPT estimated this curvature by generating numerous perturbations of a given text and measuring the average drop in log-probability, establishing a new paradigm for zero-shot detection that did not require a dedicated training dataset. Building on this foundation, subsequent research has focused on improving both the efficiency and accuracy of curvature-based methods. Our direct baseline, Fast-DetectGPT, was introduced by Bao et al. 2023 as a computationally efficient alternative to DetectGPT. It retains the core curvature hypothesis but replaces the costly perturbation step with a more efficient sampling-based approach to approximate the necessary statistics, achieving a significant speedup. Parallel to these developments, other zero-shot methods have emerged. Binoculars ( Hans et al. 2024 ) proposed a novel approach based on the cross-perplexity between two different language models, one acting as an "observer" and the other as a "performer." Another

Read the complete text