Reasoning-Aware AIGC Detection via Alignment and Reinforcement
Zhao Wang, Max Xiong, Jianxun Lian, Zhicheng Dou · 2026
Read Reasoning-Aware AIGC Detection via Alignment and Reinforcement by Zhao Wang, Max Xiong, Jianxun Lian, Zhicheng Dou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19172.txt.
Introduction
Wang and three colleagues present REVEAL, a tool for spotting AI-made content that first writes out clear reasoning chains, then judges them. They also build AIGC-text-bank, a multi-domain dataset spanning diverse language model sources and author cases. Training runs in two stages: supervised fine-tuning builds reasoning, then reinforcement learning lifts accuracy and logical consistency and cuts hallucinations. Tests show REVEAL reaches top performance across multiple benchmarks, giving a robust and transparent detection tool. The project is open source.
Catalog record
| CREATOR | Zhao Wang, Max Xiong, Jianxun Lian, Zhicheng Dou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50129 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19172
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reasoning-Aware AIGC Detection via Alignment and Reinforcement Zhao Wang, Max Xiong, Jianxun Lian, Zhicheng Dou Abstract The rapid advancement and widespread adoption of Large Language Models (LLMs) have elevated the need for reliable AI-generated content (AIGC) detection, which remains challenging as models evolve. We introduce AIGC-text-bank, a comprehensive multi-domain dataset with diverse LLM sources and authorship scenarios, and propose REVEAL, a detection framework that generates interpretable reasoning chains before classification. Our approach uses a two-stage training strategy: supervised fine-tuning to establish reasoning capabilities, followed by reinforcement learning to improve accuracy, improve logical consistency, and reduce hallucinations. Extensive experiments show that REVEAL achieves state-of-the-art performance across multiple benchmarks, offering a robust and transparent solution for AIGC detection. The project is open-source at https://aka.ms/reveal 1 Introduction The rapid advancement of Large Language Models (LLMs) has ushered in an era where AI-generated content (AIGC) is increasingly pervasive and often indistinguishable from human writing. As models approach human-level fluency and coherence 2 , the ability to reliably discern machine-authored text becomes critical for maintaining integrity across numerous domains. Beyond academic publishing—where undisclosed AIGC threatens to undermine the authenticity of research papers and peer reviews 20 ; 25 —AIGC detection is equally crucial in domains like telecommunications fraud prevention, where malicious actors deploy AI to impersonate humans 6 . A robust, reliable AIGC detector thus serves as an essential safeguard, enabling verification of authorship and upholding trust in digital communications. Existing approaches to AIGC detection have largely relied on statistical classifiers 24 ; 14 or black-box neural models 15 , which often exploit surface-level patterns and struggle to generalize as LLMs evolve 8 . While benchmarks such as M4 29 and LOKI 34 have broadened the scope of evaluation, their data scale remains limited compared to real-world requirements and often fails to include outputs from the latest state-of-the-art models. In this work, we aim to consolidate and advance the field of AIGC detection by introducing a more comprehensive benchmark and a reasoning-driven detector that generalizes effectively to evolving generative technologies. To support this goal, we construct AIGC-text-bank , a large-scale, multi-domain dataset that includes authentic human writing, fully machine-generated (AI-Native) text, and human-authored text polished by AI (AI-Polish). Our corpus is sourced from 10 diverse domains and generated using 12 different LLMs—including the latest proprietary and open-weight models—providing a realistic and challenging testbed for detecting authorship in both pure and hybrid scenarios. Its parallel structure ensures that each human reference is paired with AI-generated counterparts, enabling controlled comparisons and finer-grained analysis. We further introduce REVEAL (Reasoning-Enhanced Verification and Evaluation for AI Language), a novel framework that shifts detection from opaque classification to transparent, reasoning-based decision-making. REVEAL is trained in two stages: first, supervised fine-tuning (SFT) initializes the model by distilling concise and effective rationales from OpenAI o3, serving as an imitation learning phase; then, reinforcement learning (RL) extends these capabilities by refining reasoning chains to improve logical consistency, reduce hallucinations, and ultimately surpass the teacher model’s performance. By explicitly modeling the Think-then-Answer process, our approach not only achieves high accuracy but also provides interpretable evidence for each prediction. Extensive experiments across five benchmarks demonstrate that REVEAL outperforms existing black-box detectors and general-purpose LLMs in both binary and fine-grained settings, while maintaining strong generalization under domain shift and adversarial challenges. In summary, our contributions are threefold: • We construct and will release AIGC-text-bank , a large-scale, multi-domain dataset featuring state-of-the-art LLM outputs, providing a comprehensive training resource as well as a benchmark for AIGC detection research. • We propose REVEAL , a reasoning-driven detection framework that combines SFT and RL to produce accurate and interpretable authorship judgments. • We conduct extensive experiments showing that our method sets a new state of the art in generalization and fine-grained discrimination, providing a trustworthy foundation for real-world AIGC detection. 2 Methodology Figure 1: The Overall Framework As LLMs rapidly advance, traditional AIGC detectors relying on superficial statistical cues (e.g., log-likelihood 24 , entropy 14 ) become increasingly inadequate, especially in complex, real-world scenarios like AI-Polished content. To address this, we pursue three goals: developing an interpretable LLM-based detector that distinguishes AI from human text with reasoning; extending detection to differentiate AI-Native , AI-Polished , and Human content ; and enabling predictive uncertainty estimation . Our methodology constructs a comprehensive, multi-scenario dataset and employs a two-stage training framework of supervised fine-tuning and reinforcement learning to build a detector capable of robust, human-readable reasoning. 2.1 Dataset Construction Table 1: Statistics of the AIGC-text-bank dataset. Samples Total Tokens #.LLMs Human 66,979 22,535,085 - AI-Native 699,052 195,392,025 12 AI-Polish 732,248 205,644,529 12 Existing datasets for AIGC detection often suffer from two critical limitations: they fail to include content generated by the latest state-of-the-art LLMs (e.g., GPT-5), and they overlook the nuanced paradigm of human-AI collaborative writing. To bridge this gap, we construct AIGC-text-bank , a comprehensive multi-domain and multi-LLM dataset designed to enhance detector capabilities in real-world human-AI text discrimination. It is structured as a parallel corpus where each human-written document is paired with corresponding AI-generated counterparts. As illustrated in Figure 1 , the construction pipeline encompasses three distinct text categories: authentic human writing, fully AI-generated text ( AI-Native ), and human-authored text refined by AI ( AI-Polish ). Human Data Collection To establish a robust human baseline, we collect 66,979 authentic human-written documents across 10 diverse domains, including academic papers, social discussions, encyclopedic entries and literature. This diversity ensures extensive coverage of various linguistic styles and structural formats. To mitigate the risk of inadvertently including AI-generated text, we source documents published strictly before the release of ChatGPT (November 30, 2022), thereby establishing a temporal cutoff prior to the widespread public use of advanced, human-like language models. More details about the human subset are provided in the Appendix A.1 . Generator Models To mitigate architectural inductive biases and capture a broad stylistic spectrum, we employ a diverse ensemble of LLMs varying in parameter scales and performance profiles. Specifically, our generator pool includes state-of-the-art proprietary models (e.g., GPT-5, Grok-4), representative open-source models (e.g., DeepSeek R1, Llama 3.3, Qwen 3, and Phi-4) and legacy models (e.g., GPT-2) to capture the evolutionary trajectory of generative styles. These models serve as the backbone for synthesizing both AI-Native and AI-Polish subsets. We provide the full list of models and details in Appendix A.2 . AI-Native Generation We propose a semantically aligned reconstruction pipeline to separate intrinsic linguistic signatures from surface-level topical differences. To ensure the synthetic content remains grounded in real-world contexts, we employ GPT-4o to extract structured meta-attributes from the human reference corpus. For each document, GPT-4o distills a concise thematic summary (e.g., topic, key points) and, where pertinent, a profile of its linguistic style (e.g., formal, narrative, conversational). This transformation preserves the domain diversity of the original data while providing a controlled framework for synthesis. Leveraging these meta-attributes, we task the aforementioned 12 generator models with producing content that adheres strictly to the specified topics and writing styles. In this process, we implement two strategic constraints to ensure both the fairness and the complexity of the dataset. First, we strictly align the output length with human references to eliminate length as a confounding variable. Furthermore, to simulate real-world scenarios and increase the classification difficulty, we introduce