AGENT-X: Adaptive Guideline-based Expert Network for Threshold-free AI-generated teXt detection
Jiatao Li, Mao Ye, Cheng Peng, Xunjian Yin, Xiaojun Wan · 2025
Read AGENT-X: Adaptive Guideline-based Expert Network for Threshold-free AI-generated teXt detection by Jiatao Li, Mao Ye, Cheng Peng, Xunjian Yin, Xiaojun Wan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15261.txt.
Introduction
Jiatao Li and four co-authors build a team of AI agents to spot machine-written text, in a 2025 arXiv paper. Most detectors need huge labeled sets and a hand-set cutoff, and they give no reasons for their calls. Their system, AGENT-X, works with no training examples and no cutoff. It draws its rules from classic rhetoric and from a school of language study that sorts text by job and style.
Specialist agents grade a text on meaning, style, and structure, each giving reasons and a confidence score. A meta agent weighs those grades by confidence to make the call. A router picks which rules fit each text's traits. Across data sets, the team reports gains in accuracy, clarity of reasoning, and reach over both trained and zero-shot rivals.
Catalog record
| CREATOR | Jiatao Li, Mao Ye, Cheng Peng, Xunjian Yin, Xiaojun Wan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15261
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AGENT-X: Adaptive Guideline-based Expert Network for Threshold-free AI-generated teXt detection Jiatao Li, Mao Ye, Cheng Peng, Xunjian Yin, Xiaojun Wan Abstract Existing AI-generated text detection methods heavily depend on large annotated datasets and external threshold tuning, restricting interpretability, adaptability, and zero-shot effectiveness. To address these limitations, we propose AGENT-X , a zero-shot multi-agent framework informed by classical rhetoric and systemic functional linguistics. Specifically, we organize detection guidelines into semantic, stylistic, and structural dimensions, each independently evaluated by specialized linguistic agents that provide explicit reasoning and robust calibrated confidence via semantic steering. A meta agent integrates these assessments through confidence-aware aggregation, enabling threshold-free, interpretable classification. Additionally, an adaptive Mixture-of-Agent router dynamically selects guidelines based on inferred textual characteristics. Experiments on diverse datasets demonstrate that AGENT-X substantially surpasses state-of-the-art supervised and zero-shot approaches in accuracy, interpretability, and generalization. 1 Introduction The rapid proliferation of texts generated by Large Language Models (LLMs) has intensified the challenge of distinguishing AI-generated content from authentic human writing Ippolito et al. (2020) ; Mitchell et al. (2023a) ; Su et al. (2023a) . Traditional detection approaches rely heavily on supervised classifiers trained with extensive labeled datasets and external threshold optimization Jawahar et al. (2020) ; Bakhtin et al. (2019) ; Yan et al. (2023) , severely limiting their interpretability, adaptability, and effectiveness in realistic zero-shot scenarios, where domain-specific calibration datasets are frequently unavailable Bao et al. (2024) ; Verma et al. (2024) . To address these fundamental limitations, we propose AGENT-X , a novel zero-shot multi-agent detection framework rooted in theories drawn from classical rhetoric and systemic functional linguistics Halliday (1978) ; Simpson (2004) . We first curate an extensive set of detection guidelines derived from academic literature and online communities, explicitly organizing them into semantic, stylistic, and structural linguistic dimensions. This structured theoretical foundation provides a clear, interpretable basis for distinguishing human-written texts from AI-generated content. As illustrated in Figure 1 , AGENT-X employs specialized LLM agents, each independently analyzing texts within their respective linguistic dimensions. These agents generate explicit classification decisions, detailed linguistic reasoning, and robustly calibrated confidence scores via semantic steering methods. Crucially, our framework introduces a meta agent that integrates these dimension-specific evaluations through a confidence-aware aggregation mechanism, eliminating the need for external threshold optimization and significantly enhancing interpretability and practical applicability. To effectively handle the diversity and complexity of real-world texts, we further incorporate a dynamic Mixture-of-Agent routing mechanism. This adaptive approach selects the most relevant linguistic guidelines based on inferred textual characteristics—such as topical domains and typical textual features—enabling AGENT-X to robustly address varied zero-shot detection scenarios. Moreover, we observe that although existing detection methods commonly report threshold-independent metrics such as AUROC, their practical deployment inherently necessitates selecting thresholds to translate predicted probabilities into actionable binary decisions. This external threshold calibration introduces variability and often leads to inconsistent and suboptimal accuracy performance in real-world applications. In contrast, our proposed multi-agent framework inherently circumvents these calibration challenges through its confidence-aware, threshold-free aggregation mechanism. Consequently, AGENT-X substantially improves accuracy, interpretability, and real-world applicability. Figure 1: Overview of AGENT-X. The router agent dynamically selects relevant linguistic agents, each generating robust, calibrated confidence scores via Confidence Steering. The meta agent aggregates these assessments to classify texts as human-written or AI-generated. Our contributions are as follows 1 1 1 Our code and curated guidelines will be released to facilitate future research. : • We introduce the first comprehensive, theoretically-grounded categorization of AI-generated text detection guidelines into explicit linguistic dimensions, enabling interpretable stylistic analysis. • We propose AGENT-X , a zero-shot multi-agent framework integrating adaptive guideline routing, explicit linguistic reasoning, and advanced semantic-steering confidence calibration, significantly outperforming existing supervised and zero-shot methods. • We demonstrate that our multi-agent framework effectively addresses the limitations of existing threshold-dependent methods, providing robust, interpretable, and practically applicable threshold-free classification in diverse real-world detection scenarios. 2 Stylistics and Authorship Attribution Stylistics, tracing its intellectual heritage back to classical rhetoric, literary criticism, and early linguistic theory Aristotle et al. (1954) ; Jakobson (1960) ; Halliday (1978) , has evolved into an empirically grounded linguistic discipline dedicated to the systematic investigation of textual style. The core objective of stylistics is to identify and analyze the distinctive linguistic patterns—such as lexical selections, syntactic structures, semantic preferences, and rhetorical devices—that constitute a text’s unique stylistic fingerprint and reveal insights about its author’s identity, intentions, and cognitive processes Simpson (2004) ; Short and Leech (2015) . These stylistic patterns have been consistently demonstrated to be stable across texts by the same author, making stylistics particularly powerful in authorship attribution tasks Holmes (1994) ; Juola et al. (2008) . Authorship Attribution as a Stylistic Task. Authorship attribution, historically rooted in literary scholarship Mosteller et al. (1964) ; Burrows (2002) ; Holmes (1994) , employs rigorous stylistic analysis to identify authors by systematically quantifying and comparing linguistic features across texts. Traditionally, this involves detecting cognitively distinctive and stylistically consistent markers unique to individual authors, ranging from lexical and syntactic choices to subtle rhetorical and semantic nuances Burrows (2002) ; Stamatatos (2009) . The emergence of advanced generative AI models, such as GPT-3 and GPT-4 Brown et al. (2020) ; OpenAI et al. (2024) , has expanded the scope of authorship attribution research, necessitating robust stylistic methodologies capable of differentiating between human-authored and AI-generated texts Ippolito et al. (2020) ; Mitchell et al. (2023a) . From this perspective, AI-generated text detection naturally maps onto the theoretical and methodological framework of authorship attribution, becoming a binary classification task distinguishing between human and AI authorship based on intrinsic stylistic indicators. Theoretical Foundations: Three Dimensions of Stylistics. A substantial body of classical and contemporary stylistics research identifies three foundational linguistic dimensions that collectively constitute textual style Halliday (1978) ; Simpson (2004) ; Short and Leech (2015) . These dimensions provide a comprehensive theoretical framework for analyzing authorship and differentiating between human-written and AI-generated texts. Below, we provide illustrative examples from our sampled stylistic detection guidelines, with the complete set detailed comprehensively in Appendix A : ⬇ |\ classbg { Semantic Dimension }| Directness of Claims and Nuanced Expertise Human - written : Makes direct , succinct claims without extensive hedging . AI - generated : Generally cautious , balanced , or neutral in making claims . … |\ classbg { Stylistic Dimension }| Precision and Conciseness Human - written : Concise , direct introduction of concepts . AI - generated : Balanced , explanatory , and carefully phrased . … |\ classbg { Structural Dimension }| Structural Uniformity and Rhythmic Predictability Human - written : Variable sentence structure and rhythm . AI - generated : Uniform , predictable , consistently structured . … The semantic dimension , grounded in Halliday’s systemic functional linguistics Halliday (1978) ; Halliday and Matthiessen (2013) , encompasses textual features related to meaning-making, conceptual complexity, thematic originality, and informational specificity. Such semantic traits reflect intricate cognitive processes and intellectual contributions that characterize human writing and differentiate it from mechanically generated text Halliday (1978) ; Eggins (2004) . The stylistic dimension , extensively explored by seminal stylisticians such as Leech, Short, and Simpson Short and Leech (2015) ; Simpson (2004) , addresses expressive nuances, lexical idiosyncrasies, cognitive friction, and subtle linguistic irregularities arising naturally from human cognitive limitations and creativity.