M-DAIGT: A Shared Task on Multi-Domain Detection of AI-Generated Text
Salima Lamsiyah, Saad Ezzini, Abdelkader El Mahdaouy, Hamza Alami, Abdessamad Benlahbib, Samir El Amrany, Salmane Chafik, Hicham Hammouchi · 2025
Read M-DAIGT: A Shared Task on Multi-Domain Detection of AI-Generated Text by Salima Lamsiyah, Saad Ezzini, Abdelkader El Mahdaouy, Hamza Alami, Abdessamad Benlahbib, Samir El Amrany, Salmane Chafik, Hicham Hammouchi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11340.txt.
Introduction
Salima Lamsiyah, Saad Ezzini, and their colleagues introduce M-DAIGT, a shared task on spotting AI-generated text across domains, with a focus on news articles and academic writing. Fluent machine text threatens information integrity and research honesty, so detectors need testing on shared, fair grounds. The task splits into two binary subtasks, one for news and one for academic writing.
The team built and released a benchmark of thirty thousand samples, balanced between human and machine text from varied modern models and prompting styles. Forty-six teams registered, and four submitted final results in both subtasks. Team methods are described, with future directions for the task sketched.
Catalog record
| CREATOR | Salima Lamsiyah, Saad Ezzini, Abdelkader El Mahdaouy, Hamza Alami, Abdessamad Benlahbib, Samir El Amrany, Salmane Chafik, Hicham Hammouchi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-11340
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
M-DAIGT: A Shared Task on Multi-Domain Detection of AI-Generated Text Salima Lamsiyah, Saad Ezzini, Abdelkader El Mahdaouy, Hamza Alami, Abdessamad Benlahbib, Samir El Amrany, Salmane Chafik, Hicham Hammouchi Abstract The generation of highly fluent text by Large Language Models (LLMs) poses a significant challenge to information integrity and academic research. In this paper, we introduce the Multi-Domain Detection of AI-Generated Text (M-DAIGT) shared task, which focuses on detecting AI-generated text across multiple domains, particularly in news articles and academic writing. M-DAIGT comprises two binary classification subtasks: News Article Detection (NAD) (Subtask 1) and Academic Writing Detection (AWD) (Subtask 2). To support this task, we developed and released a new large-scale benchmark dataset of 30,000 samples, balanced between human-written and AI-generated texts. The AI-generated content was produced using a variety of modern LLMs (e.g., GPT-4, Claude) and diverse prompting strategies. A total of 46 unique teams registered for the shared task, of which four teams submitted final results. All four teams participated in both Subtask 1 and Subtask 2. We describe the methods employed by these participating teams and briefly discuss future directions for M-DAIGT. 1 Introduction The recent advancements in large language models have created a paradigm shift in content generation 25 ; 8 . These models offer numerous opportunities to improve a wide range of applications, including academic research and journalism 9 . However, their powerful capabilities also raise critical concerns regarding the integrity of the information ecosystem 38 . In journalism, the potential for large-scale automated generation of misinformation and fake news represents a serious societal threat, with AI-generated articles already appearing on both mainstream and disinformation websites 38 ; 3 . In academia, LLMs challenge the fundamental principles of academic honesty 6 , and the accessibility of these tools has made it easier for students to generate ghostwritten assignments, contributing to a noticeable rise in academic misconduct 6 ; 12 . Research indicates that a significant number of students acknowledge using such tools for their coursework, making it increasingly difficult to distinguish between appropriate academic support and plagiarism 17 . Distinguishing AI-generated text from human writing is a non-trivial scientific challenge. Modern LLMs produce text that is grammatically correct, stylistically coherent, and often factually plausible, making it difficult to differentiate from human output 7 ; 35 ; 24 . Empirical studies have shown that humans, including experienced educators with high confidence in their judgment, perform only marginally better than random chance when attempting to distinguish AI-generated text from human-written content 35 . Moreover, recent detection approaches, such as entropy-based statistical methods 30 , syntactic pattern analysis 33 , and neural classifiers 14 ; 21 , show promise yet remain vulnerable to paraphrasing and prompt variation 28 ; 16 . The field is effectively locked in a technological "arms race": as detection tools improve, so do generative models and the methods used to evade them, including paraphrase attacks and text "humanizers" 38 ; 29 . Therefore, this rapidly evolving landscape underscores the need for ongoing research and rigorous evaluation methods for AI content detection. The motivation for advancing detection methodologies extends beyond a reactive approach aimed solely at identifying academic dishonesty. Rather, it serves as a proactive strategy to preserve the integrity of the digital information ecosystem. One key concern is the phenomenon of recursive degradation, where future language models may be trained on vast amounts of unlabeled AI-generated text collected from the internet. This process risks diminishing the quality, originality, and diversity of training data, potentially leading to a degradation of model performance over time 37 . Given that news articles and academic publications constitute essential sources of high-quality training data, maintaining their authenticity is crucial for ensuring the long-term robustness, reliability, and generalization capabilities of future AI systems. To address some of these challenges and to further encourage work on AI-generated text detection, we organized the Multi-Domain Detection of AI-Generated Text (M-DAIGT) shared task. M-DAIGT focuses on two domains where the authenticity of text is particularly vital: news articles and academic writing. Specifically, the task is structured into two binary classification subtasks: • Subtask 1. News Article Detection (NAD): Classifying news content as human-written or AI-generated. • Subtask 2. Academic Writing Detection (AWD): Classifying academic texts as human-written or AI-generated. The key contributions of this work are as follows: (1) the creation and public release of a large and diverse dataset of 30,000 samples specifically designed for AI-generated text detection in the domains of news and academia, featuring outputs from models like GPT-4 and Claude using varied prompts 37 ; and (2) a comprehensive analysis of participating systems that range from statistical methods to transformer-based detectors 21 ; 19 , offering insights into the current state-of-the-art and highlighting key challenges for future research. The remainder of this paper is organized as follows: Section 2 reviews related work in AI-generated text detection. Section 3 presents the dataset creation process and evaluation metrics. Section 4 presents the baseline and participant models, along with the evaluation methodology and results. Finally, Sections 5 and Limitations conclude the paper and discuss the limitations of the shared task. 2 Related Work AI-Generated Text Detection Methods. The detection of AI-generated text is a rapidly evolving research domain, with increasing attention due to the widespread development of large language models 38 . Several methods have been proposed for AI-generated text detection, which can be broadly classified into statistics-based methods, neural-based methods, watermarking, and the use of LLMs as detectors. Statistics-based approaches aim to exploit intrinsic differences in linguistic features between human and machine-generated texts. Early efforts, such as those 30 and 33 , leveraged entropy measures and n-gram frequency analysis to differentiate between text origins. 18 utilized sentence repetition patterns, noting that LLMs often assign high probability to repetitive content. DetectGPT 24 proposed a perturbation-based method to identify whether text lies in negatively curved regions of the log-likelihood landscape. Neural-based methods dominate recent advances in AI-generated text detection due to their high accuracy and adaptability. Early methods adopt fine-tuned models like BERT 10 and RoBERTa 31 . Furthermore, 14 demonstrated that training on outputs generated using diverse decoding strategies (e.g., top-k sampling, nucleus sampling, temperature control) significantly improves detection robustness. Recently, 21 proposed IRON, a robust adversarial training framework that improves resilience against attacks designed to evade detection systems. 15 introduced M-RangeDetector, which enhances model generalization via multi-range attention masks. Similarly, 19 provided feature-level interpretability through sparse autoencoders, offering insights into which patterns distinguish AI and human text. 34 combined reinforced sampling with LLM augmentation for improved fake news detection, while 3 extended neural classifiers to low-resource languages, specifically addressing Urdu fake news detection. These efforts reflect a growing focus on robustness, explainability, and multilingual applicability in neural detection research. Watermarking-based approaches offer proactive detection capabilities by embedding or identifying implicit signals in generated text. Early methods include synonym replacement, lexical substitution 22 ; 29 , and soft watermarking using curated token lists 16 . Hidden-space watermarking approaches 41 manipulate token-level probability vectors to introduce tamper-resistant signatures. Some methods, like 5 , aim to exploit surface-level word randomness as a trigger for detection. Recently, 28 proposed Paraphrase Inversion, a novel technique to counter paraphrase attacks that aim to remove watermark signals by recovering semantic