FAID: F ine-Grained AI -Generated Text D etection Using Multi-Task Auxiliary and Multi-Level Contrastive Learning
Minh Ngoc Ta, Dong Cao Van, Duc-Anh Hoang, Minh Le-Anh, Truong Nguyen, My Anh Tran Nguyen, Yuxia Wang, Preslav Nakov, Dinh Viet Sang · 2025
Read FAID: F ine-Grained AI -Generated Text D etection Using Multi-Task Auxiliary and Multi-Level Contrastive Learning by Minh Ngoc Ta, Dong Cao Van, Duc-Anh Hoang, Minh Le-Anh, Truong Nguyen, My Anh Tran Nguyen, Yuxia Wang, Preslav Nakov, Dinh Viet Sang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14271.txt.
Introduction
Minh Ngoc Ta and co-authors present FAID in a 2025 paper on telling apart human, machine, and mixed writing. Joint work between people and models blurs the line past what two-way sorters can handle. The team first built a dataset that spans many languages, fields, and model families.
FAID sorts text into the three classes and also names which model family wrote the machine parts. It learns fine style cues through layered contrast tasks plus side tasks. Tests show it beats past sorters, in large part on new fields and new models it had not seen in training.
Catalog record
| CREATOR | Minh Ngoc Ta, Dong Cao Van, Duc-Anh Hoang, Minh Le-Anh, Truong Nguyen, My Anh Tran Nguyen, Yuxia Wang, Preslav Nakov, Dinh Viet Sang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14271
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FAID: F ine-Grained AI -Generated Text D etection Using Multi-Task Auxiliary and Multi-Level Contrastive Learning Minh Ngoc Ta, Dong Cao Van, Duc-Anh Hoang, Minh Le-Anh, Truong Nguyen, My Anh Tran Nguyen, Yuxia Wang, Preslav Nakov, Dinh Viet Sang Abstract The growing collaboration between humans and LLMs in generative tasks has introduced new challenges in distinguishing between human-written , LLM-generated , and human–LLM collaborative texts. In this work, we collect a multilingual, multi-domain, multi-generator dataset FAIDSet . We further introduce a fine-grained detection framework, FAID , to classify text into these three categories and to identify the underlying LLM family of the generator. Unlike existing binary classifiers, FAID is built to capture both authorship and model-specific characteristics. Our method combines multi-level contrastive learning with multi-task auxiliary classification to learn subtle stylistic cues. By modeling LLM families as distinct stylistic entities, we adapt to address distributional shifts without retraining on unseen data. Our results demonstrate that FAID outperforms several baselines, particularly improving generalization accuracy across unseen domains and new LLMs, offering a potential solution to improve transparency and accountability in AI-assisted writing. Our data and code are available at https://github.com/mbzuai-nlp/FAID * * footnotetext: Equal contribution. 1 Introduction LLMs have evolved from an assistant tool to a creator or initiator, from helping polish papers to initiating proposals and drafting essays, while humans increasingly serve as optimizers and reviewers. In such deeply collaborative human–LLM settings, measuring human contribution becomes challenging, yet clarifying authorship is critical for accountability and transparency, particularly in educational and academic contexts Wang et al. (2025) . This work aims to identify human involvement by distinguishing the origin of a given text (in a multilingual context): (a) fully LLM-generated, (b) fully human-written, or (c) collaboratively produced. Numerous studies have explored multilingual LLM-generated text detection, but most have focused either on binary detection, i.e., human vs. LLM Wang et al. (2024e) ; Wang et al. (2024d) ; Su et al. (2023) or on fine-grained detection limited to English Abassy et al. (2024) ; Koike et al. (2024) ; Wang et al. (2023) ; Zhang et al. (2024) . Moreover, both struggle with generalization to unseen domains, languages, and LLM generators Wang et al. (2024c) ; Li et al. (2024) . Our work aims to bridge this gap by ( i ) collecting a multilingual, multi-domain, and multi-generator dataset, FAIDSet, for fine-grained detection, i.e., identifying a text into three categories: LLM-generated , human-written , and human–LLM collaborative , and ( ii ) introducing a framework FAID to improve generalization performance. Our dataset FAIDSet 1 1 1 https://huggingface.co/datasets/ngocminhta/FAIDSet focuses on the academic field, including paper abstracts, student theses, and reports, and contains generation by a variety of families of LLMs, e.g., GPT, Gemini, DeepSeek, and Llama OpenAI (2024) ; Gemini Team (2024) ; DeepSeek-AI (2025) ; Dubey et al. (2024) . Our detection framework, FAID, treats each LLM as a distinct author, learning specific features in the hidden space to differentiate different authors, instead of classifying based on hand-crafted stylistic features. We achieve this by optimizing a language encoder with multi-level author relationship (e.g., the stylistic similarity between texts from the same LLM family is greater than that between a human and an LLM) to capture author-specific distinguishable signals of an input text using contrastive learning, along with the task of fine-tuning a classifier to recognize the input text’s origin. This multitask learning process forces the encoder to reorganize the hidden space so that the representations of texts by the same authors are distributed closer together than those by different authors. In practice, given that generations produced by LLMs from the same company tend to have similar writing styles due to similar model architecture, training data, and training strategy (see Appendix D for more detail), we consider each LLM family as an “author.” This can also help the detector acquire prior knowledge of future LLMs from the same company. Our experiments show that FAID consistently outperforms other baseline detectors in both in-domain and out-of-domain evaluations. Our contributions can be summarized as follows: • We collect a new multilingual, multi-domain, multi-generator dataset for fine-grained LLM-generated text detection with 83,350 examples. • We propose a detection framework, FAID, to improve generalization performance in unseen domains and generators by capturing subtle stylistic features in the hidden representation. • We show that FAID outperforms baseline detectors, particularly in unseen domains and with unseen generators. Meanwhile, the nature of FAID allows us to assess the stylistic proximity of a given text to other texts in our database, each labeled with ground-truth authorship labels. 2 Background and Related Work Advancements in LLMs have fundamentally reshaped the process of text production and refinement. Rather than originating every word independently, people increasingly assume the role of post-editors or reviewers, intervening after an LLM has generated an initial draft. This collaborative paradigm extends across diverse domains, including academic publishing, journalism, education, and social media, thus making hybrid human–AI authorship an emerging norm Cheng et al. (2025) ; Lee et al. (2022) . Such a shift calls into binary authorship detection: human vs. AI. Texts can be fully human-written , fully AI-generated , or collaborative text (e.g., human-written, AI-polished ; AI-generated, human-edited ; and deeply mixed ) Artemova et al. (2025) . Addressing these concerns requires fine-grained authorship detection, even tracing it back to a specific LLM family, to assess the extent of human contribution Hutson (2025) . Ensuring transparent disclosure of LLM involvement is critical to upholding research integrity and honesty. In response to these challenges, we collect a new dataset, FAIDSet, and propose a detection framework, FAID, which generalizes well to new domains, languages, and models, achieving consistently high accuracy and reliability. 2.1 Fine-Grained AI-generated Text Datasets Many prior studies have explored fine-grained AI-generated text datasets across various forms of human–AI collaboration, e.g., MixSet ( Zhang et al., 2024 ) and Beemo ( Artemova et al., 2025 ) . See Appendix A for a discussion of more datasets and detailed information regarding the label space, and the coverage of domains, languages, and LLMs for each one. However, all these studies were limited to English. A substantial gap remains in the availability of large-scale, fine-grained multilingual LLM-generated text detection datasets. To bridge this gap, we collect a multilingual fine-grained LLM-generated text detection dataset, which encompasses 83k texts generated by the latest LLMs and includes diverse forms of human–LLM collaborative generations. This dataset can facilitate the development of more robust and generalizable detection models that are capable of handling complex multilingual collaborative scenarios. 2.2 Generalization of LLM-Generated Text Detection A recent study, M4GT-Bench, Wang et al. (2024c) has highlighted a persistent challenge for both binary and fine-grained AI-generated text detection: poor generalization to unseen domains, languages, and generators. Many detection methods have shown a significant drop in performance on out-of-distribution data, underscoring the difficulty of building robust detectors for real-world scenarios and evolving LLM outputs. Various approaches have been proposed to improve generalization. OUTFOX Koike et al. (2024) leveraged adversarial in-context learning to dynamically generate challenging examples that enhance robustness, but still faced limitations in domain transferability and computational efficiency. LLM-DetectAIve Abassy et al. (2024) adopted fine-grained classification and incorporated domain-adversarial training to reduce overfitting; however, its generalization to unseen domains and generators remains