Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detection

Jiatao Li, Xiaojun Wan · 2025

Read Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detection by Jiatao Li, Xiaojun Wan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12611.txt.

Introduction

Jiatao Li and Xiaojun Wan test whether author traits bias AI text detectors in a 2025 paper. Detectors for machine written text are now widely used, but most work ignores who the human author is. The authors ask how gender, language proficiency level, academic field, and language environment affect detector accuracy.

They used a corpus of human written texts with parallel AI generated texts from several large language models. Multi factor analysis and weighted regression measured each trait effect across state of the art detectors. Proficiency and language environment consistently shifted accuracy, while gender and field effects varied by detector. The findings argue for socially aware detection that avoids unfairly penalizing some groups.

Catalog record

CREATORJiatao Li, Xiaojun Wan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12611

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detection Jiatao Li, Xiaojun Wan Abstract The rise of Large Language Models (LLMs) necessitates accurate AI-generated text detection. However, current approaches largely overlook the influence of author characteristics. We investigate how sociolinguistic attributes—gender, CEFR proficiency, academic field, and language environment—impact state-of-the-art AI text detectors. Using the ICNALE corpus of human-authored texts and parallel AI-generated texts from diverse LLMs, we conduct a rigorous evaluation employing multi-factor ANOVA and weighted least squares (WLS). Our results reveal significant biases: CEFR proficiency and language environment consistently affected detector accuracy, while gender and academic field showed detector-dependent effects. These findings highlight the crucial need for socially aware AI text detection to avoid unfairly penalizing specific demographic groups. We offer novel empirical evidence, a robust statistical framework, and actionable insights for developing more equitable and reliable detection systems in real-world, out-of-domain contexts. This work paves the way for future research on bias mitigation, inclusive evaluation benchmarks, and socially responsible LLM detectors. 1 Introduction Figure 1: Research workflow: ICNALE data and LLM-generated text with author attributes are used for out-of-domain evaluation of AI text detectors and subsequent bias analysis using multi-factor ANOVA and weighted OLS. Large Language Models (LLMs) have transformed the way we produce and consume written communication, driving remarkable advancements in text generation across a wide array of domains. From social media content moderation to automated report writing in academia, the breadth and sophistication of these models have brought renewed focus to a pressing challenge: detecting AI-generated text. Although recent efforts have expanded detection benchmarks to include multiple LLMs, multilingual settings, and adversarial perturbations ( Tao et al., 2024 ; Dugan et al., 2024 ; Li et al., 2024 ; Wang et al., 2024 ) , the human dimension of text production has received far less scrutiny. Traditional detection pipelines predominantly center on model-level and data-centric strategies—e.g., sampling, prompting, and adversarial augmentation—while overlooking social and linguistic factors tied to the authors themselves. Yet decades of sociolinguistic and applied linguistics research underscore that writing style varies systematically by gender, language proficiency, disciplinary norms, and cultural context ( Hyland, 2000 ; Lantolf, 2000 ; Long, 1996 ) . Such differences manifest in vocabulary choices, syntactic complexity, and rhetorical conventions, which can inadvertently bias AI text detectors if not carefully addressed. For example, non-native speakers or lower-proficiency writers might be wrongly flagged as AI-generated due to errors or unidiomatic expressions that differ from native-level training data. Conversely, sophisticated second-language learners might produce polished texts that resemble those generated by larger LLMs, thereby complicating detection efforts. In the absence of benchmarks that account for such diversity, existing detectors risk disproportionately penalizing particular demographic or educational groups. Motivated by this gap, we pose the question: “Who is writing?” Specifically, we investigate whether and how author-level attributes—including gender, Common European Framework of Reference (CEFR) proficiency, academic field, and language environment (e.g., native vs. EFL/ESL)—systematically influence AI (or AI-generated) text detection outcomes. To this end, we craft a comprehensive end-to-end analysis. First, we source human-authored texts with rich metadata from the ICNALE corpus, a well-established learner corpus that spans multiple Asian regions and diverse proficiency levels ( Ishikawa, 2013 ) . Next, we generate parallel AI-written texts using a range of modern LLMs (e.g., Qwen, LLaMA, Mistral). We then evaluate cutting-edge off-the-shelf detectors under out-of-domain conditions—a scenario closely mirroring real-world deployments where detectors must generalize beyond their training distributions. Figure 1 offers a concise overview of our end-to-end methodology, culminating in an out-of-domain evaluation that mirrors real-world use cases. Our findings, drawn from rigorous t -tests and ANOVA analyses, show that CEFR proficiency level and language environment exert consistent and sizable effects on detection accuracy across nearly all detectors. By contrast, gender- and academic field-related biases tend to be more detector-dependent, with some models demonstrating marked variability and others remaining largely agnostic. These results suggest a strong need to incorporate demographic and linguistic attributes into AI text detection benchmarks and training protocols. Without doing so, state-of-the-art detectors are liable to unfairly penalize certain writer populations or misclassify legitimate texts. In summary, our work highlights the human-centered challenges that arise when AI text detection collides with real-world diversity. By shifting the focus toward the people behind the text, we aim to catalyze a broader conversation on socially responsible model development, enhanced debiasing strategies, and inclusive evaluation frameworks. We hope that this renewed emphasis will pave the way for fairer, more robust, and ultimately more trustworthy detection systems. Our contributions are as follows 1 1 1 Our code and data are released at https://github.com/leejamesss/AuthorAwareDetection to facilitate related research. : • We introduce a 67K-text dataset that combines human-authored ICNALE essays with parallel AI outputs from 12 modern LLMs, each labeled with detailed persona metadata. This resource enables rigorous, human-centered analysis in AI text detection. • We propose a multi-factor WLS framework with Type II ANOVA, controlling for multiple attributes to isolate each factor’s influence on detection errors and pinpoint where bias emerges. This approach can also be extended to future bias analysis tasks that consider additional demographic or linguistic variables. • We demonstrate that human-level attributes—particularly language proficiency and environment—can overshadow model-based differences, causing significant biases in AI text detection. 2 Related Work Author Characteristics and Linguistic Theory Linguistic research demonstrates how author characteristics influence writing style. Functional linguistics and discourse analysis show that registers and genres vary in vocabulary, syntax, and pragmatics ( Biber et al., 1998 ) , creating distinctions between AI- and human-generated text. Sociolinguistics and Second Language Acquisition (SLA) research reveals textual differences (e.g., lexical diversity, grammatical complexity) between native and non-native speakers ( Hyland, 2000 ; Lantolf, 2000 ; Long, 1996 ) . Hyland (2000) specifically highlights how disciplinary norms in academic writing create stylistic variations. "World Englishes" theory ( Kachru et al., 1985 ; Jenkins, 2003 ) further emphasizes the diverse forms of English usage across cultures. This linguistic diversity complicates AI text detection, potentially introducing bias if detectors are trained on limited data and fail to generalize across varied social and cultural backgrounds. AI Text Detection Datasets and Benchmarks As LLMs continue to advance in various NLP tasks, the need to distinguish AI-generated text from human-authored text has become a hot research topic. Early work explored supervised learning or feature engineering, but as models scale, attention has shifted to multi-scenario, multi-model, and multilingual detection benchmarks. Examples include CUDRT, which focuses on polished and post-processed LLM text ( Tao et al., 2024 ) ; RAID, a comprehensive benchmark with multiple models, domains, languages, and adversarial samples ( Dugan et al., 2024 ) ; MAGE, which systematically combines models and domains for in- and out-of-domain evaluations ( Li et al., 2024 ) ; M4GT-Bench, for multilingual, black-box detection ( Wang et al., 2024 ) ; and HC3, which compares ChatGPT and human expert outputs ( Guo et al., 2023b ) . Despite this progress in creating diverse detection benchmarks, the human dimension—specifically, the demographic and identity attributes of authors—has received limited attention. The influence of factors like gender, native language, academic discipline, and language proficiency on detection accuracy and potential bias remains largely unexplored. This study addresses this gap by analyzing how these key author attributes affect

Read the complete text