Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Text

Guangsheng Bao, Lihua Rong, Yanbin Zhao, Qiji Zhou, Yue Zhang · 2025

Read Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Text by Guangsheng Bao, Lihua Rong, Yanbin Zhao, Qiji Zhou, Yue Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00258.txt.

Introduction

Guangsheng Bao and co-authors wrote a 2025 paper on how to detect text that an artificial intelligence model helped to write. Existing detection studies are scattered, with no shared framework. The team first sets out a hierarchy of risk levels for AI involvement, from a light touch to a fully fabricated text. Each level forms its own detection task.

Their method splits a text into two parts: its content, meaning what it says, and its expression, meaning how it says it. They find that content stays stable when the expression is altered, which makes content a strong signal for detection. On the highest-level tests, their two-part method beat the best earlier detectors by a wide margin on a standard curve score. It also won on a well-known difficult test set. The team released their data and code for free reuse.

Catalog record

CREATORGuangsheng Bao, Lihua Rong, Yanbin Zhao, Qiji Zhou, Yue Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-00258

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Text Guangsheng Bao, Lihua Rong, Yanbin Zhao, Qiji Zhou, Yue Zhang Abstract The wide usage of LLMs raises critical requirements on detecting AI participation in texts. Existing studies investigate these detections in scattered contexts, leaving a systematic and unified approach unexplored. In this paper, we present HART , a hierarchical framework of AI risk levels, each corresponding to a detection task. To address these tasks, we propose a novel 2D Detection Method , decoupling a text into content and language expression. Our findings show that content is resistant to surface-level changes, which can serve as a key feature for detection. Experiments demonstrate that 2D method significantly outperforms existing detectors, achieving an AUROC improvement from 0.705 to 0.849 for level-2 detection and from 0.807 to 0.886 for RAID. We release our data and code at https://github.com/baoguangsheng/truth-mirror . 1 1 footnotetext: Equal contribution. 2 2 footnotemark: 2 Corresponding author. 1 Introduction Large language models (LLMs) have shown strong text generation abilities, leading to the rise of AI-assisted text creation in news, academic, story, and advertising writing Christian (2023) ; M Alshater (2022) ; Yuan et al. (2022) ; Chen and Chan (2023) . The coauthorship between humans and machines has become the norm in the era of LLM Lee et al. (2022) ; Nguyen et al. (2024) ; Liang et al. (2024) . However, we have different levels of tolerance for AI in different contexts. For example, in academic paper writing, conferences and journals usually accept papers polished using LLMs but reject papers fabricated by models. In writing class, teachers prefer the essays written completely by students, denying the usage of AI. These application scenarios require techniques to detect AI participation in text creation at varying levels, which can be categorized into four types as illustrated in Figure 1 . Figure 1: AI participation in text creation Figure 2: The detection tasks across three risk levels address the four types of AI participation. We represent these types in a two-dimensional space, leading to a 2D detection approach. In this method, the detector performs a binary classification within the two-dimensional space for each detection task. Prior research explores detection of AI-generated text across different contexts. Early studies concentrate on identifying fully AI-generated text Gehrmann et al. (2019) ; Ippolito et al. (2020) ; Mitchell et al. (2023) , while later studies address challenges like paraphrasing and adversarial attacks Krishna et al. (2024) ; He et al. (2024) ; Dugan et al. (2024) ; Wu et al. (2024) . Recently, the focus shifts toward identifying mixed human-AI content Wang et al. (2024d) ; Richburg et al. (2024) ; Zhang et al. (2024) ; Abassy et al. (2024) . However, these studies, tailored to specific contexts and detector designs, lack a systematic framework capable of addressing all levels of AI participation in a unified manner. In this paper, we introduce HART ( H ierarchical A I R isk in T ext Creation), a comprehensive framework of AI risk levels that targets the four types of AI participation, as depicted in Figure 2 (a). Each risk level corresponds to a detection task, where a binary classifier is required. To systematically tackle these tasks, we propose decoupling the content and language expression of a text, as illustrated in Figure 2 (b). We map the four types of AI participation onto the four quadrants of a two-dimensional coordinate system, where type 2 and type 3 (AI content) are marked as high risk (in red) due to the potential for misinformation, bias, or harmful content, while type 1 (AI expression) is considered low risk (in yellow) as it primarily affects readers’ experience. Based on the two-dimensional view, we propose a novel 2D Detection Method that decomposes the problem into two sub-problems: detecting AI content and detecting AI expression. Each corresponds to a distinct textual feature, mapped to a scalar metric, as Figure 2 (c) illustrates. We hypothesize that content is the essential feature in distinguishing AI-generated texts from human-written ones. This is because content is relatively stable and less affected by superficial text changes. For example, the content “ the sun rises in the east ” can be expressed in different styles – academic as “ the sun appears to ascent from the eastern horizon ”, news as “ the sun rose in the east this morning, marking another predictable beginning to the day for residents in the region ”, and poetry as “ in dawn’s gentle embrace, the golden orb doth rise, from eastern realms it paints the morning skies ”. The core ideas of the content remain the same no matter whether words, grammar, style, and tone are altered. To test this hypothesis, we investigate two fundamental research questions. Q1: How can a text’s content and expression be effectively decoupled? Q2: How can AI content and AI expression be reliably detected? For Q1, we explore two prototyping approaches: extraction , which isolates main ideas or key expressions to represent content, and neutralization , which simplifies the text by removing unique stylistic elements or ideas. For Q2, we assess existing detection models on these content-driven and expression-driven representations, finding that current metric-based detectors can indeed be adapted to identify both AI-generated content and AI-modified expressions. Experimental results reveal that existing detectors struggle with AI-risk detection tasks due to their high sensitivity to surface-level text changes. In contrast, leveraging content-based features proves more robust, outperforming traditional detectors across multiple domains in the HART and RAID datasets. Further improvements are observed when content and expression features are integrated; the 2D framework boosts the best AUROC for the level-2 detection task from 0.711 to 0.855 and TPR5% from 47% to 59%; and it enhances the best AUROC on RAID from 0.807 to 0.886. To our knowledge, this is the first work to tackle the detection problem by focusing on content as a key feature, demonstrating its importance in distinguishing AI-generated texts and effectively mitigating diverse attacks on detection systems. 2 Related Work AI-Assisted Text Creation. LLMs have made significant progress in the area of creative assistance Zhao et al. (2023b) ; Lund et al. (2023) ; Wasi et al. (2024) . These models can generate coherent, natural text, offer a variety of writing styles and expressions, and are adapted for various writing tasks such as scientific technology Gero et al. (2022) ; Salimi and Saheb (2023) ; Lund et al. (2023) , storytelling Yuan et al. (2022) ; Zhao et al. (2023b) ; Wang et al. (2024a) ; Wang et al. (2024b) , and news media Cheng et al. (2024) . On the one hand, LLMs can help creators improve their writing efficiency, and on the other hand, they can enhance the quality of their writing. In this paper, we categorize the ways in which LLMs assist in creating text content into four types and propose detection tasks to cover them. AI-Generated Text Detection. The tasks we propose are related to existing AI-generated text detection tasks Wu et al. (2023) ; Yang et al. (2023b) , where existing tasks do not consider AI participation levels in text creation. It is also related to existing refined detection tasks Zhang et al. (2024) ; Richburg

Read the complete text