Triospect: A Three-Dimensional Framework for Robust Statistical AI-Generated Text Detection Against Diverse Attacks

Guangsheng Bao, Lihua Rong, Yanbin Zhao, Xiao Yu, Qiji Zhou, Yue Zhang · 2026

Read Triospect: A Three-Dimensional Framework for Robust Statistical AI-Generated Text Detection Against Diverse Attacks by Guangsheng Bao, Lihua Rong, Yanbin Zhao, Xiao Yu, Qiji Zhou, Yue Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31074.txt.

Introduction

Bao and five colleagues build Triospect, a detector for AI-generated text designed to survive deliberate attacks. Detectors that judge surface style alone fail when 'humanizer' tools rewrite a passage, because such attacks change expression while keeping the underlying content mostly intact. Watermarks can be scrubbed the same way, so single-view detection keeps losing ground.

Triospect judges a text from three dimensions at once: its content, its expression, and the usual statistical view. Tested on two benchmarks spanning 17 attacks, 12 domains, and 17 source models, the framework beat a strong baseline by wide margins on attacked text, including gains of 22.3 points of AUROC on one benchmark and 9.1 on another. The authors release their data and code for further testing.

Catalog record

CREATORGuangsheng Bao, Lihua Rong, Yanbin Zhao, Xiao Yu, Qiji Zhou, Yue Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.31074

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Triospect: A Three-Dimensional Framework for Robust Statistical AI-Generated Text Detection Against Diverse Attacks Guangsheng Bao, Lihua Rong, Yanbin Zhao, Xiao Yu, Qiji Zhou, Yue Zhang Abstract Existing AI-generated text detectors are vulnerable to attacks that manipulate textual characteristics. In this study, we propose a novel Triospect Detection Framework by using additional perspectives of content (core ideas) and expression (stylistic elements) within a given text. Experiments on two benchmarks involving 17 attacks, 12 domains, and 17 source models demonstrate that Triospect is robust against these attacks. It improves the strong baseline by a significant margin of 22.3% (AUROC) and 13% (TPR01) on the Humanize-16K after-attack subset, and by 9.1% (AUROC) and 22% (TPR01) on the adversarial RAID. This framework marks a pioneering effort in statistical methods to enhance detection reliability against attacks. We release our data and code at https://github.com/baoguangsheng/triospect . 1 Introduction Large language models (LLMs) have been widely used in news, academic, story and advertising writing 18 ; 53 ; 78 ; 16 , leading to unprecedented societal risks including spreading misinformation 1 ; 5 ; 13 , eroding academic integrity 61 ; 48 ; 47 , and blurring accountability in digital communication 42 ; 68 . These challenges call for reliable AI-generated text detection tools, requiring the research community to develop effective detectors. However, at the same time, attacking techniques are also developed 46 ; 82 ; 4 , and commercial AI humanizing tools (16 listed in Appendix A ) can bypass state-of-the-art detectors, posing urgent threats to safe usage of AI technology. Existing state-of-the-art detectors are vulnerable when facing attacks. Supervised detectors 66 ; 26 ; 74 ; 49 ; 70 may fail in unfamiliar synthesized styles 6 ; 69 ; 62 . Zero-shot detectors 31 ; 67 ; 58 ; 8 ; 73 ; 34 may be affected by surface-level textual changes 46 ; 23 ; 72 ; 14 . The watermarks 44 ; 81 ; 17 ; 80 ; 79 can be removed using new words and syntax 46 ; 64 . These vulnerabilities underscore the necessity of advancing robust detection mechanisms that can withstand a wide range of attacks. Figure 1: Left: Humanizing attacks cause failure of existing detectors in single-dimensional view . Middle: The failure can be mitigated by more stable content dimension. Right: In multi-dimensional view , we combine the dimensions to achieve robust detection. (Humanize-16K using Fast-Detect as the metric) Such attacks generally modify textual expressions (surface forms) while largely preserving underlying contents (semantics) ( 40 ; 2 ; 63 ; 41 ) . By content , we refer to the information conveyed in the text. It is about ‘what’ is being communicated. By expression , we refer to the manner in which the content is conveyed. It is about ‘how’ the content is communicated. That is to say , under these attacks, the content of a text remains relatively stable. Thus, if a detector can measure the content directly, it will be resilient against the attacks , as adversarial vulnerability often stems from reliance on non-robust surface features rather than semantically meaningful representations ( 54 ; 38 ) . To separate the content from the expression of a text, we leverage the strong understanding ability of LLMs to regularize its expression, leading to a resultant token sequence primarily determined by its content. This content-representing token sequence has unique features for identifying its source, which we find can be captured by existing detection metrics. Based on this idea, we propose Triospect , a three-dimensional statistical detection framework that jointly analyzes the original text, its content, and its expression, enabling complementary signals to be examined across these three distinct dimensions. Specifically, given a text T , we perform a textual transformation to convert it into an approximate content-preserving text \hat{T}_{c} and expression-preserving text \hat{T}_{e} , approximately decoupling the two aspects. We measure the texts using an existing detection metric m(\cdot) (e.g., Fast-Detect), obtaining the original text measure m(T) , the content measure m(\hat{T}_{c}) , and the expression measure m(\hat{T}_{e}) . As Figure 1 illustrates, humanizing tools shift the distribution of AI-generated texts towards human-written texts in the measure m(T) , causing overlap between ‘ Human ’ and ‘ Humanized AI ’. However, this confusion can be mitigated by the content measure , where the distribution remains relatively stable under attacks. Additionally, the expression measure can help when an attack occurs at the word level and does not change the grammatical patterns. Consequently, by combining these measures in the multi-dimensional view, we achieve a more robust detection framework. We construct a Humanize-16K benchmark for the systematic evaluation of detectors dealing with humanizing attacks. We collect human-written texts from 4 data sources and generate corresponding AI texts based on the same contexts (titles or prompts) using 6 LLMs. Then, we apply 6 humanizing attacks to the AI-generated texts, where the attacks include human editing, commercial AI tools, and LLM simulated attacks. Consequently, we obtain 16K samples, half for development and half for testing. We evaluate detectors on our Humanize-16K and the existing adversarial RAID benchmarks, where they cover a total of 12 domains, 17 LLMs, and 17 attacks. The experimental results show that Triospect is resistant to humanizing and adversarial attacks, leading to an improvement of 22.3% in AUROC and 13% in TPR01 on the Humanize-16K after-attack subset, as well as an improvement of 9.1% in AUROC and 22% in TPR01 on RAID, compared to the strong baseline detector. Analysis shows that Triospect is also robust to source models, decoding strategies, text lengths, and languages. In summary, perspectives from content and expression provide beneficial complements to original texts, leading to more reliable detection under humanizing and adversarial attacks. To our knowledge, this is the first statistical method to tackle detection problems against a wide range of attacks, and it achieves new state-of-the-art results among zero-shot detectors. 2 Related Work AI-Generated Text Detection Existing detectors consist of three types of technology. The first is supervised classifiers 66 ; 39 ; 26 ; 37 ; 74 ; 49 ; 70 ; 77 ; 14 , which train a binary classifier based on a large collection of AI-generated and human-written text. The second is zero-shot classifiers, including white-box methods 31 ; 67 ; 8 ; 73 ; 34 and black-box methods 58 ; 75 ; 10 ; 7 ; 14 . These technologies usually use pre-trained language models to extract detection metrics. The third is text watermarking technology 44 ; 81 ; 17 ; 80 ; 79 , which identifies AI-generated text by embedding easy-to-detect markers or patterns. While these methods are successful at identifying entirely AI-generated texts, they lack resilience against diverse attack strategies 29 ; 25 ; 46 ; 35 ; 23 ; 72 ; 71 ; 82 . As a result, various commercial AI tools offer features to “humanize” content, enabling them to evade current detection systems. To tackle this issue, we introduce the Triospect detection framework as a promising solution to counteract such vulnerabilities. There is limited research focused on the humanizing attack, with most efforts relying on supervised learning. For instance, ImBD 14 fine-tunes a LLM on AI-rewritten and refined texts to learn machine-generated styles, using a style-CPC (conditional probability curvature) metric

Read the complete text