Detecting Document-level Paraphrased Machine Generated Content: Mimicking Human Writing Style and Involving Discourse Features

Yupei Li, Manuel Milling, Lucia Specia, Björn W. Schuller · 2024

Read Detecting Document-level Paraphrased Machine Generated Content: Mimicking Human Writing Style and Involving Discourse Features by Yupei Li, Manuel Milling, Lucia Specia, Björn W. Schuller (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12679.txt.

Introduction

Yupei Li and three co-authors detect machine-written documents in a paper from twenty twenty-four. Large language models make generated text easy to produce at scale. That fuels plagiarism and misinformation risks. Detectors that read only surface features are easily fooled. Paraphrased, long generated texts fool them most.

The authors bring in discourse features, the structural traits of a whole document. Besides a public benchmark, they built two new paraphrased data sets. One extends long-form question answering, the other writing prompts. Paraphrases were made with GPT and a discourse paraphrasing tool. Their methods aim to catch machine text that mimics human style sentence by sentence. Readers get detection aimed at document structure, where paraphrase cannot hide as easily.

Catalog record

CREATORYupei Li, Manuel Milling, Lucia Specia, Björn W. Schuller
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-12679

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Detecting Document-level Paraphrased Machine Generated Content: Mimicking Human Writing Style and Involving Discourse Features Yupei Li, Manuel Milling, Lucia Specia, Björn W. Schuller Abstract The availability of high-quality APIs for Large Language Models (LLMs) has facilitated the widespread creation of Machine-Generated Content (MGC), posing challenges such as academic plagiarism and the spread of misinformation. Existing MGC detectors often focus solely on surface-level information, overlooking implicit and structural features. This makes them susceptible to deception by surface-level sentence patterns, particularly for longer texts and in texts that have been subsequently paraphrased. To overcome these challenges, we introduce novel methodologies and datasets. Besides the publicly available dataset Plagbench, we developed the paraphrased Long-Form Question and Answer (paraLFQA) and paraphrased Writing Prompts (paraWP) datasets using GPT and DIPPER, a discourse paraphrasing tool, by extending artifacts from their original versions. To address the challenge of detecting highly similar paraphrased texts, we propose MhBART, an encoder-decoder model designed to emulate human writing style while incorporating a novel difference score mechanism. This model outperforms strong classifier baselines and identifies deceptive sentence patterns. To better capture the structure of longer texts at document level, we propose DTransformer, a model that integrates discourse analysis through PDTB preprocessing to encode structural features. It results in substantial performance gains across both datasets – 15.5% absolute improvement on paraLFQA, 4% absolute improvement on paraWP, and 1.5% absolute improvemene on M4 compared to SOTA approaches. 1 Introduction As LLMs such as GPT-4 OpenAI 2023 and Llama3 Touvron et al. 2023 develop rapidly and become widely utilized by the general public, Machine-Generated Content (MGC) has become increasingly abundant. In particular, people often rely on these models to revise long texts, such as essays, which results in paraphrased MGC. One example is shown in Figure 1 , where the original human-written text is highlighted in red on the left side, and the MGC in green on the right side, with differences shaded. It can be argued that content features such as fluency, readability, and clarity all improve after revision, and that the usage of LLM-usage can be hard to detect manually. Figure 1: Comparison of human-written text (left) with its corresponding GPT-revised text (right). There are well known risks associated with the misuse of MGC. Crothers et al. 2023 conducted a survey on the applications of MGC, reporting that it may contribute to academic misconduct, the spread of fake political news, and an increase in social media spam. Our goal in this paper is the effective detection of document-level paraphrased MGC, which is rewritten by LLMs from an original human written text. Automatically distinguishing MGC from Human-Produced Content (HPC) is, however, very challenging, given that MGC tends to resemble HPC, often containing at least chunks that are reproduced from human produced training data. Currently, methods to detect MGC involve a combination of processes, namely a Natural Language Understanding (NLU) module that extracts linguistic and contextual features, followed by a classification module which fits this to binary labels using algorithms such as Logistic Regression (LR) Cox 1958 for decision-making. However, these suffer from various limitations. First, current NLU models built using Transformers Vaswani et al. 2017 such as Roberta Liu et al. 2019 demonstrate good performance in analysing short texts (such as sentences) but less so when processing document-level data, as shown in Fu 2024 . They tend to struggle with retaining information if the texts are long. Even LLMs are limited in the length of the input texts that they can process effectively. Document-level texts exhibit more complex structures’ relationships. Secondly, the degree of similarity between MGC and HPC is higher especially when LLMs are used to paraphrase HPC rather than generating it from scratch. This makes distinguishing HPC and MGC challenging, as differences in linguistic content are less distinctive. Previous work focuses on identifying similarities at surface level linguistic features, ignoring the importance of other implicit features such as writing style or structural features, which we show can contribute to the effectiveness of a detection model. There is indeed a difference in writing style in Figure 1 : the left side is more poetic, while the right side is a plainer narrative, though the distinction may not be obvious to the human reader. These limitations lead to underperforming detectors in work to date. We propose two novel approaches to automatically detect MGC which address the limitations described above. The aim is to better classify the texts by identifying structural features, and implicit features, such as discourse relations or writing styles. Specifically, we introduce two models: MhBART, which does detection through writing style by leveraging the capabilities of BART Lewis et al. 2019 , and DTransformer, which incorporates discourse features to improve detection accuracy. As data to build and evaluate our models, we use publicly available datasets containing document-level paraphrased MGC and their HPC counterparts, as well as two new datasets that we created. We show that our proposed models consistently outperform baseline and SOTA approaches, both research and commercial tools, for long-form and machine-paraphrased texts. Our contributions can be summarized as follows: A. We create paraphrased Long-Form Question and Answer (paraLFQA) and paraphrased Writing Prompts (paraWP) – two parallel HPC-MGC corpora for model evaluation and further research in Section 3 B. We introduce MhBART – an encoder-decoder model designed to learn human writing style, which outperforms strong baselines for paraphrased MGC detection in Section 4 . Additionally, we identified sentence patterns that can deceive current detectors. C. We introduce DTransformer – a discourse-aware Transformer-based model to incorporate discourse features in detection, which leads to better performance for long form texts in Section 5 . 2 Related work 2.1 MGC Detection Approaches Given the current prominence of this topic, current work includes contributions from both academia and industry. In the academic literature, two types of models are commonly used: statistical methods, also known as feature-based methods, and neural network methods. Herbold et al. 2023 identified seven linguistic features and criteria for distinguishing MGC from HPC, and they concluded that MGC tends to exhibit fewer discourse and epistemic words but displays greater lexical diversity and nominalizations. Choudhary and Arora 2021 and GLTR (Generative Language Test Room) Gehrmann et al. 2019 also made decision with linguistic features. However, feature-based methods need manual work to design the features. There have been studies comparing neural network methods and statistical methods Hayawi et al. 2023 , demonstrating the superior efficiency of Transformer-based models Vaswani et al. 2017 , such as Roberta Large OpenAI Detector Solaiman et al. 2019 , the first fake news detector Grover Zellers et al. 2019 , a zero-shot detection method DetectGpt Mitchell et al. 2023 , watermarking based detection Fu et al. 2024 . The Roberta Large Detector has been fined-tuned with 1.5B output of GPT2. The detection is treated as a binary classification. However, it was trained on texts produced with GPT-2, which may retain biases. Additionally, Fu et al. 2024 have introduced semantic-aware watermarking algorithms, while Jiang et al. 2023 employ perturbation strategies to evade detection methods based on watermarking. Besides, Hu et al. 2023 introduced another adversarial learning approach named Radar, noted for its robust transferability. Additionally, Chaka 2023 directly utilizes LLMs Brown et al. 2020 for MGC detection, but concludes that

Read the complete text