Advancing LLM detection in the ALTA 2024 Shared Task: Techniques and Analysis

Dima Galat · 2024

Read Advancing LLM detection in the ALTA 2024 Shared Task: Techniques and Analysis by Dima Galat (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-19076.txt.

Introduction

Dima Galat reports a 2024 study of methods to spot AI-written text, done for a shared task at a language tech meeting. The task was to judge text sentence by sentence inside mixed articles, where human and machine lines sit side by side. Good spotting tools are in rising demand as made text spreads.

One model's output showed distinct, repeating chance patterns that allowed steady spotting within its own domain. Light edits such as rewording barely dented the scores. The paper sets out the methods tried and what the results mean for building stronger detectors of made text.

Catalog record

CREATORDima Galat
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE11 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-19076

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Advancing LLM detection in the ALTA 2024 Shared Task: Techniques and Analysis Dima Galat Abstract The recent proliferation of AI-generated content has prompted significant interest in developing reliable detection methods. This study explores techniques for identifying AI-generated text through sentence-level evaluation within hybrid articles. Our findings indicate that ChatGPT-3.5 Turbo exhibits distinct, repetitive probability patterns that enable consistent in-domain detection. Empirical tests show that minor textual modifications, such as rewording, have minimal impact on detection accuracy. These results provide valuable insights for advancing AI detection methodologies, offering a pathway toward robust solutions to address the complexities of synthetic text identification. 1 Introduction The evolution of writing assistants has progressed from simple spell checkers to AI-driven systems ( Heidorn 2000 ) . Advancements of Large Language Models (LLMs) , now capable of drafting entire documents, are transforming writing assistants into interactive tools capable of enhancing creativity and productivity ( Brown et al. 2020 ) . The introduction of ChatGPT has propelled LLMs into mainstream, quickly gaining them a status of a disruptive technology in many knowledge industries ( OpenAI 2023a ) . ChatGPT classifier has been discontinued in 2023 seven months after launch citing low accuracy ( OpenAI 2023b ) . The analysis of sentiments from early ChatGPT adopters reveals predominantly positive reactions across various domains. However, at the same time concerns have been raised regarding potential misuse and adverse effects in the context of educational activities and news media ( Haque et al. 2022 ) . Being able to distinguish between human and machine-generated text is critical for maintaining integrity and transparency in academia, as well as other fields such as journalism. The rise of human-AI collaborative writing necessitates more advanced detection methods for analysing hybrid texts that incorporate both AI and human-authored sentences. This paper looks at the ALTA 2024 Shared Task challenge ( Mollá et al. 2024 ) , where participants develop an automatic detection system to classify sentences in hybrid articles as either human-written or machine-generated. This paper shows ways to improve existing detection methods and promotes more responsible practices in content generation. 2 Background and Related Work The strategies for a sentence-level detection task predominately focus on the following two approaches: sentence classification, where each sentence in a document is considered independently; or sequence classification, where a document is evaluated as a whole to decide labels for each word and then determine the most frequently-occurring label for the document ( Wang et al. 2023 ) . Wang et al. 2023 proposed using token-probabilities from different LLMs , aligning local word-wise features to address differences in tokenisation, and then applying convolutions and a linear level for training a sequence classification model exhibiting strong results. Shi et al. 2024 proposed to look for a boundary between AI and human-authored text, detecting transitions by modeling distances between subsequent sentences in a hybrid document. Experiments demonstrated that this approach consistently improved classification. However, the optimal number of subsequent sentences to be evaluated depends on the document length, and additional considerations are required to account for boundaries that might exist within a hybrid sentence. Zeng et al. 2024 investigated segmentation within hybrid texts to classify authorship of each segment. The findings suggest to employ a text segmentation strategy when only a few boundaries exist. Authors note that this is a challenging task; and that short texts provide limited stylistic clues, segment detection is difficult with frequent authorship changes, and human writers are free to select and edit sentences based on their preference ( Zeng et al. 2024 ) . 3 Research Methodology Our goal is to classify sentences generated by ChatGPT-3.5 Turbo mixed with sentences written by humans. We know that at each generation step LLM predicts the next most likely token given the preceding sequence of tokens (i.e. context), or P(\text{token}_{i}\mid\text{context}) . We believe that these marginal probabilities can be used to identify distinct statistical patterns in probability distributions. For example, some high-probability tokens might be favoured by an LLM , whereas human-written text would have higher entropy due to an unexpected choice of words. 3.1 Data and baseline We were provided a training dataset of 14576 academic and 1500 news articles, containing multiple sentences with a corresponding human/machine label. Validation and test datasets contained 500 and 1000 news articles respectively. When analysing news domain data, we observed that human-written and machine-generated sentences tend to appear in continuous blocks rather than being interwoven or interspersed at the sentence level. Sequences of sentences from each class do not appear to be completely random and follow a pattern resembling the hybrid article generation method of using an LLM with fill-in task prompts described by Shi et al. 2024 . To rigorously evaluate our sentence classification capabilities without relying on contextual cues, we focus on sentence-level classification. Although a model leveraging entire article context might yield higher accuracy, such approach lies beyond the scope of our current research. In order to evaluate the importance of domain for building a predictor we have trained baseline models using 3 different versions of the dataset: 1. using all of the training data 2. using random under-sampling of academic articles to match the number of news articles 3. using only news articles Our baseline model is built using a Naive Bayes classifier, chosen for the efficiency and simplicity. Best results were obtained when using TF-IDF n-gram features up to the length of 5, without stopword filtering ( McCallum and Nigam 1998 ; Ramos 2003 ; Manning et al. 2008 ) . Results suggest that certain phrases and expressions can be favoured by ChatGPT. A relaxed feature independence assumption adds bias and limits the accuracy of the predictions, but this classifier is perfectly suited for comparing statistical properties texts. We run the model 100 times using different seed selections to account for the random under-sampling of academic articles, and for the variations of a validation data split. The results in Table 1 suggest that that using only news data is sufficient for building a sentence level predictor for this challenge. Moreover, we can see that there are distinctive statistical patterns that can be used to classify these texts. Dataset Kappa Score F1 Weighted All Data 0.644 \pm 0.028 0.83 \pm 0.014 Sampling 0.703 \pm 0.026 0.86 \pm 0.013 Only News 0.716 \pm 0.03 0.87 \pm 0.014 Table 1: Performance metrics of Naive Bayes for different datasets based on 100 random seed selections, evaluating Cohen’s Kappa Score and F1 Weighted (mean \pm standard deviation). 3.2 Model and training We have attempted using LLM classification zero-shot, however this approach was not getting close to the baseline model. In order to build the best classifier we can, we selected the best base model we could adapt. LLaMA 3.1 ( Meta 2024 ) , demonstrates a strong capability to generalise across various applications in natural language processing and is very popular in the research community because the release of its weights has facilitated accessibility and further experimentation. Instruction tuning, has emerged as a fine-tuning strategy which augments input-output examples with instructions, enabling instruction-tuned models to generalise more easily to new tasks Wei et al. 2022 . We are using a model variant with 8 billion parameters which can be trained on a

Read the complete text