Fine-Grained Detection of AI-Generated Text Using Sentence-Level Segmentation

L. D. M. S. Sai Teja Annepaka Yadagiri Partha Pakray, Chukhu Chunka Mangadoddi Srikar Vardhan · 2025

Read Fine-Grained Detection of AI-Generated Text Using Sentence-Level Segmentation by L. D. M. S. Sai Teja Annepaka Yadagiri Partha Pakray, Chukhu Chunka Mangadoddi Srikar Vardhan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17830.txt.

Introduction

Lekkala Sai Teja and 4 co-authors hunt AI-made text at the level of single sentences. Their 2025 paper notes that whole-doc checks miss mixed texts, where human and AI parts sit side by side. Light edits can also hide AI parts from blunt tools.

Their model tags each token as human or AI made, and marks where the switch occurs. It pairs a large pre-trained language model with a net and a chain rule layer. On two public bench sets with mixed texts, the fine tags beat whole-doc checks. Sharp bounds help users see which parts need a closer look.

Catalog record

CREATORL. D. M. S. Sai Teja Annepaka Yadagiri Partha Pakray, Chukhu Chunka Mangadoddi Srikar Vardhan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-17830

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fine-Grained Detection of AI-Generated Text Using Sentence-Level Segmentation L. D. M. S. Sai Teja Annepaka Yadagiri Partha Pakray, Chukhu Chunka Mangadoddi Srikar Vardhan Abstract Generation of Artificial Intelligence ( AI ) texts in important works has become a common practice that can be used to misuse and abuse AI at various levels. Traditional AI detectors often rely on document-level classification, which struggles to identify AI content in hybrid or slightly edited texts designed to avoid detection, leading to concerns about the model’s efficiency, which makes it hard to distinguish between human-written and AI-generated texts. A sentence-level sequence labeling model proposed to detect transitions between human- and AI-generated text, leveraging nuanced linguistic signals overlooked by document-level classifiers. By this method, detecting and segmenting AI and human-written text within a single document at the token-level granularity is achieved. Our model combines the state-of-the-art pre-trained Transformer models, incorporating Neural Networks ( NN ) and Conditional Random Fields ( CRFs ). This approach extends the power of transformers to extract semantic and syntactic patterns, and the neural network component to capture enhanced sequence-level representations, thereby improving the boundary predictions by the CRF layer, which enhances sequence recognition and further identification of the partition between Human- and AI-generated texts. The evaluation is performed on two publicly available benchmark datasets containing collaborative human and AI-generated texts. Our experimental comparisons are with zero-shot detectors and the existing state-of-the-art models, along with rigorous ablation studies to justify that this approach, in particular, can accurately detect the spans of AI texts in a completely collaborative text. All our source code and the processed datasets are available in our GitHub repository 1 1 1 https://github.com/saitejalekkala33/GenAI_Detect_Sentence_Level . Figure 1: Text Segmentation between the Human and Machine with boundary prediction. The text in Green is Human written text, and the text in Red is Machine Generated Text. 1 Introduction Recent advancements in Large Language Models (LLMs) Chang et al. 2024 ; Annepaka and Pakray 2025 , such as ChatGPT 2 2 2 https://chatgpt.com/ , Grok 3 3 3 https://grok.com/ , Gemini 4 4 4 https://gemini.google.com/ , and DeepSeek 5 5 5 https://chat.deepseek.com/ , have demonstrated exceptional performance in Natural Language Processing (NLP) Patwardhan et al. 2023 . These models are capable of generating highly fluent and realistic human-like text, significantly enhancing applications such as text classification Dogra et al. 2022 ; Kowsari et al. 2019 , sentiment analysis Nasukawa and Yi 2003 , machine translation Stahlberg 2020 , and question-answering systems He et al. 2024 ; Allam and Haggag 2012 . These foundational models demonstrate significant potential in addressing a wide spectrum of NLP tasks, ranging from Natural Language Understanding ( NLU ) to Natural Language Generation ( NLG ), and even contributing to the development of Artificial General Intelligence (AGI) Yang et al. 2024 . AI-plagiarism has been a growing concern in the modern world, where the distinction between human-generated and AI-generated work has become increasingly subtle. Due to the rapid growth of AI-generation tools and LLMs, academic integrity and content originality have become significant challenges. Detecting AI generation is a significant challenge for modern researchers. Traditional plagiarism detection systems, such as Turnitin, Scribbr, etc., have fought this. Generally, detection systems such as the above systems identify plagiarism by using Machine Learning (ML) algorithms to compare the user-written text against a vast database of online content and highlight the parts that closely resemble the existing material; however, this system is often bypassed using simple techniques like paraphrasing or restructuring the sentence without altering the core meaning. This is generally due to the nature of detection methods, where general detection methods, such as perplexity-based methods, are geared towards incremental or document-level modification. This has become a significant challenge that requires great efforts from NLP researchers worldwide. To address the above-stated problems, we propose a novel integration of a pre-trained Transformer encoder with Neural Networks and a Conditional Random Field ( CRF ) layer, specifically designed for boundary-aware sentence-level authorship segmentation. Unlike prior CRF pipelines, our architecture introduces dynamic dropout and hierarchical loss-aware training, tailored to mixed-authorship detection. Unlike traditional Transformer-CRF pipelines applied to NER or POS tagging, we adapt this architecture for fine-grained authorship segmentation, incorporating sequence-aware regularization and token boundary-aware loss tailored for mixed-authorship text, a novel problem space. Our contribution lies in the hierarchical integration of authorial cues at different granularity levels, use of dynamic dropout to mitigate overfitting to local styles, and a custom-designed loss that emphasizes boundaries. To our knowledge, no existing model has applied these optimizations specifically for sentence-level segmentation in human-AI collaborative texts. 2 Related Work Based on the evolution of AI models, this mixed text data is prone to plagiarism and authenticity issues. There have been works based on the mixed text data classification by RoFT Dugan et al. 2020 created a dynamic benchmark where users attempted to identify transition points between human and AI texts. In the follow-up RoFT-ChatGPT Kushnareva et al. 2023 adapted SOTA detectors to locate the boundaries and compared the perplexity based approaches. The work ‘Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Education’ by Zeng et al. 2024 introduced a new segmentation approach that learns distinct human and AI authorship prototypes within embedding space, while treating the boundaries as points of maximum prototype distance. SemEval 2024 shared task by Wang et al. 2024 , in which many participated for the task of detecting the boundaries, in that Qu and Meng 2024 ( TM-TREK ) achieved 1st place in the human-machine mixed - text detection subtask by reframing boundary detection as token classification and leveraging ensembles of LLMs with segmentation loss. Another work, SeqXGPT Wang et al. 2023 , introduced a sequence labeling approach using GPT-style decoder-only models as the core features. With the rapid advancement of LLMs, collaborative writing between humans and AI has become increasingly seamless. For instance, previous work by Buschek et al. 2021 explored the use of GPT-2 to provide phrase-level writing suggestions during email composition, aiming to support and enhance human writing. This tells about the growing relevance of detecting and understanding hybrid texts that combine contributions from both humans and AI. Lee et al. 2022 extended this line of work by employing the more advanced GPT-3 model to offer sentence-level suggestions in human-AI collaborative essay writing. As this type of collaborative writing between humans and LLMs becomes more prevalent, it introduces a critical challenge for the AI text detection field: identifying AI-generated segments within jointly authored text. Addressing this issue, Dugan et al. 2023 reframed the task of detecting AI text in hybrid documents as a boundary detection problem, aiming to precisely locate the transition points between human and AI-generated text. The study specifically evaluated human ability to identify boundaries within hybrid texts containing a single transition point. Although detection accuracy improved with some level of training, overall performance remained limited, participants were only able to correctly identify the boundary in 23.4% of the cases. Building upon the work of Dugan et al. 2023 , our research also focuses on boundary detection. However, key differences include: (1) this work explores automated methods for identifying boundaries, and (2) the hybrid texts used in our experiments contain multiple boundaries. OUR KEY CONTRIBUTIONS: 1. CRF tagged

Read the complete text