Detecting Verbatim LLM Copy-Paste in Homework

Aizierjiang Aiersilan · 2026

Read Detecting Verbatim LLM Copy-Paste in Homework by Aizierjiang Aiersilan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16336.txt.

Introduction

Aiersilan, Yousefi, and Pless propose a teacher-run mark to catch word-for-word LLM copy-paste. Post-hoc AI-text checkers prove shaky and punish non-native writers, while output-side marks need maker help. Their input-side mark hides an order inside the visible task prompt, so a model that ingests it word-for-word writes a tag into its reply. Their SteganoPrompt tool encodes payloads in the Unicode Tags block, lives through common copy-paste channels, and carries an always-on school-honesty note.

Catalog record

CREATORAizierjiang Aiersilan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32111
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16336

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Detecting Verbatim LLM Copy-Paste in Homework Aizierjiang Aiersilan Abstract Large language models (LLMs) have made fluent essay writing, code drafting, and quiz answering instantly available to students at every level, from secondary school through graduate study. Many educators do not object to LLM use per se ; what they need to detect is the case in which a student pastes the assignment prompt into a chatbot and submits the model’s reply verbatim, without engaging with the work. Existing post-hoc AI-text detectors remain unreliable and have been shown to penalise non-native English writers, while output-side watermarks require cooperation from the model provider. We propose an alternative that the educator controls directly: an input-side watermark in which an invisible instruction is embedded inside the visible assignment prompt itself. An LLM that ingests the prompt verbatim quietly reads the hidden instruction and writes a tell-tale signature into its reply, exposing the copy-and-paste pathway specifically. We describe SteganoPrompt, a single-page, zero-dependency web tool that encodes an arbitrary printable-ASCII payload into the deprecated Unicode Tags block ( U+E0000 – U+E007F ). The encoded string is visually identical to the original, survives common copy-paste channels (Word, Google Docs, PDF, Markdown, Slack, e-mail, the major learning-management systems), and is reliably tokenized by frontier models. We evaluate compliance across seven LLM families and a representative set of educational content channels. The work is informed by my experience as a graduate teaching assistant for an undergraduate software engineering course at the George Washington University. The tool is released under the MIT licence at https://ezharjan.github.io/SteganoPrompt/ . I Introduction The release of broadly capable instruction-following language models [ 18 , 2 ] has made it trivial for a student, whether in secondary school or at university, to obtain a fluent answer to almost any short-answer or short-essay assignment by pasting the prompt into a chatbot. Surveys in education and rapid reviews of the resulting literature [ 5 , 24 , 15 , 20 , 23 ] report rapid uptake of LLMs across the full educational spectrum, accompanied by substantial uncertainty among educators as to how to verify that the work submitted is, in fact, the student’s own. The pedagogically dangerous case is not LLM use per se ; many educators welcome AI as a study aid when its use is disclosed and accompanied by substantive engagement with the material. The case worth detecting is the one in which a student pastes the assignment prompt into a chatbot and submits the model’s reply verbatim, without engaging with the work. This paper targets that specific case. Two families of countermeasures have emerged. The first is post-hoc detection , in which a classifier inspects the submitted text and decides whether it was produced by a model. Tools in this family include DetectGPT [ 16 ] , the (since-withdrawn) OpenAI classifier [ 17 ] , and a number of commercial services. Both empirical [ 13 ] and theoretical [ 22 , 10 ] results have shown that such detectors are unreliable, can be defeated by light paraphrasing, and disproportionately misclassify essays written by non-native English speakers. This problem is likely to deepen over time, as human learners of English are themselves exposed to and may internalize the stylistic conventions of AI-generated text. The second family is output-side watermarking , in which the model provider biases its sampling distribution at generation time so that a downstream verifier can later test for the watermark [ 9 , 1 , 11 , 4 , 28 ] . Output watermarking is technically attractive but is only available to parties who control the model. A classroom teacher or university instructor generally does not. A third option, less explored in the academic literature but widely discussed by the prompt-security community [ 21 ] , is to watermark the input that the model is asked to consume. If the assignment brief itself contains an invisible instruction, then any LLM that reads the prompt as text will treat that instruction as part of the conversation, and a student who copies the prompt verbatim into the chatbot becomes the unwitting courier of a tripwire. This work was motivated by two recent observations. First, the program chairs of ICML 2026 announced that reviewer-facing materials would be circulated with hidden watermarks, so that a reviewer who pasted a call into an LLM and copied the model’s reply back into the review form could be flagged automatically [ 8 ] . The proposal followed quantitative evidence that several percent of recent peer reviews at major AI conferences had been substantively rewritten by language models [ 12 ] . Second, while serving as a graduate teaching assistant for an undergraduate software engineering course at the George Washington University across the Fall 2025 and Spring 2026 semesters, I observed an analogous manual integrity check used by the course instructor. At the start of each in-class quiz the instructor would announce a word of the day (for example, apple , umbrella , compiler ) that students had to write at the top of the submission, and the presence of the word served as evidence that the student had been physically present and had worked on the quiz themselves. The technique is convenient and zero-cost, but is also fragile: a student who knows another student in the room can be told the word over a messaging app in seconds, and the protocol does not generalise to take-home assignments at all. We introduce SteganoPrompt, which is the take-home generalisation of this idea, implemented through a channel the student does not see. We make four contributions. (i) We formalise the input-side watermarking setting for academic integrity and articulate a threat model in which the adversary is a student who copies an assignment prompt verbatim into an LLM (Section III ). (ii) We describe SteganoPrompt, a single-file, zero-dependency web tool that encodes an arbitrary ASCII payload into the Unicode Tags block U+E0000 – U+E007F and concatenates it with the visible assignment text. The output is visually identical to the original on every text renderer we tested but is read transparently by most of current frontier models (Section III ). (iii) We evaluate the technique on seven LLM families and a set of content channels typical of classroom and online-course workflows (Section IV ). (iv) We discuss limitations, defences, and concrete guidance for ethical, disclosed deployment by educators (Section V ). The tool is open source under the MIT licence and is hosted at https://ezharjan.github.io/SteganoPrompt/ . The implementation is a single HTML file that performs all computation in the user’s browser. II Background and Related Work II-A LLMs and academic integrity The arrival of fluent, broadly knowledgeable LLMs has created an acute pedagogical problem. Susnjak [ 24 ] argues that the affordances of ChatGPT and its peers undermine the assumption underlying most online assessment. Cotton et al. [ 5 ] survey responses by universities and recommend a combination of policy, assessment design, and detection. Perkins [ 20 ] catalogues post-pandemic integrity considerations specific to LLMs, while Lo [ 15 ] provides a rapid review of the early educational literature. Stokel-Walker [ 23 ] reports a Nature news piece in which several academics admit that they cannot reliably distinguish a student essay from a ChatGPT essay

Read the complete text