Integrity Shield A System for Ethical AI Use & Authorship Transparency in Assessments

Ashish Raj Shekhar, Shiven Agarwal, Priyanuj Bordoloi, Yash Shah, Vivek Gupta, Demo, Video, Code · 2026

Read Integrity Shield A System for Ethical AI Use & Authorship Transparency in Assessments by Ashish Raj Shekhar, Shiven Agarwal, Priyanuj Bordoloi, Yash Shah, Vivek Gupta, Demo, Video, Code (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11093.txt.

Introduction

Ashish Raj Shekhar, Shiven Agarwal, Priyanuj Bordoloi, Yash Shah, and Vivek Gupta present Integrity Shield, a system for ethical AI use in assessments. Language models can now solve whole exams from an uploaded PDF. That power threatens the reliability of grades and credentials. Watermarking is a common defense, but token-level marks fail when students use closed, black-box systems.

Integrity Shield aims at authorship transparency under those real conditions. Teachers hand out the documents; students query systems the school does not control. Any shield must work without touching the model's decoding. The work serves educators who want AI use declared and checkable, rather than banned in ways no one can enforce.

Catalog record

CREATORAshish Raj Shekhar, Shiven Agarwal, Priyanuj Bordoloi, Yash Shah, Vivek Gupta, Demo, Video, Code
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11093

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Integrity Shield A System for Ethical AI Use & Authorship Transparency in Assessments Ashish Raj Shekhar, Shiven Agarwal, Priyanuj Bordoloi, Yash Shah, Vivek Gupta, Demo, Video, Code Abstract Large Language Models (LLMs) can now solve entire exams directly from uploaded PDF assessments, raising urgent concerns about academic integrity and the reliability of grades and credentials. Existing watermarking techniques either operate at the token level or assume control over the model’s decoding process, making them ineffective when students query proprietary black-box systems with instructor-provided documents. We present Integrity Shield , a document-layer watermarking system that embeds schema-aware, item-level watermarks into assessment PDFs while keeping their human-visible appearance unchanged. These watermarks consistently prevent MLLMs from answering shielded exam PDFs and encode stable, item-level signatures that can be reliably recovered from model or student responses. Across 30 exams spanning STEM, humanities, and medical reasoning, Integrity Shield achieves exceptionally high prevention (91-94% exam-level blocking) and strong detection reliability (89-93% signature retrieval) across four commercial MLLMs. Our demo showcases an interactive interface where instructors upload an exam, preview watermark behavior, and inspect pre/post AI performance & authorship evidence. 1 Introduction Figure 1: Overview of Integrity Shield . The system extracts question structure from an assessment PDF, uses LLM-based planner to select schema-aware watermarking tactics, & applies document-layer perturbations through the watermark engine. It outputs shielded PDF variants ( I S-v1 , I S-v2 ) & an attribution report summarizing AI vulnerability along with authorship signals. LLMs & MLLMs can now interpret full PDF assessments, reason over diagrams and tables, and produce fluent step-by-step solutions within seconds. While these capabilities expand access to high-quality assistance, they simultaneously undermine the credibility of homework and online exams by enabling students to outsource entire assessments to AI tools ( 10 ; 12 ; 11 ) . Institutions have responded with post-hoc detection (e.g., authorship classifiers ( 2 ; 13 ) ) & surveillance-heavy proctoring (e.g., keystroke, browser, or gaze monitoring ( 1 ; 5 ) ). However, detectors struggle with short answers, code, paraphrasing, & mixed authorship ( 8 ; 9 ) , while invasive monitoring raises significant privacy, accessibility, & equity concerns. These approaches share a fundamental limitation: they analyze the student’s output . In practice, the dominant workflow is the opposite-students upload instructor-provided PDFs to black-box AI systems. Existing watermarking methods, which modify generation at the model’s decoder ( 4 ; 7 ) , cannot operate in this setting. This motivates a new question: Can assessments themselves be instrumented so that AI reliance becomes observable, without altering visible exam content or student workflows? From detection to document-level watermarking. We exploit the render-parse gap in PDFs: what humans see often differs from what AI parsers ingest. By injecting invisible text, glyph remappings, and lightweight overlays, we influence model interpretation while leaving the exam visually unchanged. Integrity Shield operationalizes this idea as an authorship-aware watermarking system. Rather than asking whether a student cheated, we ask: to what extent do model-generated responses follow a consistent watermark signature embedded in the exam? This reframing provides instructors with an interpretable notion of authorship degree while maintaining fairness for honest students. Finally, we summarize our contributions as: • We introduce Integrity Shield , a document-layer watermarking system that embeds schema-aware watermarks into assessment PDFs while keeping their human-visible appearance unchanged. • We develop an LLM-driven planner and PDF watermark engine that adapt tactics to question type,achieving consistently high prevention (91-94% exam-level blocking) and strong detection reliability (89-93% retrieval) across four commercial MLLMs on a ten-exam benchmark. • We release an interactive demo that allows instructors to upload exams, preview watermarks, and inspect pre/post AI performance and authorship evidence, enabling ethical and transparent AI use in education. 2 Background and Related Work 2.1 AI assistance and mixed authorship LLMs increasingly participate in writing and problem-solving tasks, often producing blended human-AI content. Recent work formalizes this as homogeneous vs. heterogeneous mixed authorship ( 13 ) . Existing detectors-including perplexity-based methods ( 8 ) , style-based classifiers ( 2 ) , and multilingual cheating detectors ( 9 ) -struggle with short answers, paraphrasing, and multi-author mixtures, and they analyze only the output , leaving the assessment itself uninstrumented. 2.2 AI watermarking Watermarking embeds provenance signals into generated content, typically by modifying decoding distributions ( 4 ) or via prompt-based in-context cues ( 7 ) . Parallel work explores invisible watermarks for AI-generated writing that survive paraphrasing and editing ( 6 ) . These methods assume control over generation, which is infeasible when students query proprietary black-box systems using instructor-provided PDFs. 2.3 Document-layer perturbations Recent work shows that perturbing the PDF substrate-via phantom tokens, font CMaps, or off-page text-can induce systematic model errors without affecting human readability ( 3 ; 14 ) . Our work builds on these insights but shifts the objective: rather than deceiving models or detecting cheating, we embed recoverable watermark signatures that quantify the extent of AI involvement in solving an exam. 3 Integrity Shield System Architecture & Workflow 3.1 Design Principles Integrity Shield is designed as a practical tool for instructors who want to harden PDF-based assessments against AI assistants without redesigning their exams or changing grading workflows. The system keeps all human-facing content (layout, typography, pagination, item numbering) unchanged while embedding signals that reliably influence model-side parsing. It adapts watermark tactics to the item schema, treating MCQ , true/false , and Long-Form questions differently; remains robust across black box MLLMs; and exposes a lightweight web interface where instructors can upload assessments, preview watermark behavior, and inspect calibration and authorship signals with minimal configuration. 3.2 End-to-End Architecture and Workflow Figure 1 summarizes the end-to-end workflow of Integrity Shield . A single-page web front end communicates with a stateless backend that operates directly on the PDF substrate. The backend is organized around four logical services: document ingestion, which parses the uploaded PDF into a structured item schema with stems, options, diagrams, and answer keys; strategy planning, via a lightweight instruction-tuned LLM that assigns a watermark plan to each item based on its type, gold answer, and local layout metadata; PDF rewriting, which applies the plan while enforcing that the rendered appearance of the document remains unchanged; and an authorship and calibration service that runs reference models on original and watermarked PDFs and later scores submitted answers against stored watermark signatures. From an instructor’s perspective, this architecture is depicted in three-stage interaction flow. Figure 2: Stage 1: Upload & Watermark Planning. Instructors upload an assessment PDF & answer key, after which the system extracts question structure & previews the planned schema-aware watermarking strategies. Stage 1: Upload & Watermark Planning. The instructor uploads an exam PDF through the browser. The ingestion service segments pages into questions, detects answer options & numbering, & associates inline figures or tables with the relevant items, producing a compact item schema with content spans, page coordinates, and answer keys when available, best depicted in Figure 2 . The strategy planner then assigns, for each item, either a target distractor (for multiple-choice and true/false questions) or a small set of signature keyphrases (for long-form questions), and decides which document-layer mechanisms to apply. The interface presents a split-screen preview of original and watermarked pages with per-question summaries of the chosen strategy, allowing

Read the complete text