AI Detectors Fail Diverse Student Populations: A Mathematical Framing of Structural Detection Limits
N.A. Garland · 2026
Read AI Detectors Fail Diverse Student Populations: A Mathematical Framing of Structural Detection Limits by N.A. Garland (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20254.txt.
Introduction
Garland proves that AI text detectors face structural limits that no better engineering can remove. Student reports and studies show high false positive rates, skewed against some groups. Standard theory treats detection as a test between two known distributions. In real grading, the assessor does not know each student's own writing distribution. That makes the null hypothesis composite, and total variation bounds bite. Any useful text only detector must then false accuse at a rate set by population overlap. Scores alone should never ground misconduct cases, he argues.
Catalog record
| CREATOR | N.A. Garland |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35100 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20254
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI Detectors Fail Diverse Student Populations: A Mathematical Framing of Structural Detection Limits N.A. Garland Abstract Student experiences and empirical studies report that “black box” AI text detectors produce high false positive rates with disproportionate errors against certain student populations, yet typically theoretical analyses model detection as a test between two known distributions for human and AI prose. This framing omits the structural feature of university assessment whereby an assessor generally does not know the individual student’s writing distribution, making the null hypothesis composite. Standard application of the variational characterisation of total variation distance to this composite null shows trade-off bounds that any text-only, one-shot detector with useful power must produce false accusations at a rate governed by the distributional overlap between student writing and AI output. This is a constraint arising from population diversity that is logically independent of AI model quality and cannot be overcome by better detector engineering or technology. A subgroup mixture bound connects these quantities to observable demographic groups, providing a theoretical basis for the disparate impact patterns documented empirically. We propose suggestions to improve policy and practice, and argue that detection scores should not serve as sole evidence in misconduct proceedings. 1 Introduction The deployment of AI text detection tools in university assessment has become widespread, driven by legitimate concerns about academic integrity in the era of large language models (LLMs) (see 20 ; 16 ). However, a growing body of empirical work has documented serious problems with these tools. For example, 21 tested 14 detection tools and found that none achieved 80% accuracy, with all tools producing false positives (human-written text flagged as AI-generated) and false negatives (AI-generated text classified as human-written). 15 demonstrated that detectors disproportionately flag non-native English speakers, raising equity concerns. 6 found inconsistencies across detection tools when applied to human-written control samples. Most recently, 8 evaluated detector accuracy for institutions serving English as a Foreign Language learners, concluding that current tools are “unsuitable as authoritative arbiters of authorship” and that institutions should approach detection “with caution and nuance.” The broader implications of LLMs for assessment validity and fairness have been recognised by the educational measurement community 9 , but a formal statistical framework connecting population diversity to structural detection limits has not yet been developed. These empirical findings paint a consistent picture: current AI text detectors are unreliable, particularly for diverse student populations. But the existing literature largely treats each study’s findings as properties of particular detectors that might be improved by better engineering. In this paper, we ask a different question: are there structural reasons why any text-only, one-shot detector must face a trade-off between detection power and false accusations, independent of detector quality? We show that the answer is yes, and that the source of this structural barrier is population diversity —the natural variation in writing style, ability, and linguistic background across a student body. This is distinct from, and complementary to, the widely-discussed problem of AI text quality converging toward human text ( 18 ; 2 ) . Existing theoretical analyses ( 18 ; 2 ) model AI detection as a binary test between two known distributions: p_{H} (“the” human distribution) versus p_{M} (“the” AI distribution). They show that as these distributions converge, detection approaches random guessing. But in a university, there is no single “human distribution.” Each student writes differently, and the assessor typically does not know an individual student’s writing characteristics when evaluating a submission. The null hypothesis is not “this was drawn from p_{H} ” but rather: “This document was written by student i , whose writing distribution p_{\theta_{i}} is unknown.” In the language of statistical hypothesis testing ( 14 ) , this is a composite null hypothesis - the null distribution is not a single known entity but a family \{p_{\theta}:\theta\in\Theta\} indexed by student characteristics. This seemingly simple reframing has concrete, quantifiable consequences for what any detector can achieve. In this work we present our arguments towards modelling a “black-box” university one-shot AI detection as a composite hypothesis test with a composite null, making explicit a structural feature that prior theoretical work overlooks. We identify population diversity as a source of detection difficulty that is logically independent of AI quality, and show precisely what policy levers can address each mode (Section 4.1 ). We show a bound that helps to connect the theoretical overlap quantities to observable, real student subgroups, providing a bridge to the bias and auditing evidence documented by 15 , 21 , 6 , and 8 . We conclude by proposing a concrete stratified FPR auditing procedure that institutions can implement with existing data (Section 4.5 ). The proof techniques are standard applications of the total variation (TV) distance variational inequality. We make no claim to have discovered new results in hypothesis testing theory. This present contribution is the applied formalisation, the conceptual separation of failure modes, and the connection to institutional practice enabled by relatively elementary mathematical exercises with fundamental statistics definitions. 2 Background We briefly review the two main theoretical results in the literature, highlighting the structural assumption that each makes. The key mathematical tool is the total variation (TV) distance between two probability distributions P and Q , defined as \displaystyle\mathrm{TV}(P,Q)=\sup_{A}|P(A)-Q(A)|=\frac{1}{2}\int_{\mathcal{X}}|p(x)-q(x)|\,d\mu(x), (1) where \sup is the supremum, and A is any event possible in the set of all possible text documents (the sample space), \mathcal{X} , with reference measure \mu(x) . For any test function, which we will shortly formalise as our detector, \phi:\mathcal{X}\to[0,1] , the variational inequality gives |\mathbb{E}_{P}[\phi]-\mathbb{E}_{Q}[\phi]|\;\leq\;\,\mathrm{TV}(P,Q), (2) where \mathbb{E}_{P}[\phi]=\int_{\mathcal{X}}\phi(x)p(x)d\mu(x) is the expectation of \phi over a given distribution P . This single inequality is the only mathematical tool used in our analysis. In terms of distributional convergence, 18 applies ( 2 ) to a known human distribution P_{H} and AI distribution P_{M} , and show any detector’s power exceeds its false positive rate by at most \,\mathrm{TV}(P_{H},P_{M}) . As AI models improve and \mathrm{TV}(P_{M},P_{H})\to 0 , all detection metrics degrade. A key assumption was that both P_{H} and P_{M} are single, known distributions. For multi-sample detection, the work of ( 2 ) demonstrates reliable detection requires O(1/\delta^{2}) independent samples when \mathrm{TV}(p_{M},p_{H})=\delta>0 . In the one-shot setting ( n=1 ), this provides no useful guarantee when \delta is small. Again, their study assumed both distributions were known with multiple independent and identically distributed samples available. The structural gap is that neither result addresses the case where the null distribution varies across the population and is unknown for each individual. This is precisely the situation in university assessment. The one-shot AI detection problem is also structurally related to authorship verification without enrolment in computational stylometry ( 13 ; 19 ; 5 ) . In that setting, one must determine whether a questioned document was written by a claimed author, given no (or very limited) reference material from that author. Both problems have a composite null in that the writer’s distribution is unknown. The fundamental difficulty of verification without enrolment data is well-established in the stylometry community ( 13 ; 19 ) . The key structural asymmetry is that the alternative p_{M} is, in principle, known as a detector software designer can query AI systems and characterise their output distribution, and define rules. Classical authorship