Can We Trust LLM Detectors?
Jivnesh Sandhan, Harshit Jaiswal, Fei Cheng, Yugo Murawaki · 2026
Read Can We Trust LLM Detectors? by Jivnesh Sandhan, Harshit Jaiswal, Fei Cheng, Yugo Murawaki (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15301.txt.
Introduction
Jivnesh Sandhan, Harshit Jaiswal, Fei Cheng, and Yugo Murawaki ask whether AI text detectors can be trusted. Their 2026 arXiv paper deals with the tools meant to spot machine-written text. Demand for them has grown with the rapid spread of language models.
Yet detectors often fail outside tidy benchmarks. The authors evaluate the two dominant paradigms: training-free methods and supervised ones. Both prove brittle under distribution shift. New generators and even simple style changes can fool them. The sobering results warn against leaning too hard on these brittle detector scores in court or class.
Catalog record
| CREATOR | Jivnesh Sandhan, Harshit Jaiswal, Fei Cheng, Yugo Murawaki |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15301
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can We Trust LLM Detectors? Jivnesh Sandhan, Harshit Jaiswal, Fei Cheng, Yugo Murawaki Abstract The rapid adoption of LLMs has increased the need for reliable AI text detection, yet existing detectors often fail outside controlled benchmarks. We systematically evaluate 2 dominant paradigms (training-free and supervised) and show that both are brittle under distribution shift, unseen generators, and simple stylistic perturbations. To address these limitations, we propose a supervised contrastive learning (SCL) framework that learns discriminative style embeddings. Experiments show that while supervised detectors excel in-domain, they degrade sharply out-of-domain, and training-free methods remain highly sensitive to proxy choice. Overall, our results expose fundamental challenges in building domain-agnostic detectors. 1 1 1 Our code is available at: https://github.com/HARSHITJAIS14/DetectAI 1 Introduction The rapid adoption of large language models (LLMs) has intensified the need for reliable LLM detection, particularly in academic settings where pedagogical integrity and research authenticity are critical 10 . While many existing detectors report near-perfect in-domain accuracy, their reliability in real-world, out-of-distribution (OOD) settings remains questionable 11 . This mismatch between benchmark performance and practical robustness undermines trust in automated detection systems. In this work, we systematically evaluate the reliability of 2 dominant detection paradigms (training-free and supervised fine-tuning) and propose a new framework to mitigate their OOD failures. Current LLM detectors mainly follow 2 approaches. Supervised classifiers, often based on fine-tuned models such as BERT 5 , achieve high in-domain accuracy but tend to overfit to model-specific artifacts, leading to severe degradation on text from unseen generators. In contrast, training-free detectors, including DetectGPT 9 , Fast-DetectGPT 2 , and Binoculars 8 , rely on intrinsic statistical properties of generated text. Although appealing, their performance is highly sensitive to the choice of proxy model, introducing a distinct but equally problematic form of brittleness. Figure 1: Overview of the AI text detection task and proposed framework. Our framework integrates a supervised classifier with a supervised contrastive learning module that learns style embeddings, enabling robust detection. To address these limitations, we propose a supervised contrastive learning (SCL) framework that learns discriminative style embeddings separating human and machine-generated text. Using a DeBERTa-v3 backbone optimized with an InfoNCE loss, our method enables efficient few-shot adaptation to new LLMs with as few as 25 examples. Extensive experiments show that supervised detectors degrade substantially under distribution shift, while training-free methods remain fragile to proxy selection. We find that limited supervision improves generalization but does not fully resolve these issues. Our robustness analysis further reveals vulnerabilities to adversarial attacks and simple stylistic perturbations, highlighting severity of reliability these detectors. Our contributions are: • We show that both training-free and supervised detectors fail under domain shift. • We introduce a contrastive learning framework that improves robustness and enables few-shot adaptation to new LLMs. • We provide comprehensive OOD and adversarial analyses, providing evidence that it is not possible to built universal detector. 2 The proposed framework We use a pre-trained BERT model as our base model fine-tuned with binary classification objective. The model is trained by minimizing the binary cross-entropy loss function: \mathcal{L}_{\mathrm{BCE}}=-\left[y\log(p)+(1-y)\log(1-p)\right] (1) where y is the true label and p is the model’s predicted probability. We propose a Supervised Contrastive Learning (SCL) module illustrated in Figure 1 , inspired by recent successes in learning discriminative representations 7 ; 3 ; 1 . This module helps learning a meaningful style embeddings using a DeBERTa-v3 backbone and a projection head. It is trained with the InfoNCE loss function: \mathcal{L}_{\mathrm{InfoNCE}}=-\log\frac{\exp\!\left(\operatorname{sim}(z_{i},z_{j}^{+})/\tau\right)}{\sum_{k=1}^{N}\exp\!\left(\operatorname{sim}(z_{i},z_{k})/\tau\right)} (2) where z_{i} is an anchor embedding, z_{j}^{+} is a positive sample, \operatorname{sim}(\cdot,\cdot) is cosine similarity, and \tau is a temperature parameter. This objective structures the embedding space such that classes form distinct, coherent clusters. 3 Experiments Datasets: We use 3 datasets: CHEAT , with 35,304 academic abstracts for high-performance supervised evaluation 15 ; RAID , a large-scale benchmark with over 6 million texts from 11 LLMs across 8 domains for cross-domain comparison 6 ; and M4 , a multi-generator, multi-domain, and multi-lingual corpus designed for black-box detection that encompasses diverse linguistic settings and generative models to test detector generalization 13 . Baselines: We evaluate our method against two training-free and two supervised baselines. We use NVIDIA A100 and TITAN RTX GPUs with a learning rate of 2e-5 for models training. • Binocular: A perplexity-based, training-free detector compares token-level likelihoods under a base language model and its perturbed variant to find statistical regularities characteristic of AI-generated text 8 . • FastDetectGPT: A discrepancy-based, training-free approach that measures the divergence between the likelihood of a text under an original model and samples generated from it 2 . • BERT: A supervised BERT-base classifier fine-tuned for binary classification. • GAN-BERT: We adopt GAN-BERT 4 , which integrates adversarial learning with supervised text classification. The model comprises a generator and a discriminator: the generator maps Gaussian noise z\sim\mathcal{N}(0,1) to synthetic embeddings that mimic BERT representations, while the discriminator receives either real BERT embeddings or generated ones and predicts k+1 classes (the k task labels plus a “fake” class). • Ours: The proposed method describe in § 2 . Main Results: Dataset Method Acc. Prec. Recall F1 FPR RAID FastDetectGPT 34.63% 92.00% 2.00% 4.00% 0.35 % Binoculars 82.81% 93.61% 79.65% 86.07% 10.87% GAN-BERT 95.72% 95.85% 97.81% 96.82% 8.50% BERT 95.31% 94.37% 98.86 % 96.56% 11.80% Ours 95.98 % 100.00 % 94.00% 97.00 % 0.90% CHEAT FastDetectGPT 54.33% 97.00% 9.00% 16.00% 0.32 % Binoculars 97.41% 95.49% 99.52 % 97.46% 4.70% GAN-BERT 83.56% 77.81% 93.90% 85.10% 26.80% BERT 76.75% 68.46% 99.22% 81.02% 45.72% Ours 97.83 % 98.00 % 98.00% 98.00 % 2.00% M4 FastDetectGPT 49.99% 0.00% 0.00% 0.00% 0.02 % Binoculars 71.35% 96.15 % 44.48% 60.82% 1.78% GAN-BERT 76.12 % 77.44% 73.72 % 75.53 % 21.50% BERT 66.42% 69.44% 58.66% 63.59% 25.82% Ours 50.83% 66.00% 4.00% 7.00% 1.84% Table 1: Results of all baselines on the in-domain RAID and out-of-domain (CHEAT, M4) benchmarks. Supervised methods outperform training-free approaches in-domain, while all models degrade under OOD shifts. Our method achieves the best performance on RAID and generalizes to CHEAT, but fails on M4 due to substantial domain mismatch, highlighting the difficulty of building a universal LLM detector across domains and models. Table 1 summarizes results on the in-domain RAID dataset and the out-of-domain (OOD) CHEAT and M4 benchmarks. In-domain, supervised methods clearly outperform training-free approaches, with FastDetectGPT exhibiting extremely low recall, while Binoculars provides moderate gains. Among supervised models, GAN-BERT and BERT achieve strong performance, but our method attains the best overall results on RAID, achieving the highest accuracy and F1-score, perfect precision, and the lowest false positive rate. Under OOD evaluation, all methods show performance degradation. On CHEAT, our method generalizes well and achieves the best accuracy and F1-score with a low false positive rate, outperforming other supervised baselines. In contrast, on M4, performance drops sharply for all models; while GAN-BERT performs best among baselines, our method fails to generalize, with very low recall and F1. Overall, these results show that supervised detectors dominate in-domain settings, OOD shifts remain challenging, and achieving a universal LLM detector that generalizes across diverse domains and models remains difficult. Why does our approach succeed on OOD CHEAT but fail on OOD M4? We analyze OOD generalization by evaluating models trained on RAID against the CHEAT and M4 benchmarks. Our