The Drill-Down and Fabricate Test (DDFT): A Protocol for Measuring Epistemic Robustness in Language Models

Rahul Baxi · 2025

Read The Drill-Down and Fabricate Test (DDFT): A Protocol for Measuring Epistemic Robustness in Language Models by Rahul Baxi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23850.txt.

Introduction

Rahul Baxi proposes a stress test for a quality benchmarks rarely measure: how robustly a language model knows what it knows. Static tests such as MMLU can tell a knowledgeable model from an ignorant one. Not a solid model from one whose fact-checking collapses when information is compressed or an adversary plants fabrications. His Drill-Down and Fabricate Test probes exactly that epistemic robustness.

The protocol rests on a two-system picture of a model: a fluent semantic generator and an epistemic verifier that checks facts. Evaluating nine frontier models across eight domains at five compression levels, Baxi finds robustness essentially unrelated to model size or architecture family, while the ability to detect errors strongly predicted it. Some flagship models proved brittle and some smaller ones robust, challenging the assumption that scale buys reliability. Revised claims in this version avoid overgeneralizing beyond the tested conditions.

Catalog record

CREATORRahul Baxi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23850

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Drill-Down and Fabricate Test (DDFT): A Protocol for Measuring Epistemic Robustness in Language Models Rahul Baxi Abstract Current language model evaluations measure what models know under ideal conditions (full context, clear questions, no adversarial pressure) but not how robustly they know it under realistic stress. Static benchmarks like MMLU and TruthfulQA cannot distinguish a model that lacks knowledge from one whose verification mechanisms collapse when information degrades or adversaries probe for weaknesses. We introduce the Drill-Down and Fabricate Test (DDFT), a protocol that measures epistemic robustness: a model’s ability to maintain factual accuracy under progressive semantic compression and adversarial fabrication. We propose a two-system cognitive model to explain LLM behavior: a Semantic System that generates fluent text and an Epistemic Verifier that validates factual accuracy. DDFT is explicitly designed to stress-test the Verifier while monitoring the Semantic System. Our findings, based on evaluating 9 frontier models across 8 knowledge domains at 5 compression levels (1,800 turn-level evaluations), reveal that epistemic robustness is orthogonal to conventional design paradigms. Neither parameter count ( r = 0.083 r=0.083 , p = 0.832 p=0.832 , 95% CI: [-0.58, 0.68]) nor architectural type ( r = 0.153 r=0.153 , p = 0.695 p=0.695 , 95% CI: [-0.52, 0.71]) significantly predicts robustness. Confidence intervals computed via bootstrap resampling (10,000 iterations) confirm null results are stable despite small sample size ( n = 9 n=9 ), suggesting it emerges from training methodology and verification mechanisms distinct from current approaches. Error detection capability (the Epistemic Verifier’s ability to reject fabrications) strongly predicts overall robustness ( ρ = − 0.817 \rho=-0.817 , p = 0.007 p=0.007 ), indicating this is the critical bottleneck. We find that flagship models ( gpt-5 , claude-haiku-4-5 ) exhibit brittleness despite their scale, while smaller models ( o4-mini ) can achieve robust performance, challenging assumptions about the relationship between model size and reliability. The DDFT framework, Comprehension Integrity (CI) metric, and two-system model provide both theoretical foundation and practical tools for assessing epistemic robustness before deployment in critical applications. 1 Introduction Large Language Models (LLMs) have demonstrated remarkable capabilities in generating fluent and coherent text across a vast range of subjects. Standard evaluation benchmarks, such as MMLU ( 2 ) and HELM ( 8 ) , have been instrumental in tracking the progress of these models by measuring their factual knowledge and reasoning abilities on static question-answering tasks. However, these evaluations often fail to capture a critical dimension of knowledge: epistemic robustness . Epistemic robustness is not merely about knowing a fact, but about the stability and reliability of that knowledge under pressure, scrutiny, and information decay. 1.1 The Two-System Hypothesis We propose that LLM performance can be understood through a two-system cognitive model, analogous to System 1 and System 2 thinking in human psychology. The Semantic System (analogous to System 1) is the model’s core generative engine, which is fast, associative, and optimized to produce fluent, coherent text. This system, honed through large-scale pre-training, excels at pattern matching and can generate plausible-sounding responses for virtually any prompt. The Epistemic Verifier (analogous to System 2) is a secondary, more fragile system that validates outputs against an internal model of facts, logic, and constraints. While the Semantic System asks “what sounds right?”, the Epistemic Verifier asks “what is right?” This theoretical framework predicts a critical failure mode: semantic-epistemic dissociation , where the Semantic System operates flawlessly while the Epistemic Verifier fails. A model in this state produces responses that are fluent, coherent, and confidently wrong—the most dangerous type of error in high-stakes applications. Current benchmarks, which typically measure final output quality, cannot distinguish between a model that lacks knowledge and one whose verification system has collapsed under cognitive load. In high-stakes domains like medicine, finance, and law, a model’s ability to maintain factual accuracy when faced with incomplete context or misleading prompts is paramount. A model that can recite a textbook definition but hallucinates when asked for specifics presents a significant risk ( 3 ) . Recent work has begun to explore the complementary roles of uncertainty in LLM failures ( 5 ) , but comprehensive frameworks for measuring epistemic robustness remain scarce (see Section 2 for detailed positioning). To address this gap, we introduce the Drill-Down and Fabricate Test (DDFT) , a novel evaluation protocol explicitly designed to stress-test the Epistemic Verifier. The DDFT simulates a critical Socratic dialogue where a model is progressively challenged to provide more specific details while the informational context is simultaneously degraded. Crucially, the protocol culminates in an adversarial “fabrication” step, where the model is presented with a plausible-sounding but entirely fictitious piece of information—a direct test of the Verifier’s error-detection capabilities. By measuring performance throughout this process, we can move beyond a simple “right or wrong” assessment to a multi-dimensional understanding of a model’s epistemic architecture. This paper details the DDFT protocol, introduces a suite of new metrics that culminate in a holistic Comprehension Integrity (CI) index, and presents findings from applying this framework to a diverse set of state-of-the-art models. Our results reveal that epistemic robustness is orthogonal to both parameter count and architectural paradigm, suggesting it emerges from factors beyond current design principles. Key Innovations: DDFT introduces three novel elements absent from existing evaluations: 1. Progressive degradation: Models are tested across continuous compression levels (0.0 to 1.0), revealing when (not just if) they fail—the HOC metric captures this threshold, unlike binary pass/fail assessments. 2. Active deception: The fabrication trap (Turn 4) tests error detection against plausible falsehoods, unlike passive factuality checks in benchmarks like TruthfulQA that test resistance to common misconceptions. 3. Socratic stress-testing: The five-turn drill-down simulates adversarial questioning, probing knowledge depth through progressive specificity rather than breadth through diverse topics. Together, these map to a two-system cognitive architecture (Semantic System + Epistemic Verifier) that generates testable predictions about how LLMs fail under cognitive load. Intended Use: DDFT is designed as a diagnostic protocol for understanding model failure modes under epistemic stress, not as a leaderboard benchmark for model comparison. The CI index provides a risk profile to inform deployment decisions rather than a single quality score. We anticipate DDFT will be most valuable for: (1) developers conducting pre-deployment safety assessments, (2) researchers investigating the mechanisms of epistemic robustness, and (3) organizations evaluating models for high-stakes applications where factual accuracy under uncertainty is critical. 2 Related Work The DDFT framework addresses a critical gap in language model evaluation: measuring not just what models know, but how robustly they know it. We position our work relative to three research areas: hallucination detection and factuality benchmarks, adversarial robustness evaluation, and cognitive models of LLM verification. 2.1 Hallucination Detection and Factuality Benchmarks Recent work has developed various approaches to detect and quantify hallucinations in LLM outputs. SelfCheckGPT ( 12 ) detects hallucinations by measuring consistency across multiple sampled responses. If a model generates contradictory statements about the same fact, at least one must be fabricated. FActScore ( 15 ) evaluates factuality at atomic fact granularity, decomposing generated text into verifiable claims and checking each against a knowledge base. TruthfulQA ( 9 ) tests whether models generate truthful answers or reproduce common falsehoods, measuring resistance to imitative falsehoods learned from training data. HaluEval ( 7 ) provides task-specific

Read the complete text