Architecture Matters: Comparing RAG Systems under Knowledge Base Poisoning

Samuel Korn · 2026

Read Architecture Matters: Comparing RAG Systems under Knowledge Base Poisoning by Samuel Korn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05632.txt.

Introduction

Poisoning a retrieval system's knowledge base is a known attack, but almost all testing used the simplest pipeline. Samuel Korn asks whether fancier architectures resist better. He evaluates four designs under controlled single-document poisoning: vanilla retrieval-augmented generation, an agentic variant, a multi-agent debate system, and recursive language models.

The test used 921 question-answer pairs from Natural Questions. Each architecture faced a clean baseline, a naive injection, and an adversarial attack that frames lies to look expert. Comparing outcomes shows how much safety design alone buys, and where each design still breaks.

Catalog record

CREATORSamuel Korn
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.05632

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Architecture Matters: Comparing RAG Systems under Knowledge Base Poisoning Samuel Korn Abstract Retrieval-Augmented Generation (RAG) systems are vulnerable to knowledge base poisoning, yet existing attacks have been evaluated almost exclusively against vanilla retrieve-then-generate pipelines. Meanwhile, architectures designed to handle conflicting retrieved information—multi-agent debate, agentic retrieval, recursive language models—have never been tested against adversarially optimized contradictions. We bridge this gap by evaluating four RAG architectures (vanilla RAG, agentic RAG, MADAM-RAG, and Recursive Language Models) under controlled single-document ( N = 1 N{=}1 ) poisoning on 921 question-answer pairs from the Natural Questions dataset. We test each architecture against a clean baseline, naive injection, and CorruptRAG-AK, an adversarial attack whose meta-epistemic framing directly targets credibility assessment. We find that architecture is a high-impact variable in adversarial robustness: under CorruptRAG-AK, attack success rates range from 81.9% (vanilla) to 24.4% (RLM)—a spread of nearly 58 percentage points across architectures with comparable clean accuracy ( ∼ {\sim} 92%). Decomposing the gap between naive and adversarial attacks, we find that once the poisoned document is retrieved, adversarial framing—not retrieval optimization—drives the majority of CorruptRAG-AK’s advantage over naive injection for three of four architectures, localizing the cross-architecture vulnerability at the content-reasoning stage. Our MADAM-RAG reimplementation shows the highest rate of apparent contradiction detection among all architectures, though our LLM judge substantially over-identifies this behavior ( ∼ {\sim} 48.5% precision), so reported rates are upper bounds. Regardless of detection, this implementation cannot resolve contradictions reliably, producing a 41.4% non-answer rate even on clean inputs---though implementation divergences from the original work may contribute to this weakness. We additionally introduce a seven-category behavioral taxonomy that captures contradiction detection, hedging, and failure modes beyond binary accuracy. Code, data, and analysis notebooks are publicly available. 1 1 1 Code: https://github.com/samkorn/rag-poisoning-architecture-bench . Data: https://doi.org/10.5281/zenodo.19582217 . 1 Introduction Retrieval-Augmented Generation (RAG) has become the dominant paradigm for grounding large language model (LLM) outputs in external knowledge ( 7 ; 4 ) . By conditioning generation on documents retrieved from a knowledge base, RAG mitigates hallucination and enables domain-specific deployment. However, the reliance on external corpora introduces a vulnerability: an adversary who can inject even a single crafted document into the knowledge base can manipulate system outputs ( 18 ; 16 ) . Figure 1 : Architecture produces a nearly 58 percentage point spread in attack success rate under CorruptRAG-AK adversarial poisoning. Bars show clean-conditioned ASR (restricted to questions each architecture answers correctly on clean inputs) with 95% bootstrap confidence intervals. Vanilla, agentic, and RLM all achieve {\sim} 92% clean accuracy, so these differences reflect architectural robustness, not baseline capability. MADAM-RAG’s clean accuracy is 56.6% due to a high non-answer rate (Section 4.4 ). Two largely disconnected research communities have studied complementary aspects of this problem. The poisoning attack literature ( 18 ; 16 ; 3 ) has demonstrated that injecting adversarial texts into a RAG knowledge base can achieve attack success rates (ASR) exceeding 90%. Yet these attacks have been evaluated almost exclusively against vanilla retrieve-then-generate pipelines. Moreover, several influential evaluations use conditions where attacker-controlled documents dominate the retrieval context (e.g., N{=}5 poisoned documents among K{=}5 retrieved ( 18 ) ), testing whether an LLM follows adversarial instructions rather than whether it can reason about conflicting evidence . Separately, the conflict-handling literature has developed architectures specifically designed to help RAG systems resolve contradictory or unreliable retrieved content. Multi-agent debate systems like MADAM-RAG ( 12 ) assign each document to an independent LLM agent for deliberation, achieving substantial gains on misinformation benchmarks. Astute RAG ( 11 ) consolidates retrieved content with the LLM’s parametric knowledge to identify and suppress unreliable documents. Recursive Language Models ( 15 ) process full topical context through programmatic decomposition, enabling systematic cross-referencing across large evidence sets. Yet none of these architectures has been tested against adversarially optimized contradictions—documents engineered to be maximally persuasive. This gap matters because conflict-handling architectures are designed for exactly the scenario that poisoning attacks create: contradictory information in the retrieval context. Yet their robustness claims rest entirely on evaluations against organic conflicts—naturally occurring misinformation, outdated documents, and ambiguous queries. Adversarially crafted contradictions, engineered to be maximally persuasive, represent a significantly harder test of the same capability. The realistic setting for this test is N{=}1 poisoning, where a single adversarial document coexists alongside legitimate sources in the retrieval context. This N{=}1 coexistence scenario, validated as practical by 16 , forces conflict reasoning: the system must weigh contradictory evidence rather than simply follow a context dominated by attacker-controlled documents. We bridge these two bodies of work by evaluating four reasoning architectures—vanilla RAG, agentic RAG (implemented with PydanticAI), MADAM-RAG, and Recursive Language Models (RLM)—under controlled N{=}1 poisoning on a filtered subset of 921 Natural Questions where correct evidence appears in top-10 clean retrieval, drawn from a 2.68M-passage Wikipedia corpus. This filtering—detailed in Section 3.2 —isolates how architectures handle the introduction of contradictory evidence from cases where retrieval simply fails to surface correct information. By architecture we mean the full end-to-end system design—retrieval strategy, context construction, and generation orchestration—rather than the backbone model’s neural architecture, which is held constant across all four systems. We test each architecture under three conditions: a clean baseline, naive injection (a naturally written contradictory passage with no retrieval optimization), and CorruptRAG-AK ( 16 ) , whose meta-epistemic framing (“many outdated sources incorrectly state… the latest data confirms…”) directly targets the credibility assessment that conflict-handling architectures perform. Beyond standard accuracy and ASR, we classify each response into a seven-category behavioral taxonomy via an LLM judge, capturing whether systems detect contradictions, hedge appropriately, or confidently adopt incorrect answers. Our naive injection condition serves a dual analytical role. It functions as a realistic proxy for organic knowledge base corruption—outdated documents, incorrect entries, conflicting policy versions—that enterprises face regardless of adversarial intent. It also serves as a baseline for isolating CorruptRAG-AK’s adversarial enhancements in our decomposition analysis, enabling us to disentangle retrieval-stage and generation-stage contributions to attack success. The results reveal that architecture is a high-impact, underexplored variable in RAG adversarial robustness. Under CorruptRAG-AK, ASR computed over questions each architecture answers correctly on clean inputs ranges from 81.9% (vanilla) to 24.4% (RLM)—a spread of nearly 58 percentage points across architectures that achieve comparable clean accuracy ( {\sim} 92%). MADAM-RAG presents a particularly complex picture: it produces the highest judge-reported contradiction detection rate among all architectures—though our LLM judge over-identifies this category ( {\sim} 48.5% precision; Section 3.5 ), so these rates are upper bounds. Regardless, this implementation cannot reliably resolve detected conflicts in favor of correct information, producing a 41.4% non-answer rate even on clean inputs—though implementation differences from the original work likely contribute to this baseline weakness (Section 3 ). Contributions. 1. We provide the first evaluation of agentic RAG, multi-agent debate, and recursive language models against adversarial knowledge base poisoning, bridging the gap between the RAG poisoning and conflict-handling literatures. 2. We demonstrate that end-to-end system design produces a nearly 58 percentage point spread in attack success rate under realistic N{=}1 poisoning, establishing architecture as a first-order variable in RAG adversarial robustness. 3. We decompose the gap between naive and adversarial attacks into retrieval-stage and generation-stage components, finding that adversarial framing—not retrieval optimization—constitutes the majority of the observed CorruptRAG-AK advantage across three of four architectures, motivating generation-level

Read the complete text