Addressing Corpus Knowledge Poisoning Attacks on RAG Using Sparse Attention
Sagie Dekel, Moshe Tennenholtz, Oren Kurland · 2026
Read Addressing Corpus Knowledge Poisoning Attacks on RAG Using Sparse Attention by Sagie Dekel, Moshe Tennenholtz, Oren Kurland (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04711.txt.
Description
Sagie Dekel, Moshe Tennenholtz, and Oren Kurland defend retrieval-augmented generation against poisoned texts in a 2026 paper. Such systems fetch texts to ground a language model's answer, but attackers can inject misleading texts that steer the output.
The authors blame standard causal attention, which lets fetched texts sway each other inside the model. Their defense, called SDAG, uses sparse attention that blocks cross-attention between distinct fetched texts. Only a small change to the attention mask at run time is needed. In question-answering tests under varied attack plans, SDAG beat standard attention by a lot. Mixing it with leading defenses improved results further, with gains over the past state of the art that passed significance checks.
Catalog record
| CREATOR | Sagie Dekel, Moshe Tennenholtz, Oren Kurland |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04711