The Vulnerability of LLM Rankers to Prompt Injection Attacks
Yu Yin, Shuai Wang, Bevan Koopman, Guido Zuccon · 2026
Read The Vulnerability of LLM Rankers to Prompt Injection Attacks by Yu Yin, Shuai Wang, Bevan Koopman, Guido Zuccon (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16752.txt.
Description
Yu Yin, Shuai Wang, Bevan Koopman, and Guido Zuccon study how prompt injection attacks threaten language-model-based rankers. Simple injected prompts hidden in a candidate document can sharply shift ranking decisions, posing serious security risks for ranking pipelines. How far that weakness spans model families, designs, and settings was largely unexplored.
The paper runs a broad empirical study of jailbreak prompt attacks on rankers. Two tasks frame it: preference vulnerability, gauged by attack success rate, and ranking vulnerability, gauged by ranking quality impact. Three ranking paradigms and two injection variants are tested, along with scaling across families, position sensitivity, backbones, and cross-domain robustness. Search engineers get a map of where ranker vulnerability holds and where it fades.
Catalog record
| CREATOR | Yu Yin, Shuai Wang, Bevan Koopman, Guido Zuccon |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-16752