Exploring LLM biases to manipulate AI search overview
Roman Smirnov · 2026
Read Exploring LLM biases to manipulate AI search overview by Roman Smirnov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00012.txt.
Description
Roman Smirnov investigates whether the biases of large language models can be exploited to rig AI search overviews. Such overview systems use a model to pick the most relevant sources from search results and compose an answer. Bias can enter at both stages, and Smirnov focuses mainly on source selection, asking whether a snippet can be rewritten to win the model's favor.
He trains a small language model with reinforcement learning to rewrite search snippets so an overview system prefers them. The setup deliberately limits the rewriter to snippets and blocks easy reward hacking, matching real search conditions. The results show the overviews are biased, that the rewriting usually succeeds, and that choices turn on comparative rather than absolute advantage. Context poisoning can also push such systems toward wrong or harmful answers.
Catalog record
| CREATOR | Roman Smirnov |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.00012