PixelRAG : Web Screenshots Beat Text for Retrieval-Augmented Generation
Yichuan Wang, Zhifei Li, Zirui Wang, Paul Teiletche, Lesheng Jin, Matei Zaharia, Joseph E. Gonzalez, Sewon Min · 2026
Read PixelRAG : Web Screenshots Beat Text for Retrieval-Augmented Generation by Yichuan Wang, Zhifei Li, Zirui Wang, Paul Teiletche, Lesheng Jin, Matei Zaharia, Joseph E. Gonzalez, Sewon Min (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28344.txt.
Description
Yichuan Wang and seven colleagues argue that web retrieval should skip text altogether. Today's retrieval systems parse web pages into plain text, throwing away layout, formatting, and visual structure, even though the web was designed to be seen. Their PixelRAG system instead stores and reads pages as screenshots.
PixelRAG indexes tens of millions of Wikipedia screenshots with a visual retrieval model fine-tuned on screenshot pairs, then hands retrieved images straight to a vision-language model. It beat text-based and no-retrieval baselines across question answering benchmarks, even text-centered ones, with gains reaching roughly eighteen percent on some tasks. Lower-resolution screenshots cut token costs up to threefold while holding accuracy. Keeping pages in their native visual form, the results suggest, can improve both quality and efficiency.
Catalog record
| CREATOR | Yichuan Wang, Zhifei Li, Zirui Wang, Paul Teiletche, Lesheng Jin, Matei Zaharia, Joseph E. Gonzalez, Sewon Min |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28344