Visual-RAG: Benchmarking Text-to-Image Retrieval Augmented Generation for Visual Knowledge Intensive Queries
Yin Wu, Quanyu Long, Jing Li, Jianfei Yu, Wenya Wang · 2025
Read Visual-RAG: Benchmarking Text-to-Image Retrieval Augmented Generation for Visual Knowledge Intensive Queries by Yin Wu, Quanyu Long, Jing Li, Jianfei Yu, Wenya Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16636.txt.
Description
Yin Wu and four co-authors present Visual-RAG in a 2025 paper, a test set for systems that answer hard questions with help from pictures. Many question systems search written text and feed what they find to a language model. Some questions, though, can only be answered from visual clues, and past test sets did not isolate that skill.
Visual-RAG pairs each question with clue images that the system must find and use. The team tested eight current models, five of them open and three closed. Pictures clearly helped the models answer, yet even the best systems often failed to pull the right facts out of the images they found. The results point to weak spots in image search and image reading that builders still need to fix.
Catalog record
| CREATOR | Yin Wu, Quanyu Long, Jing Li, Jianfei Yu, Wenya Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-16636