RobustVisRAG: Causality-Aware Vision-Based Retrieval-Augmented Generation under Visual Degradations

I-Hsiang Chen, Yu-Wei Liu, Tse-Yu Wu, Yu-Chien Chiang, Jen-Chieh Yang, Wei-Ting Chen, National Taiwan University · 2026

Read RobustVisRAG: Causality-Aware Vision-Based Retrieval-Augmented Generation under Visual Degradations by I-Hsiang Chen, Yu-Wei Liu, Tse-Yu Wu, Yu-Chien Chiang, Jen-Chieh Yang, Wei-Ting Chen, National Taiwan University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22013.txt.

Description

Vision-based retrieval systems answer questions by pulling up relevant pictures and documents, but blur, noise, dim light, and shadows can throw them off. I-Hsiang Chen and five co-authors trace the failure to visual encoders that tangle what a picture shows with how it is degraded. They propose RobustVisRAG, a two-path design that separates damage signals from clean meaning before answering.

One path captures degradation cues through one-way attention, while the other learns purified meaning guided by those cues, trained with two new objectives that keep the two strands apart. The split keeps retrieval and answer quality steadier under harsh visual conditions, without giving up speed or zero-shot skill. The result is a retrieval system that holds up when the pictures it reads are far from perfect.

Catalog record

CREATORI-Hsiang Chen, Yu-Wei Liu, Tse-Yu Wu, Yu-Chien Chiang, Jen-Chieh Yang, Wei-Ting Chen, National Taiwan University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-22013

Browse the full library · About the Tower of Babel