How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbations
Yuxing Cheng, Yuan Wu, Yi Chang · 2026
Read How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbations by Yuxing Cheng, Yuan Wu, Yi Chang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26041.txt.
Description
Yuxing Cheng, Yuan Wu, and Yi Chang probe a weak spot in vision-language models: reading text in damaged images. Models ace clean OCR benchmarks. Real inputs arrive blurred, warped, or noisy, though. Corruption can garble letters and break layout, which poisons later reasoning. Their OCR-Robust benchmark measures that fragility directly.
Samples number 812 across two subsets. One covers documents, scene text, receipts, handwriting, and maths. The other covers charts, diagrams, and tables. A pilot over eighteen distortions picked five representative types. Each runs at three severity levels. Eighteen models face the suite, from proprietary systems to OCR-plus-language pipelines. Clean accuracy does not predict robustness, the results show. Worst-case drops can be severe. Charts and tables prove far more fragile than document-like inputs, since their meaning lives in structure that damage destroys.
Catalog record
| CREATOR | Yuxing Cheng, Yuan Wu, Yi Chang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26041