A Simple Data Augmentation Strategy for Text-in-Image Scientific VQA
Belal Shoer, Yova Kementchedjhieva · 2025
Read A Simple Data Augmentation Strategy for Text-in-Image Scientific VQA by Belal Shoer, Yova Kementchedjhieva (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20119.txt.
Description
Belal Shoer and Yova Kementchedjhieva wrote this 2025 arXiv paper on science questions with images. In one test format, the figure, question, and answer options all sit inside a single image. Even the best commercial models do poorly on this format without extra training. Training data in this style is scarce.
The authors create new training data by merging separate image and text pairs into single images. They then fine-tune a small multilingual vision-language model on a mix of this synthetic data and the original exam set. The tuned model gained clearly across thirteen languages. Gains also transferred to languages beyond the training mix. The recipe is simple, and it shows how data design can matter as much as model size.
Catalog record
| CREATOR | Belal Shoer, Yova Kementchedjhieva |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-20119