Oasis : One Image is All You Need for Multimodal Instruction Data Synthesis

Letian Zhang Quan Cui Bingchen Zhao Cheng Yang · 2025

Read Oasis : One Image is All You Need for Multimodal Instruction Data Synthesis by Letian Zhang Quan Cui Bingchen Zhao Cheng Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08741.txt.

Description

Models that can see and read need huge sets of image-and-instruction pairs for training, and collecting them by hand is slow and costly. Letian Zhang and co-authors propose Oasis, a method that grows such training data from images alone. A multimodal model is shown only a picture and prompted to invent the questions, instructions, and answers that fit it.

Starting from pictures alone stretches the range of topics far beyond what fixed templates produce. A quality-control step filters the synthetic pairs before they enter the dataset. The team built more than half a million pairs this way and used them to keep training a public vision-language model. The extra data clearly raised the model's scores, and the approach lets builders target special domains by choosing the seed images.

Catalog record

CREATORLetian Zhang Quan Cui Bingchen Zhao Cheng Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-08741

Browse the full library · About the Tower of Babel