UVLM: A Universal Vision-Language Model Loader for Reproducible Multimodal Benchmarking

Joan Perez, Giovanni Fusco · 2026

Read UVLM: A Universal Vision-Language Model Loader for Reproducible Multimodal Benchmarking by Joan Perez, Giovanni Fusco (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13893.txt.

Description

Perez and Fusco present UVLM, a shared loader that runs several vision-language models through one interface on Google Colab. Model families differ in vision encoders, tokenizers, and decoding, which makes fair comparisons hard. UVLM hides those gaps behind a single inference function with identical prompts. It supports LLaVA-NeXT and Qwen2.5-VL so far. Features include four answer types, majority-vote checks over repeat runs, and a chain-of-thought reference mode for benchmarking.

Catalog record

CREATORJoan Perez, Giovanni Fusco
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60363
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13893

Browse the full library · About the Tower of Babel