"În t , elegi române s , te?" A Recipe for Romanian Vision-Language Models

Mihai Masala, Marius Leordeanu, Mihai Dascalu, Traian Rebedea · 2026

Read "În t , elegi române s , te?" A Recipe for Romanian Vision-Language Models by Mihai Masala, Marius Leordeanu, Mihai Dascalu, Traian Rebedea (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31401.txt.

Introduction

Masala and colleagues build a vision-language model for Romania. Vision-text models shine on English tests but fade on low-resource languages. The team renders English training and test corpora in Romanian, using machine translation for textual notes. Training and testing models isolates the roles of vision bases, wide and Romania-tuned language bases, and OCR-style image-text data. A new HoraVQA test set from daily scenes in Romania completes the pipeline. Romania-tuned models beat same-sized and larger-category rivals.

Catalog record

CREATORMihai Masala, Marius Leordeanu, Mihai Dascalu, Traian Rebedea
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47741
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.31401

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

"În t , elegi române s , te?" A Recipe for Romanian Vision-Language Models Mihai Masala, Marius Leordeanu, Mihai Dascalu, Traian Rebedea Abstract Vision-Language Models (VLMs) largely follow the text-only LLM trajectory, excelling on English benchmarks but sharply degrading on low-resource languages, where neither large-scale image-text corpora nor culturally grounded evaluations exist. We present a systematic study of building a language-specific VLM for Romanian, covering the full pipeline from data construction to architectural choices. We translate established English VLM training and evaluation corpora into Romanian, applying machine translation to textual annotations and to in-image text, preserving visual grounding while adapting the textual content. Using this data, we train and ablate a series of VLMs to isolate the contribution of (i) vision backbones of varying scale and pretraining, (ii) language backbones from multilingual to Romanian-adapted LLMs, and (iii) OCR-style image-text data. We further curate HoraVQA, a culturally native evaluation set grounded in Romanian everyday scenes. Romanian-adapted VLMs consistently outperform their same-sized counterparts and, across all evaluated benchmarks, even surpass models from the next larger size category. 1 Introduction Recent Vision-Language Models (VLMs) have achieved strong multilingual capabilities, largely driven by advances in multilingual Large Language Models (LLMs) and large-scale multimodal pretraining. However, it remains unclear how effectively these capabilities transfer to grounded multimodal understanding in lower-resource languages 26 . While current systems can often generate fluent responses in many languages, tasks involving OCR, document image understanding, culturally grounded reasoning, and localized visual semantics remain insufficiently studied. A major challenge is the lack of comprehensive multimodal resources and evaluation frameworks for many languages. Existing datasets often under-represent naturally occurring image-text pairs, domain-specific documents, and culturally relevant visual contexts, making it difficult to systematically assess model behavior beyond general conversational ability. As a result, there has been a growing effort to develop language- or region- specific multimodal benchmarks 21 ; 6 to more accurately evaluate model performance across diverse linguistic and cultural contexts. In this work, we take a step further by not only studying cross-lingual multimodal evaluation, but also examining the role of language-specific training data, including translated and aligned image–text pairs, in improving VLM performance for low-resource languages. We also construct a comprehensive evaluation suite that contains 19 benchmarks spanning OCR, visual question answering, captioning, and reasoning tasks, and investigate adaptation strategies for multilingual vision-language models. Our experiments show that strong multilingual text capabilities do not consistently translate into robust multimodal performance, particularly in OCR-intensive and culturally grounded settings. We further analyze how data composition and instruction tuning affect low-resource multimodal transfer. Our contributions can be summarized as follows: • We introduce a comprehensive Romanian multimodal evaluation suite, consisting of 19 benchmarks spanning OCR, visual question answering, captioning, and reasoning, including a novel fully human-annotated culturally grounded test set. • We conduct a systematic study of training strategies for multilingual VLM adaptation, including ablations over text and vision backbones, and analyze the role of OCR and data composition in low-resource multimodal performance. • We introduce HoraVQA (" hora " is a Romanian circle dance that signals community and tradition), a culturally native evaluation set of more than 500 question-answer pairs grounded in Romanian everyday scenes; • We release RoVLM models for Romanian multimodal understanding along with a fully open and reproducible training and evaluation pipeline, including data processing, training recipes, and evaluation protocols. 1 1 1 www.openllm.ro 2 Related Work Vision-language models (VLMs) have rapidly evolved from contrastive image-text representation learning approaches such as CLIP 33 into large instruction-tuned multimodal systems capable of visual reasoning, captioning, and dialogue 36 ; 41 . Modern VLMs couple a vision encoder to an LLM and are trained with visual instruction tuning, LLaVA 27 , InstructBLIP 14 , and recent open families such as Qwen-VL 41 ; 4 , InternVL 11 ; 42 , and PaliGemma 5 . We adopt this modular recipe as the backbone for Romanian adaptation. Alongside these advances, recent work has increasingly explored multilingual extensions of VLMs. Multilingual coverage has been pursued either at pretraining scale 10 ; 9 ; 12 ; 39 or via translated instruction data: M3IT 25 , PALO 29 , and Maya 1 . Aya Vision 16 adds synthetic multilingual annotation and cross-modal model merging to limit text-only forgetting, and LRM-LLaVA 24 argues that residual gaps stem from a modality gap between visual inputs and non-English text. 20 further show that LLaVA-style models drift toward English responses when an image is present – a failure mode our Romanian-only adaptation directly targets. Several existing works adapt VLMs to a single language: LLaVA-NDiNO for Italian 30 , LaVy for Vietnamese 38 , Qolda for Kazakh 2 and, closest to us 18 who LoRA-tune LLaMA/LLaVA/Qwen variants on a translated Romanian Flickr30k. RoVLM differs in scope: a 3.1M-sample mix containing alignment, captioning, instruction VQA, OCR/documents, grounding data, 19-benchmark evaluation, and in-image text translation. Parallel evaluation probes how VLMs behave across languages and cultures. Early work translated tasks or multilingual captions and VQA, including MaRVL 26 , Crossmodal-3600 37 , and MaXM 7 . More recent benchmarks shift toward culturally grounded content: CVQA 34 , CulturalVQA 31 , ALM-Bench 40 , EXAMS-V 15 , TaiwanVQA 21 , and SEA-VL 6 . The evaluation suites AyaVisionBench 16 and m-WildVision 16 translate prompts over shared images; we complement them with HoraVQA , a Romanian-authored benchmark sourced from Wikidata/Wikimedia with culturally tagged questions. Prior multilingual VLM work has pursued either broad multilingual coverage through large-scale pretraining or instruction tuning in translated form, or benchmark construction to measure cross-lingual and cross-cultural gaps. In contrast, our work studies the full adaptation pipeline for a single low-resource language. We focus on Romanian and combine translated multimodal supervision, translated in-image text, native Romanian OCR/document data, and a human-authored cultural benchmark. This setting allows us to isolate which components of adaptation matter: the language backbone, the vision backbone, OCR-heavy supervision, and text localization within images. Our findings show that Romanian multimodal performance depends not only on multilingual language modeling, but also on OCR-sensitive data composition and grounded cultural coverage. 3 Dataset Development We collect image–text data from a diverse set of English and Romanian-language sources to enable language-specific multimodal training and evaluation. Our dataset includes naturally occurring image-caption pairs, OCR-rich visual content, instructional data, and document-style tasks covering a broad range of domains and visual formats. In addition to native Romanian data, we incorporate translated image–text pairs to study the impact of language-specific supervision in low-resource multimodal adaptation. We rely on established, high-quality datasets that are usually used for instrution-tuning and evaluating strong multimodal models. Our aim is to study the impact of using translated versions of this data for Romanian VLM training. In total, we selected 11 training datasets as follows: LAION 35 , LLaVA-Mix 27 , PixMo 17 , Flickr30K 18 , CoSyn 43 , and FinePDFs 22 . In the end, we were left with 3.17M training samples, with datasets grouped per task in Table 1 . We observe substantial variation in text complexity and visual structure across domains (see details in Appendix E ), motivating the need for diverse multimodal evaluation beyond standard captioning settings. Task Dataset # Samples Alignment LAION 552k Captioning PixMo-Cap 601k Flickr30K-Cap 25k General VQA & Instruction LLaVA-Mix 618k PixMo-AA 131k PixMo-CapQa

Read the complete text