MaD-Mix: Multi-Modal Data Mixtures via Latent Space Coupling for Vision-Language Model Training
Wanyun Xie, Francesco Tonin, Volkan Cevher · 2026
Read MaD-Mix: Multi-Modal Data Mixtures via Latent Space Coupling for Vision-Language Model Training by Wanyun Xie, Francesco Tonin, Volkan Cevher (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07790.txt.
Description
Vision-language models train on many data domains, but choosing how much of each to mix is usually manual and expensive. Wanyun Xie and two co-authors propose MaD-Mix, a principled method that derives data mixtures from modality-aware domain alignment, computed in closed form through inter-modal coupling variables.
The framework handles domains missing a modality, including language-only data, and costs under one GPU-hour to compute. On models of 0.5 and 7 billion parameters, MaD-Mix matches human-tuned mixtures with 22 percent fewer training steps for image-text tuning, and improves accuracy over uniform mixing in harder video-image-text settings. Training teams gain a scalable, cheap replacement for mixture guesswork.
Catalog record
| CREATOR | Wanyun Xie, Francesco Tonin, Volkan Cevher |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07790