Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study
Hao Dong, Hongzhao Li, Shupan Li, Muhammad Haris Khan, [0.3em] Eleni Chatzi, Olga Fink, [0.5em] ETH Zürich · 2026
Read Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study by Hao Dong, Hongzhao Li, Shupan Li, Muhammad Haris Khan, [0.3em] Eleni Chatzi, Olga Fink, [0.5em] ETH Zürich (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06643.txt.
Description
Hao Dong and five co-authors benchmark multimodal domain generalization, where models must work in new domains using several input types at once. Reported gains in this growing field may reflect inconsistent evaluation rather than real progress, since studies vary in datasets, modality mixes, and settings, and mostly test action recognition alone.
Their MMDG-Bench standardizes six datasets across action recognition, fault diagnosis, and sentiment analysis, training over seven thousand networks. Findings are sobering: recent specialized methods barely beat a plain baseline, no method wins consistently, three modalities do not reliably beat two, and corruption or missing modalities degrade every method. A large gap to the upper bound remains.
Catalog record
| CREATOR | Hao Dong, Hongzhao Li, Shupan Li, Muhammad Haris Khan, [0.3em] Eleni Chatzi, Olga Fink, [0.5em] ETH Zürich |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06643