Beyond Single-Modal Analytics: A Framework for Integrating Heterogeneous LLM-Based Query Systems for Multi-Modal Data
*Ruyu Li, *Tinghui Zhang, Haodi Ma, Daisy Zhe Wang, Yifan Wang · 2026
Read Beyond Single-Modal Analytics: A Framework for Integrating Heterogeneous LLM-Based Query Systems for Multi-Modal Data by *Ruyu Li, *Tinghui Zhang, Haodi Ma, Daisy Zhe Wang, Yifan Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01701.txt.
Description
Ruyu Li and colleagues unify language model query systems for multi modal data, where meaning hides in semantics beyond queries. Fragmentation comes from interfaces and the specialization generality tradeoff. Specialists excel but struggle across modalities, while all in one systems handle modalities but lag specialists. Their Meta Engine, a query system on query systems, integrates systems. It has five parts: a language query parser, an operator generator, a query router, adapters and an aggregator. In tests it beats baselines, with several times higher F1 and higher on some sets.
Catalog record
| CREATOR | *Ruyu Li, *Tinghui Zhang, Haodi Ma, Daisy Zhe Wang, Yifan Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69791 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01701