Beyond Single-Modal Analytics: A Framework for Integrating Heterogeneous LLM-Based Query Systems for Multi-Modal Data

*Ruyu Li, *Tinghui Zhang, Haodi Ma, Daisy Zhe Wang, Yifan Wang · 2026

Read Beyond Single-Modal Analytics: A Framework for Integrating Heterogeneous LLM-Based Query Systems for Multi-Modal Data by *Ruyu Li, *Tinghui Zhang, Haodi Ma, Daisy Zhe Wang, Yifan Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01701.txt.

Description

Ruyu Li and colleagues unify language model query systems for multi modal data, where meaning hides in semantics beyond queries. Fragmentation comes from interfaces and the specialization generality tradeoff. Specialists excel but struggle across modalities, while all in one systems handle modalities but lag specialists. Their Meta Engine, a query system on query systems, integrates systems. It has five parts: a language query parser, an operator generator, a query router, adapters and an aggregator. In tests it beats baselines, with several times higher F1 and higher on some sets.

Catalog record

CREATOR*Ruyu Li, *Tinghui Zhang, Haodi Ma, Daisy Zhe Wang, Yifan Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69791
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01701

Browse the full library · About the Tower of Babel