Efficient and High-Fidelity Omni Modality Retrieval

Chuong Huynh, Manh Luong, Abhinav Shrivastava, University of Maryland, College Park, USA Monash University, Australia Equal contributionProject Page: https://hmchuong.github.io/omniret · 2026

Read Efficient and High-Fidelity Omni Modality Retrieval by Chuong Huynh, Manh Luong, Abhinav Shrivastava, University of Maryland, College Park, USA Monash University, Australia Equal contributionProject Page: https://hmchuong.github.io/omniret (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02098.txt.

Description

Chuong Huynh, Manh Luong, and Abhinav Shrivastava present a 2026 search model that works across text, images, and sound at once. Most search tools handle only text and images. Their model, OmniRet, is built for mixed queries that combine all three forms. It must stay fast while keeping fine detail.

For speed, the model shrinks long inputs into short, fixed-size codes. For detail, a new pooling step keeps small cues that a single code would lose. Training used about six million query pairs from thirty data sets. In tests, OmniRet gained most on mixed, audio, and video search. The authors also built a new audio-focused test set for later work.

Catalog record

CREATORChuong Huynh, Manh Luong, Abhinav Shrivastava, University of Maryland, College Park, USA Monash University, Australia Equal contributionProject Page: https://hmchuong.github.io/omniret
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68246
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02098

Browse the full library · About the Tower of Babel