Multi-Vector Index Compression in Any Modality Conference: Preprint; 2026; Preprint CCS: Information systems Search index compression

Hanxiang Qin, Alexander Martin, Rohan Jha, Chunsheng Zuo, Reno Kriz, Benjamin Van Durme · 2026

Read Multi-Vector Index Compression in Any Modality Conference: Preprint; 2026; Preprint CCS: Information systems Search index compression by Hanxiang Qin, Alexander Martin, Rohan Jha, Chunsheng Zuo, Reno Kriz, Benjamin Van Durme (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21202.txt.

Description

Late-interaction retrieval matches queries against many document vectors, but storage and compute grow with document length. Hanxiang Qin, Alexander Martin, Rohan Jha, Chunsheng Zuo, Reno Kriz, and Benjamin Van Durme compress those representations in this 2026 arXiv paper, under a fixed vector budget. Four query-agnostic methods are compared: sequence resizing, memory tokens, hierarchical pooling, and attention-guided clustering.

Attention-guided clustering picks semantically salient regions as cluster centroids and weights token aggregation, beating other parameterized methods and offering more size flexibility than hierarchical pooling. Across text, visual-document, and video retrieval tasks, it matches or improves on a full uncompressed index. The work makes late interaction practical for image-, video-, and audio-rich collections.

Catalog record

CREATORHanxiang Qin, Alexander Martin, Rohan Jha, Chunsheng Zuo, Reno Kriz, Benjamin Van Durme
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-21202

Browse the full library · About the Tower of Babel