Efficiency Optimizations for Superblock-based Sparse Retrieval

Parker Carlson, Wentai Xie, Rohil Shah, Tao Yang · 2026

Read Efficiency Optimizations for Superblock-based Sparse Retrieval by Parker Carlson, Wentai Xie, Rohil Shah, Tao Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02883.txt.

Description

Faster first-stage search is the goal of a 2026 paper by Parker Carlson and 3 co-authors. Learned sparse retrieval ranks documents using language-model meaning while staying cheap to run on ordinary processors. Earlier systems group blocks of the index into superblocks to skip work quickly, but scoring those groups costs time.

The authors propose a simpler pruning scheme for superblocks. It cuts that scoring cost while keeping result quality competitive. A compact index structure and a ready-to-use configuration accompany it. Tests use the MS MARCO and BEIR collections. Analysis supports the design. The authors present the scheme as a strong, efficient option across retrieval models and datasets.

Catalog record

CREATORParker Carlson, Wentai Xie, Rohil Shah, Tao Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02883

Browse the full library · About the Tower of Babel