Efficiency Optimizations for Superblock-based Sparse Retrieval
Parker Carlson, Wentai Xie, Rohil Shah, Tao Yang · 2026
Read Efficiency Optimizations for Superblock-based Sparse Retrieval by Parker Carlson, Wentai Xie, Rohil Shah, Tao Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02883.txt.
Description
Faster first-stage search is the goal of a 2026 paper by Parker Carlson and 3 co-authors. Learned sparse retrieval ranks documents using language-model meaning while staying cheap to run on ordinary processors. Earlier systems group blocks of the index into superblocks to skip work quickly, but scoring those groups costs time.
The authors propose a simpler pruning scheme for superblocks. It cuts that scoring cost while keeping result quality competitive. A compact index structure and a ready-to-use configuration accompany it. Tests use the MS MARCO and BEIR collections. Analysis supports the design. The authors present the scheme as a strong, efficient option across retrieval models and datasets.
Catalog record
| CREATOR | Parker Carlson, Wentai Xie, Rohil Shah, Tao Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02883