A Replicability Study of XTR DOI: XXXXXXX.XXXXXXX Conference: ; 978-1-4503-XXXX-X/2018/06 ISBN: ; CCS: Information systems Retrieval models and ranking

Rohan Jha, Reno Kriz, Benjamin Van Durme · 2026

Read A Replicability Study of XTR DOI: XXXXXXX.XXXXXXX Conference: ; 978-1-4503-XXXX-X/2018/06 ISBN: ; CCS: Information systems Retrieval models and ranking by Rohan Jha, Reno Kriz, Benjamin Van Durme (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00646.txt.

Description

Rohan Jha, Reno Kriz, and Benjamin Van Durme replicate XTR, a tweak of the ColBERT search method that promises cheaper retrieval. ColBERT scores texts token by token, then gathers and reranks matches at some cost. XTR skips the full gathering by filling in missing match scores from the first pass. Its authors also proposed a changed training goal, claiming standard token scoring cannot support the fill-in.

The rerun confirms the claimed token-level matching. Under a fair head-to-head, however, XTR's edge over ColBERT does not come back. The study then finds something the first paper missed: the modified training flattens ColBERT's typically peaked token scores, which yields sharper center scores and therefore faster retrieval in modern inverted-index engines. So the training change earns its keep for engine speed broadly, not only in the narrow regime first studied.

Catalog record

CREATORRohan Jha, Reno Kriz, Benjamin Van Durme
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.00646

Browse the full library · About the Tower of Babel