Are LLM-Based Retrievers Worth Their Cost? An Empirical Study of Efficiency, Robustness, and Reasoning Overhead DOI: XXXXXXX.XXXXXXX Conference: the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, Australia.; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking CCS: Information systems Evaluation of retrieval results CCS: Computing methodologies Natural language processing

Abdelrahman Abdallah, Jamie Holdcroft, Mohammed Ali, Adam Jatowt · 2026

Read Are LLM-Based Retrievers Worth Their Cost? An Empirical Study of Efficiency, Robustness, and Reasoning Overhead DOI: XXXXXXX.XXXXXXX Conference: the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, Australia.; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking CCS: Information systems Evaluation of retrieval results CCS: Computing methodologies Natural language processing by Abdelrahman Abdallah, Jamie Holdcroft, Mohammed Ali, Adam Jatowt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03676.txt.

Description

Abdelrahman Abdallah and colleagues asked whether retrievers built on large language models earn their extra cost. They reran a hard retrieval test across 12 tasks and 14 systems, tracking setup cost, speed, growth with corpus size, toughness under changed queries, and trust signals. Some tuned retrievers stayed fast and strong, but several large systems added heavy delays for small gains, and trust scores proved weak across all types.

Catalog record

CREATORAbdelrahman Abdallah, Jamie Holdcroft, Mohammed Ali, Adam Jatowt
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47542
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03676

Browse the full library · About the Tower of Babel