Are LLM-Based Retrievers Worth Their Cost? An Empirical Study of Efficiency, Robustness, and Reasoning Overhead DOI: XXXXXXX.XXXXXXX Conference: the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, Australia.; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking CCS: Information systems Evaluation of retrieval results CCS: Computing methodologies Natural language processing
Abdelrahman Abdallah, Jamie Holdcroft, Mohammed Ali, Adam Jatowt · 2026
Read Are LLM-Based Retrievers Worth Their Cost? An Empirical Study of Efficiency, Robustness, and Reasoning Overhead DOI: XXXXXXX.XXXXXXX Conference: the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, Australia.; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Information retrieval CCS: Information systems Retrieval models and ranking CCS: Information systems Evaluation of retrieval results CCS: Computing methodologies Natural language processing by Abdelrahman Abdallah, Jamie Holdcroft, Mohammed Ali, Adam Jatowt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03676.txt.
Description
Abdelrahman Abdallah and colleagues asked whether retrievers built on large language models earn their extra cost. They reran a hard retrieval test across 12 tasks and 14 systems, tracking setup cost, speed, growth with corpus size, toughness under changed queries, and trust signals. Some tuned retrievers stayed fast and strong, but several large systems added heavy delays for small gains, and trust scores proved weak across all types.
Catalog record
| CREATOR | Abdelrahman Abdallah, Jamie Holdcroft, Mohammed Ali, Adam Jatowt |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47542 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.03676