Rank-K: Test-Time Reasoning for Listwise Reranking
Eugene Yang, Andrew Yates, Kathryn Ricci, Orion Weller, Benjamin Van Durme, Dawn Lawrie, {eugene.yang, andrew.yates, vandurme}@jhu.edu · 2025
Read Rank-K: Test-Time Reasoning for Listwise Reranking by Eugene Yang, Andrew Yates, Kathryn Ricci, Orion Weller, Benjamin Van Durme, Dawn Lawrie, {eugene.yang, andrew.yates, vandurme}@jhu.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14432.txt.
Description
Eugene Yang and seven co-authors wrote a 2025 information retrieval paper on reranking search results with a reasoning model at query time. Search engines retrieve a rough list fast, then rerank a shortlist carefully. Language model rerankers judge whole lists at once and lead the field, but they are expensive to run.
Their model, Rank-K, spends test time reasoning to handle hard queries better, scaling effort where it pays. Reranking a classic keyword system's output, it improved effectiveness by about a fifth over the prior best listwise reranker. Gains held when starting from a strong neural retriever's list too. Because the underlying model is multilingual, cross language queries ranked as well as same language ones. The authors pitch reasoning time as the new dial for retrieval quality.
Catalog record
| CREATOR | Eugene Yang, Andrew Yates, Kathryn Ricci, Orion Weller, Benjamin Van Durme, Dawn Lawrie, {eugene.yang, andrew.yates, vandurme}@jhu.edu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14432