ReasonIR: Training Retrievers for Reasoning Tasks

Rulin Shao, Rui Qiao, Varsha Kishore, Niklas Muennighoff, Xi Victoria Lin, Daniela Rus, Bryan Kian Hsiang Low, Sewon Min, Wen-tau Yih, Pang Wei Koh, Luke Zettlemoyer · 2025

Read ReasonIR: Training Retrievers for Reasoning Tasks by Rulin Shao, Rui Qiao, Varsha Kishore, Niklas Muennighoff, Xi Victoria Lin, Daniela Rus, Bryan Kian Hsiang Low, Sewon Min, Wen-tau Yih, Pang Wei Koh, Luke Zettlemoyer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20595.txt.

Introduction

Shao and ten co-authors present a study from twenty twenty-five on a search tool built for reasoning tasks. Normal search tools gain little on hard questions that need steps of thought. Training sets skew toward short fact queries with direct answers. The team build fake training data that pairs each document with a tough, apt query. Each query also gets a tempting but useless match to teach sharper picks. Their tool trains on that mix plus public data.

The tool sets a new best score on a known reasoning search benchmark. It also lifts scores on two hard question tasks when used to fetch context. Longer, richer rewritten queries raise its scores further at test time. The team release code, data, and the model in public.

Catalog record

CREATORRulin Shao, Rui Qiao, Varsha Kishore, Niklas Muennighoff, Xi Victoria Lin, Daniela Rus, Bryan Kian Hsiang Low, Sewon Min, Wen-tau Yih, Pang Wei Koh, Luke Zettlemoyer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE109 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-20595

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ReasonIR: Training Retrievers for Reasoning Tasks Rulin Shao, Rui Qiao, Varsha Kishore, Niklas Muennighoff, Xi Victoria Lin, Daniela Rus, Bryan Kian Hsiang Low, Sewon Min, Wen-tau Yih, Pang Wei Koh, Luke Zettlemoyer Abstract We present ReasonIR-8B , the first retriever specifically trained for general reasoning tasks. Existing retrievers have shown limited gains on reasoning tasks, in part because existing training datasets focus on short factual queries tied to documents that straightforwardly answer them. We develop a synthetic data generation pipeline that, for each document, our pipeline creates a challenging and relevant query, along with a plausibly related but ultimately unhelpful hard negative. By training on a mixture of our synthetic data and existing public data, ReasonIR-8B achieves a new state-of-the-art of 29.9 nDCG@10 without reranker and 36.9 nDCG@10 with reranker on BRIGHT, a widely-used reasoning-intensive information retrieval (IR) benchmark. When applied to RAG tasks, ReasonIR-8B improves MMLU and GPQA performance by 6.4% and 22.6% respectively, relative to the closed-book baseline, outperforming other retrievers and search engines. In addition, ReasonIR-8B uses test-time compute more effectively: on BRIGHT, its performance consistently increases with longer and more information-rich rewritten queries; it continues to outperform other retrievers when combined with an LLM reranker. Our training recipe is general and can be easily extended to future LLMs; to this end, we open-source our code, data, and model. † † date: August 24, 2026 † † correspondence: [email protected] , [email protected] † † Code \& Data: https://github.com/facebookresearch/ReasonIR † † Model: https://huggingface.co/reasonir/ReasonIR-8B 1 Introduction Retrieval-augmented generation (RAG) has been widely used in knowledge-seeking tasks such as factual question-answering ( Borgeaud et al., 2022 ; Lewis et al., 2020 ; Wang et al., 2023a ; Zhang et al., 2023b ) . In such tasks, one can often find documents that directly answer the question. However, for complex tasks that require reasoning, it is often helpful to retrieve a broader set of documents—e.g., background knowledge that contains preliminaries, tutorials that present effective reasoning patterns, or demonstration questions solved using similar methodologies. We refer to such retrieval as reasoning-intensive retrieval . Existing retrievers are generally trained on datasets that focus on short factual queries with straightforward matches to relevant documents, and have consequently struggled with reasoning-intensive retrieval ( BehnamGhader et al., 2022 ; Su et al., 2024 ) . (a) IR Performance. (b) RAG Performance. Figure 1 : (a) Performance against test-time compute on the reasoning-intensive information retrieval (IR) benchmark BRIGHT. ReasonIR-8B achieves new state-of-the-art scores, demonstrating that efficient bi-encoders can outperform significantly more expensive reranker baselines. We also introduce an LLM reranking method with a simple yet effective tie-breaking technique, combined with which ReasonIR-8B achieves a new SOTA RBRIGHT score of 36.9 nDCG@10 (§ 4.6 ). (b) Performance on Retrieval-augmented generation (RAG) benchmarks MMLU and GPQA. ReasonIR-8B outperforms other retriever and search engine baselines. The IR benchmark directly measures retrieval quality using annotated target documents; RAG benchmarks measure the performance of LM responses that incorporate retrieved information. In this work, we present ReasonIR-8B , the first bi-encoder retriever developed specifically for reasoning-intensive retrieval. The key element is ReasonIR-Synthesizer (§ 4 ), a recipe for synthetically generating reasoning-intensive retrieval data that we then use for contrastive training. ReasonIR-Synthesizer generates two types of training data: (1) varied-length queries and their corresponding synthesized documents, which are of diverse lengths and are designed to extend the effective context length for our retriever; and (2) hard queries , reasoning-intensive queries that we generate based on real seed documents. For both types of queries, we also synthesize hard negatives—documents that appear superficially relevant but are actually unhelpful for the query—using a multi-turn approach, as we find that previous hard-negative-mining approaches ( Luan et al., 2021 ) do not work well for reasoning-intensive queries. Our analysis demonstrates that the synthetic data generated by ReasonIR-Synthesizer is significantly more challenging and covers a broader range of query lengths compared to existing training datasets, both of which are important for improving reasoning-intensive retrieval performance. We trained ReasonIR-8B by fine-tuning Llama3.1-8B ( Touvron et al., 2023 ) on a combination of public datasets and the synthetic data generated by ReasonIR-Synthesizer . We evaluate on both reasoning-intensive IR and RAG benchmarks (§ 5 ), as shown in Figure 1 . ReasonIR-8B achieves state-of-the-art results on BRIGHT ( Su et al., 2024 ) —24.4 nDCG@10 using original queries, 29.9 with GPT4-rewritten queries, and 36.9 when further combined with an LLM reranker. Moreover, ReasonIR-8B with query rewriting outperforms recent LLM reranker baselines while requiring over 200 \times less compute. On the reasoning-intensive RAG tasks MMLU ( Hendrycks et al., 2020 ) and GPQA ( Rein et al., 2024 ) , where the retrieved results are fed to an LLM 1 1 1 Llama3.1-8B-Instruct and Qwen-2.5-7B-Instruct, respectively. , ReasonIR-8B achieves 6.39% and 22.58% relative gains respectively over closed-book baselines and outperforms other retriever and search engine baselines. ReasonIR-8B can also be effectively combined with test-time techniques. First, we studied rewriting queries to make them increasingly detailed and informative (e.g., by brainstorming about potentially useful types of information to answer the query). ReasonIR-8B consistently benefits from longer rewritten queries, whereas other retrievers plateau or even worsen with longer queries; thus, ReasonIR-8B enables the length of the rewritten queries as a new dimension of test-time scaling. Second, we found that ReasonIR-8B outperforms other retrievers when used with an LLM reranker, as it achieves a higher recall in its retrieved documents. Our proposed method can be readily adapted to incorporate newer LLMs for synthetic data generation in ReasonIR-Synthesizer or as base models for training ReasonIR-8B . We release our code, model, and data recipe to facilitate future research. 2 Preliminaries Let f denote an LM, which takes an input x from a text space \mathcal{X} and produces a distribution f(x) from which the output y\sim f(x) can be sampled. Let {\mathcal{D}}=\{d_{1},d_{2},\dots,d_{n}\} denote a datastore of n documents. A bi-encoder retriever h encodes a query q\in{\mathcal{X}} and a document d\in{\mathcal{D}} independently as vector embeddings h(q) and h(d) to produce a cosine similarity score s(q,d)=\cos\bigl(h(q),h(d)\bigr) . Instead of outputting an answer y directly to a query q as y\sim f(q) , a RAG-based approach first retrieves the top- k scored documents D_{k}\subseteq{\mathcal{D}} from the datastore, then augments the original query with D_{k} to generate more informative responses y\sim f([q,D_{k}]) , where [q,D_{k}]\in{\mathcal{X}} denotes the concatenation of query and documents. Our objective is to improve the performance of RAG-powered LMs on hard, reasoning-intensive queries by improving retrieval quality, i.e., the relevance of the top- k retrieved documents D_{k} . Information retrieval (IR) for such queries is more challenging because these queries exhibit low lexical and semantic overlap with relevant documents. Query rewriting and LLM reranking. A reasoning-intensive query can be refined and enriched with more lexically and semantically relevant content through a query rewriter g(\cdot;c) with a length configuration c and chain-of-thought reasoning, producing a rewritten query \tilde{q}=g(q;c) , namely Reason-query . The length of a Reason-query is a potential test-time scaling factor that influences the retrieval quality, which we will investigate in detail in Section 3 . LLM reranking is another test-time technique to further improve retrieval quality—it reaccesses the top-K retrieved documents (where K\gg k ). An LLM assigns new relevance scores to each document, rearranging their order and

Read the complete text