Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval

Kidist Amde Mekonnen, Yubao Tang, Maarten de Rijke · 2025

Read Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval by Kidist Amde Mekonnen, Yubao Tang, Maarten de Rijke (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05181.txt.

Introduction

Kidist Amde Mekonnen, Yubao Tang, and Maarten de Rijke wrote this 2025 paper on generative search, a new way to find documents. In generative retrieval, a model answers a query by generating the identifier of the right document. Training such a model end to end is attractive, but a flaw lurks: the model learns word by word, while relevance is a trait of the whole document.

Reward-based fixes exist, but they are complex, costly, and often unstable. The authors propose direct document relevance optimization instead. Their method aligns the word-level generation task with document-level relevance in one step. It skips the extra reward model and the reinforcement stage that rivals need. The result is a lighter training route to the same goal: search results that match what the user actually needs.

Catalog record

CREATORKidist Amde Mekonnen, Yubao Tang, Maarten de Rijke
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05181

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval Kidist Amde Mekonnen, Yubao Tang, Maarten de Rijke Abstract . GenIR ( GenIR ) is a promising neural retrieval paradigm that formulates document retrieval as a document identifier (docid) generation task, allowing for end-to-end optimization toward a unified global retrieval objective. However, existing GenIR models suffer from token-level misalignment, where models trained to predict the next token often fail to capture document-level relevance effectively. While reinforcement learning-based methods, such as RLRF ( RLRF ), aim to address this misalignment through reward modeling, they introduce significant complexity, requiring the optimization of an auxiliary reward function followed by reinforcement fine-tuning, which is computationally expensive and often unstable. To address these challenges, we propose DDRO ( DDRO ), which aligns token-level docid generation with document-level relevance estimation through direct optimization via pairwise ranking, eliminating the need for explicit reward modeling and reinforcement learning. Experimental results on benchmark datasets, including MS MARCO document and Natural Questions, show that DDRO outperforms reinforcement learning-based methods, achieving a 7.4% improvement in MRR@10 for MS MARCO and a 19.9% improvement for Natural Questions. These findings highlight DDRO ( DDRO )’s potential to enhance retrieval effectiveness with a simplified optimization approach. By framing alignment as a direct optimization problem, DDRO simplifies the ranking optimization pipeline of GenIR models while offering a viable alternative to reinforcement learning-based methods. 821 Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3730023 ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Retrieval models and ranking CCS: Information systems Learning to rank CCS: Information systems Language models † † cc-license: by 1. Introduction Building on the success of transformer-based pre-trained language models, recent research has explored various neural retrieval approaches ( Yates et al., 2021 ) : learned sparse retrieval ( Formal et al., 2021a ; Formal et al., 2021b ) , dense retrieval ( Karpukhin et al., 2020 ; Xiong et al., 2020 ; Zeng et al., 2022 ; Zhan et al., 2021 ) , and cross-encoders ( Nogueira and Cho, 2019 ) . A new paradigm has recently been added to this palette, GenIR ( GenIR ) ( Tay et al., 2022 ; Metzler et al., 2021 ) . This approach uses pre-trained encoder-decoder models as DSI ( DSI ). It has inspired the development of several models ( Wang et al., 2022 ; Zhuang et al., 2022 ; Mehta et al., 2023 ; Bevilacqua et al., 2022 ; Zhou et al., 2022b ; Ren et al., 2023 ; Zeng et al., 2024b ; Zeng et al., 2024a ; Tang et al., 2023b ; Tang et al., 2024b ; Tang et al., 2024a ; Tang et al., 2025 ; Tang et al., 2024c ) Generative information retrieval. GenIR models represent documents as sequences of unique document identifiers (docids), generated autoregressively, where each token is conditioned on the query encoding and previously generated tokens. The generation process is controlled through (constrained) beam search ( Mehta et al., 2023 ; Tay et al., 2022 ; Wang et al., 2022 ; Zeng et al., 2024a ; Zeng et al., 2024b ; Zhuang et al., 2022 ) . Docids could be predefined and remain static during training, making their careful design crucial for optimal retrieval performance ( Tang et al., 2024f ) . We classify docids into two categories based on their generation methodology and abstraction level. The first category, referred to as content-derived docids, includes identifiers that are extracted directly from document elements such as titles ( De Cao et al., 2020 ; Chen et al., 2022a ; Chen et al., 2022b ; Lee et al., 2023 ; Tang et al., 2024d ; Tang et al., 2024g ; Tang et al., 2024e ; Tang et al., 2023a ) , n-grams ( Bevilacqua et al., 2022 ; Chen et al., 2023b ; Li et al., 2024 ; Li et al., 2023b ; Wang et al., 2023 ) , URLs ( Ren et al., 2023 ; Zhou et al., 2023 ; Zhou et al., 2022b ; Ziems et al., 2023 ) , and key terms ( Zhang et al., 2023 ) . These docids preserve surface-level textual characteristics and are closely tied to the original document content. In contrast, the second category, termed computationally-generated are derived using techniques like quantization ( Chen et al., 2023a ; Rajput et al., 2023 ; Zeng et al., 2024b ; Zhou et al., 2022b ; Zeng et al., 2024a ) or hierarchical clustering algorithms ( Mehta et al., 2023 ; Sun et al., 2023 ; Tay et al., 2022 ; Wang et al., 2022 ) to encode deeper semantics by abstracting raw document content into conceptual features. During training, GenIR models learn to associate document text with corresponding docids, embedding semantic information directly into its parameters. During retrieval, docids are sequentially generated based on learned representations. By unifying indexing and retrieval within a transformer-based architecture, these models optimize both processes simultaneously ( Metzler et al., 2021 ; Tay et al., 2022 ) . Challenges in GenIR . Despite recent advancements, GenIR models face key limitations that hinder their effectiveness. These models typically rely on an auto-regressive loss function that optimizes the generation of individual docid tokens. However, this token-level optimization approach does not align with the broader goal of ranking tasks, which requires assessing the overall relevance of a document to the query. As a result, this misalignment often leads to suboptimal ranking performance. To address these challenges, it is crucial to align token generation with document-level relevance estimation to ensure more accurate, well-rounded retrieval outcomes. Direct document-level relevance optimization. Existing approaches aimed at aligning token-level docid generation with document-level relevance estimation, such as RLRF , use reinforcement learning to align predictions with relevance judgments through reward modeling ( Zhou et al., 2023 ) . However, RLRF introduces significant complexity, requiring the optimization of an auxiliary reward function followed by reinforcement fine-tuning, which is computationally expensive and often unstable. To address these challenges, we introduce a DDRO ( DDRO ) method that employs a pairwise ranking approach into GenIR models to improve document retrieval performance. Our approach has two key phases. (i) First, we employ SFT ( SFT ) to train a LM ( LM ) capable of generating docids that are most relevant to a given query. (ii) Next, we directly refine the model through pairwise ranking, where the model learns to differentiate between relevant and irrelevant docids for a specific query based on labeled data. This refinement ensures that the retrieval system ranks documents based on their relevance, aligning the model more closely with the query. The SFT phase serves as a pretraining step, aligning the model with initial relevance signals from training data and providing a strong foundation for the pairwise ranker to further fine-tune document ranking effectiveness. Experiments conducted on the MS MARCO document ranking ( Bajaj et al., 2016 ) and Natural Questions (NQ) ( Kwiatkowski et al., 2019 ) benchmarks demonstrate the effectiveness of DDRO in improving retrieval accuracy, outperforming multiple baselines. Moreover, DDRO

Read the complete text