The Evolution of Reranking Models in Information Retrieval: From Heuristic Methods to Large Language Models

Tejul Pandit, Sakshi Mahendru ∗, Meet Raval ∗, Dhvani Upadhyay · 2025

Read The Evolution of Reranking Models in Information Retrieval: From Heuristic Methods to Large Language Models by Tejul Pandit, Sakshi Mahendru ∗, Meet Raval ∗, Dhvani Upadhyay (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-16236.txt.

Introduction

Tejul Pandit and three co-authors survey search technology in work posted to arXiv in 2025, accepted to a 2025 language technology conference. Reranking is the stage of a search system that reorders an initial list of candidate documents to put the best matches on top. It matters even more inside retrieval-augmented generation, where an AI's answer depends on the documents it is fed.

The authors trace rerankers from early rule-based heuristics to neural cross-encoders, sequence models like T5, and graph neural networks that use document structure. They cover knowledge distillation, a way to shrink big models into fast ones without losing much quality. The final section maps how large language models are entering reranking, through prompting tricks and fine-tuning, and weighs accuracy, cost, and speed trade-offs across all the families.

Catalog record

CREATORTejul Pandit, Sakshi Mahendru ∗, Meet Raval ∗, Dhvani Upadhyay
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-16236

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Evolution of Reranking Models in Information Retrieval: From Heuristic Methods to Large Language Models Tejul Pandit, Sakshi Mahendru ∗, Meet Raval ∗, Dhvani Upadhyay Abstract Reranking is a critical stage in contemporary information retrieval (IR) systems, improving the relevance of the user-presented final results by honing initial candidate sets. This paper is a thorough guide to examine the changing reranker landscape and offer a clear view of the advancements made in reranking methods. We present a comprehensive survey of reranking models employed in IR, particularly within modern Retrieval Augmented Generation (RAG) pipelines, where retrieved documents notably influence output quality. We embark on a chronological journey through the historical trajectory of reranking techniques, starting with foundational approaches, before exploring the wide range of sophisticated neural network architectures such as cross-encoders, sequence-generation models like T5, and Graph Neural Networks (GNNs) utilized for structural information. Recognizing the computational cost of advancing neural rerankers, we analyze techniques for enhancing efficiency, notably knowledge distillation for creating competitive, lighter alternatives. Furthermore, we map the emerging territory of integrating Large Language Models (LLMs) in reranking, examining novel prompting strategies and fine-tuning tactics. This survey seeks to elucidate the fundamental ideas, relative effectiveness, computational features, and real-world trade-offs of various reranking strategies. The survey provides a structured synthesis of the diverse reranking paradigms, highlighting their underlying principles and comparative strengths and weaknesses. * * footnotetext: Equal contribution 1 Introduction Information retrieval (IR) systems are essential in today’s digital world, with their ability to power anything from online search and recommender systems to sophisticated question-answering and knowledge management platforms. A critical component within these systems is the reranking stage. Reranking carefully reorders these candidates to show the user the most pertinent results after an initial, often rapid, retrieval phase that produces an extensive collection of candidate documents. This dramatically improves the overall quality and efficacy of the IR system [ 65 ] . Notably, the significant development in Large Language Models (LLMs) has subsequently driven substantial improvements and interest in Retrieval Augmented Generation (RAG) pipelines, where the precision of retrieved context, refined by reranking, is crucial for generating accurate and relevant outputs [ 50 ] . Based on [ 20 ] , we represent the typical placement of the reranking component within a RAG pipeline in Figure 1 . Figure 1: RAG approach highlighting a post-retrieval step of Reranking documents. Reranking methods have evolved significantly, from heuristic scoring and traditional learning-to-rank models to deep learning and, more recently, LLMs, enabling richer semantic understanding and inter-document relationships. This survey provides a comprehensive exploration of the evolving field of reranking models in IR. We trace the development trajectory from classical learning-to-rank methods in Section 3 , followed by Deep learning rerankers in Section 4 . We also cover methods aimed at improving the efficiency of reranking models, with a particular focus on knowledge distillation techniques in Section 5 . Finally, we examine the cutting-edge integration of LLM-based rerankers in Section 6 . This study aims to provide scholars and practitioners with a valuable guide for navigating this ever-evolving subject by compiling significant advancements and empirical findings throughout the reranking timeline. 2 Background Ranking approaches, which form the basis for many reranking techniques, can broadly be categorized based on their supervision strategies and how they process documents during training and scoring: pointwise, pairwise, and listwise. Pointwise approaches consider a single document at a time within the loss function. They train a classifier or regressor to predict the relevance score of an individual document for a given query. The final ranking is then produced by sorting documents based on these predicted scores. Pairwise approaches focus on pairs of documents. Given a pair of documents, the model aims to determine the optimal relative ordering between them, comparing this prediction against the ground truth. Listwise approaches directly consider and optimize the ranking of an entire list of documents. These methods aim to produce the optimal ordering for the complete set of retrieved candidates. 3 Learning to Rank in Reranking Models Learning drastically changed the reranking phase of contemporary information retrieval (IR) systems to Rank (LTR). This section of the survey charts LTR’s evolutionary trajectory in reranking, focusing on methodological shifts, core problems, and model sophistication, from foundational probabilistic methods to pairwise learning, listwise optimization, and introduction to deep learning models. Early LTR (late 1980s- early 1990s) applied statistical methods to estimate relevance. Key efforts included [ 19 ] using polynomial regression for direct relevance probability estimation, [ 13 ] with multi-stage logistic regression for composite clues, and [ 4 ] learning optimal linear combinations of expert scores, presaging meta-search. These established data-driven rankings’ viability. The late 1990s- early 2000s saw pairwise learning ascend, driven by machine learning advances. Friedman’s [ 18 ] provided the Gradient Boosted Decision Tree (GBDT) foundation crucial for later LTR. Algorithms like [ 17 ] applied boosting to learn from pairwise preferences, while [ 6 ] introduced influential neural networks for pairwise ranking by minimizing cross-entropy between predicted and target pair probabilities. Limitations of generic pairwise losses spurred refinement towards IR-specific metrics. [ 9 ] Adapted Ranking SVM by weighting misranked pairs based on IR relevance. The pivotal [ 7 ] enabled direct optimization of non-smooth IR metrics (like NDCG) by defining gradients ( \lambda -values) based on metric changes from swaps, guiding pairwise models to optimize listwise objectives. Other works like [ 42 ] and [ 73 ] also explored pairwise regression for preferences and direct MAP optimization. This led to explicit listwise approaches, treating entire document lists as training instances. [ 10 ] pioneered a listwise loss based on top-one probabilities. Others like [ 47 ] and [ 62 ] (both 2007) proposed query-level losses. Boosting frameworks like [ 68 ] were adapted to optimize IR metrics directly. Probabilistic list models, such as [ 67 ] using the Plackett-Luce model, gained traction. The highly successful [ 5 ] integrated MART (GBDTs) with LambdaRank’s gradients, becoming a state-of-the-art baseline. The scalability of such tree-based models was later significantly enhanced by systems like [ 12 ] . From the mid-2010s, deep learning (DL) began to dominate LTR, offering powerful representation learning and contextual modeling. Using techniques like [ 53 ] triplet loss for metric learning, neural IR models began learning potent query-document embeddings. Contextual DL models, using RNNs or Transformers (e.g., [ 1 ] , [ 43 ] , [ 44 ] ), excelled at capturing document interdependencies within lists. Simultaneously, DL spurred innovations in preference modeling (e.g., [ 32 ] ) and end-to-end metric optimization using differentiable surrogates or black-box methods (e.g., [ 8 ] , [ 59 ] ). We elaborate on more sophisticated DL-based rerankers in Section 4 . Alongside these mainstream trends, diverse strategies continued to enrich LTR. Evolutionary algorithms [ 71 ] , [ 25 ] directly optimized IR metrics. Other approaches included ordinal classification [ 33 ] , incorporating preference magnitudes [ 77 ] , and hybrid models combining objectives or data sources [ 54 ] . 4 Deep Learning Techniques for Reranking Deep learning models have significantly advanced the reranking task by capturing intricate semantic relationships between queries and documents. 4.1 Transformer-based Rerankers (BERT and T5) Transformer architectures dominate recent reranking advancements, notably

Read the complete text