Multi-view-guided Passage Reranking with Large Language Models
Jeongwoo Na, Jun Kwon, Eunseong Choi, Jongwuk Lee · 2025
Read Multi-view-guided Passage Reranking with Large Language Models by Jeongwoo Na, Jun Kwon, Eunseong Choi, Jongwuk Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07485.txt.
Introduction
Jeongwoo Na and 3 co-authors present MVP in 2025, a faster and less biased way for language models to rerank search passages. Reranking takes a first list of candidate passages and reorders them by relevance. Current language-model rerankers generate text step by step and scan with sliding windows, which gets costly as lists grow, and they suffer position and selection biases from the input order.
MVP instead encodes each query-passage pair into several view embeddings, distinct numeric viewpoints, without generating text. An anchor vector per view yields relevance scores in a single decoding step, and an orthogonal loss keeps the views distinct from each other. With only 220 million parameters, MVP matches much larger fine-tuned models of about 7 billion parameters in the reported experiments. Cheaper, stabler reranking could improve search quality in everyday systems.
Catalog record
| CREATOR | Jeongwoo Na, Jun Kwon, Eunseong Choi, Jongwuk Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-07485
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-view-guided Passage Reranking with Large Language Models Jeongwoo Na, Jun Kwon, Eunseong Choi, Jongwuk Lee Abstract Recent advances in large language models (LLMs) have shown impressive performance in passage reranking tasks. Despite their success, LLM-based methods still face challenges in efficiency and sensitivity to external biases . (i) Existing models rely mostly on autoregressive generation and sliding window strategies to rank passages, which incurs heavy computational overhead as the number of passages increases. (ii) External biases, such as position or selection bias, hinder the model’s ability to accurately represent passages and the input-order sensitivity. To address these limitations, we introduce a novel passage reranking model, called M ulti- V iew-guided P assage Reranking ( MVP ) . MVP is a non-generative LLM-based reranking method that encodes query–passage information into diverse view embeddings without being influenced by external biases. For each view, it combines query-aware passage embeddings to produce a distinct anchor vector, used to directly compute relevance scores in a single decoding step . Besides, it employs an orthogonal loss to make the views more distinctive. Extensive experiments demonstrate that MVP, with just 220M parameters, matches the performance of much larger 7B-scale fine-tuned models while achieving a 100× reduction in inference latency. Notably, the 3B-parameter variant of MVP achieves state-of-the-art performance on both in-domain and out-of-domain benchmarks. The source code is available at https://github.com/bulbna/MVP . 1 Introduction Figure 1: Comparison of latency and nDCG@10 across various reranking models. Latency refers to the time required to rerank for a single query and nDCG@10 is averaged over DL19 and DL20. Passage reranking aims to assign fine-grained relevance scores to candidate passages – typically retrieved by a first-stage retriever Robertson et al. 1994 ; Karpukhin et al. 2020 – by harnessing the language understanding capabilities of large language models (LLMs), in both zero-shot and fine-tuned settings. Recent studies Sun et al. 2023 ; Liang et al. 2023 formulate a prompt that consists of a query and candidate passages and generate an ordered list of passage identifiers in a zero-shot setting. Subsequent work has fine-tuned open-source LLMs by distilling knowledge from the teacher model Pradeep et al. 2023a ; Pradeep et al. 2023b , achieving competitive performance. Despite their success, LLM-based reranking methods still face challenges in efficiency and sensitivity to input order . Specifically, we address two key issues for designing an efficient and effective LLM-based reranker. (i) How do we perform reranking without incurring unnecessary inference? Efficient reranking hinges on two key aspects: global ranking (evaluating all candidates at once) and single pass decoding (performing reranking with a single decoding step). However, existing methods Pradeep et al. 2023a ; Pradeep et al. 2023b fail to satisfy both. First, they are unable to include all candidate passages in a single prompt due to input length limitations, leading to rely on sliding-window algorithms, as illustrated in Figure 2 (a). Next, generative rerankers employ autoregressive decoding, generating one passage identifier at a time, which leads to substantial computational overhead in Figure 2 (b). (ii) How do we represent query-passage explicitly without introducing bias? While LLMs show strong zero-shot reranking performance, the unbiased modeling of query-passage relationships remains an underexplored challenge due to common biases Dai et al. 2024 . First, position bias emerges in long-context prompts, a problem known as lost-in-the-middle Liu et al. 2024a . Second, selection bias arises when natural language tokens (e.g., "A", "1") are used as passage identifiers. These identifiers may encode unintended priors, potentially biasing reranking—as observed in multiple-choice settings Zheng et al. 2024 . Figure 2: Inference pipeline of a generative listwise reranker. The total number of inferences is determined by the product of (i) the number of prompts and (ii) the window size required to evaluate all candidate passages. To this end, we propose a novel listwise reranking model, M ulti- V iew-guided P assage reranking ( MVP ) . It consists of two key components under the Fusion-in-Decoder (FiD) architecture Izacard and Grave 2020 . Multi-View Encoding. Each query–passage pair is encoded into learnable soft prompts in the FiD architecture. To eliminate position bias, soft prompts are inserted at the same fixed positions across all passages. For each passage, distinct position embeddings are used to separate relevant views. Since these prompts are not tied to any pre-trained vocabulary, they allow for unbiased modeling of query-passage relationships. The encoder produces view-specific embeddings, called relevance vectors, which are then passed to the decoder to compute the final relevance scores. Anchor-Guided Decoding. Our method adopts a non-generative design that leverages anchor vectors for listwise relevance scoring across all candidates within a single decoding step. This approach operates independently from a language modeling (LM) head. During decoding, MVP aggregates view-specific relevance embeddings from all candidate passages using cross-attention in the decoder to produce anchor vectors. This design directly computes similarity-based scores, aligning both training and inference with the ranking objective while substantially improving efficiency. As illustrated in Figure 1 , MVP-3B achieves state-of-the-art performance on in-domain benchmarks (DL19 and DL20). Notably, our 220M-parameter model matches the nDCG@10 of 7B-scale listwise rerankers while reducing inference latency by up to 100×. These results highlight the efficiency and scalability of our reranking approach, demonstrating that high-quality reranking can be achieved without the computational overhead of large scale generative models. Our contributions are summarized as follows: • Efficient Listwise Reranker : We propose a novel non-generative reranking method named MVP , which enables global ranking in a single step. • Robustness to External Biases : Our embedding-based architecture is robust to position and selection biases, enabling flexible adaptation to diverse passage input scenarios. • Extensive Experiments : MVP achieves state-of-the-art performance on both in-domain and out-domain benchmarks. 2 Related Work 2.1 Reranking with LLMs Recent work has explored leveraging the language understanding capabilities of LLMs for passage reranking Zhu et al. 2023 ; Liang et al. 2023 . Depending on the prompting strategy, methods can be categorized into pointwise and listwise approaches. Pointwise rerankers estimate the relevance between a query and a single passage. For example, Some pointwise approaches Nogueira et al. 2019 ; Nogueira et al. 2020 ; Zhuang et al. 2024 compute relevance scores using the logits of relevance-related tokens such as “Yes” or “No”. Other approaches Sachan et al. 2022 ; Zhuang et al. 2023b ; Cho et al. 2023 estimate the relevance of a passage based on the probability of generating the corresponding query sequence. In contrast, Xian et al. 2023 demonstrated that listwise reranking methods outperform pointwise approaches by comparing candidate passages at once. Building on this, RankGPT Sun et al. 2023 employed GPT-4 OpenAI 2023 to achieve state-of-the-art zero-shot reranking performance, and later work distilled knowledge into open-source LLMs Pradeep et al. 2023a ; Pradeep et al. 2023b . While intuitive, this generation-based approach introduces inefficiencies and hinders alignment with the goals of ranking. 2.2 Generative Reranking with LLMs Model Global Ranking Single Pass Decoding Bias Mitigation Position Selection ListT5 ✗ ✗ ✓ ✗ RankZephyr ✗ ✗ ✓ ✗ PE-Rank ✓ ✗ ✗ ✗ FIRST ✗ ✓ ✗ ✗ MVP ✓ ✓ ✓ ✓ Table 1: Comparison of generative LLM rerankers and MVP with respect to bias mitigation, global ranking capability, and generation target. To address the limitations discussed