Bayesian Active Learning with Gaussian Processes Guided by LLM Relevance Scoring for Dense Passage Retrieval
Junyoung Kim, Anton Korikov, Jiazhou Liang, Justin Cui, Yifan Simon Liu, Qianfeng Wen, Mark Zhao, Scott Sanner, [1ex] Sungkyunkwan University, Republic of Korea, University of Toronto, Canada [email protected] · 2026
Read Bayesian Active Learning with Gaussian Processes Guided by LLM Relevance Scoring for Dense Passage Retrieval by Junyoung Kim, Anton Korikov, Jiazhou Liang, Justin Cui, Yifan Simon Liu, Qianfeng Wen, Mark Zhao, Scott Sanner, [1ex] Sungkyunkwan University, Republic of Korea, University of Toronto, Canada [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17906.txt.
Introduction
Junyoung Kim and seven colleagues frame passage retrieval as a budget-limited global search, since large language models score relevance well but cost too much to run everywhere. Their BAGEL framework spreads sparse model scores across the embedding space using one Gaussian process per query. It then picks passages to score by balancing trusted regions against uncertain ones. Across four benchmark datasets and two model backbones, BAGEL beats reranking methods under the same model budget on every dataset.
Catalog record
| CREATOR | Junyoung Kim, Anton Korikov, Jiazhou Liang, Justin Cui, Yifan Simon Liu, Qianfeng Wen, Mark Zhao, Scott Sanner, [1ex] Sungkyunkwan University, Republic of Korea, University of Toronto, Canada [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49014 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17906
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bayesian Active Learning with Gaussian Processes Guided by LLM Relevance Scoring for Dense Passage Retrieval Junyoung Kim, Anton Korikov, Jiazhou Liang, Justin Cui, Yifan Simon Liu, Qianfeng Wen, Mark Zhao, Scott Sanner, [1ex] Sungkyunkwan University, Republic of Korea, University of Toronto, Canada [email protected] Abstract While Large Language Models (LLMs) exhibit exceptional zero-shot relevance modeling, their high computational cost necessitates framing passage retrieval as a budget-constrained global optimization problem. Existing approaches passively rely on first-stage dense retrievers, which leads to two limitations: (1) failing to retrieve relevant passages in semantically distinct clusters, and (2) failing to propagate relevance signals to the broader corpus. To address these limitations, we propose B ayesian A ctive Learning with G aussian Processes guid E d by L LM relevance scoring ( BAGEL ) 1 1 1 https://github.com/junieberry/BAGEL , a novel framework that propagates sparse LLM relevance signals across the embedding space to guide global exploration. BAGEL models the multimodal relevance distribution across the entire embedding space with a query-specific Gaussian Process (GP) based on LLM relevance scores. Subsequently, it iteratively selects passages for scoring by strategically balancing the exploitation of high-confidence regions with the exploration of uncertain areas. Extensive experiments across four benchmark datasets and two LLM backbones demonstrate that BAGEL effectively explores and captures complex relevance distributions and outperforms LLM reranking methods under the same LLM budget on all four datasets. 1 Introduction Figure 1: Comparison of passage selection strategies under a fixed LLM budget. The x-axis shows a 1D projection of passage embeddings, and the y-axis displays the estimated Gaussian Process posterior mean (blue line) and standard deviation (shaded region). (a) LLM Pointwise Reranking focuses on passages (red dots) located nearby the query embedding (dashed line), often missing relevant passages in distant semantic clusters. (b) BAGEL actively explores the embedding space with active learning. By modeling the predictive mean (blue line) and uncertainty (blue shaded area) from observed scores (red dots), the acquisition function (orange line) guides the selection of the next passage (black ▼) to explore high uncertainty regions and/or exploit high expected relevance areas, uncovering relevant passages in diverse clusters. While Large Language Models (LLMs) demonstrate a strong zero-shot ability in modeling complex query-passage relevance 22 ; 27 , their high computational cost prohibits exhaustive inference over large corpora. Consequently, the passage retrieval task can be framed as a budget-constrained global optimization problem : identifying relevant passages within a massive search space under a strictly limited number of LLM inferences. Prevalent approaches largely adhere to the LLM reranking paradigm 41 ; 27 , where dense retrievers retrieve a top- K candidate set based on computationally efficient vector similarity and then reorder the set with an LLM. However, as shown in Figure 1 a, passively relying on this first-stage candidate set introduces two fundamental limitations: First , the first-stage retriever imposes an upper bound on the recall. Relevant passages often reside in multiple, semantically distinct clusters scattered throughout the embedding space 33 ; 12 , forming a multimodal relevance distribution. These clusters may be located far from the query due to out-of-distribution domains 13 or query ambiguity 5 . Standard dense retrievers, which retrieve from a local neighborhood around the query embedding, may fail to detect global structures or high-relevance clusters located far from the initial neighborhood of query. Second , existing approaches fail to propagate relevance signals from previously scored passages to unseen passages, overlooking the underlying embedding space that connects them. By failing to utilize the semantic structure where the relevance of one passage often implies the relevance of its neighbors 8 , current approaches hinder efficient exploration of the global landscape. To overcome these limitations, we propose Gaussian Process (GP)-based active learning as an effective framework for this budget-constrained task. GPs offer two intrinsic properties that directly address the aforementioned challenges: (1) Kernel-based Relevance Signal Propagation : GPs naturally model correlations between data points via kernel functions, enabling the representation of multimodal, clustered relevance functions (cf. Figure 1 b). They also allow us to interpolate relevance signals across the embedding space, effectively inferring the relevance of unobserved passages based on sparse LLM signals. (2) Uncertainty for Active Learning : GPs provide a probabilistic posterior that includes both predictive mean and variance (uncertainty). This enables Bayesian Active learning to effectively search the embedding space by balancing exploration ( e.g., via uncertainty) with exploitation. Building on these insights, we propose B ayesian A ctive learning with G aussian Processes guid E d by L LM relevance scoring ( BAGEL ) , by leveraging the advantages of GPs to actively navigate the embedding space. Figure 1 b illustrates how BAGEL models relevance scores and actively selects the next passage for LLM scoring using both the GP predicted mean (blue line) and uncertainty (blue shaded area) as further elaborated below. Specifically, BAGEL constructs a query-specific GP surrogate model of the LLM-based query-passage relevance function, defined over the dense passage embedding space. By conditioning on the observed LLM relevance scores, BAGEL extends relevance signals to unseen passages, capturing complex, multimodal relevance structures and producing a full ranking under a limited LLM budget. Moreover, to explore multiple high relevance clusters ( i.e., modes), BAGEL actively selects additional passages (Steps 1–5 in Figure 1 b) for LLM relevance scoring using an acquisition function. By jointly evaluating the GP’s predicted relevance and its uncertainty, it balances exploitation : selecting passages predicted to be highly relevant, and exploration : selecting passages with high uncertainty. This strategy enables efficient navigation of the entire passage embedding space while making parsimonious use of expensive LLM relevance scoring. The main contributions of our work are summarized as follows: • Gaussian Process-based Active Learning for Passage Exploration. We propose a framework that integrates LLM-based relevance scoring with active learning driven by Gaussian Processes, enabling the strategic exploration of the dense passage embedding space. • Empirical Analysis of Kernel and Acquisition Functions. We empirically show that stationary kernels ( e.g., RBF, Matérn) are effective for capturing multimodal relevance structures, while uncertainty-based acquisition functions play a critical role in guiding effective exploration. • Comprehensive Validation. Evaluated on four distinct passage retrieval datasets, BAGEL significantly outperforms conventional LLM reranking baselines under the same LLM budget, for example, improving NDCG@50 from 29.3 to 41.6 on the TravelDest dataset. Figure 2: Overview of BAGEL. For each query, BAGEL defines a query-specific Gaussian Process (GP) using LLM-based relevance scores of selected passages in dense embedding space. The process begins with a (a) warm-start initialization by labeling the query itself and top- M dense-retrieved passages. In the (b) active learning phase, an acquisition function combines the GP’s predictive mean and uncertainty to iteratively select next passage. 2 Preliminaries 2.1 Gaussian Processes GPs are non-parametric Bayesian models that define a prior over functions, allowing probabilistic function modeling 36 ; 37 . Let f:\mathbb{R}^{d}\rightarrow\mathbb{R} , then the prior over f is specified as f\sim\mathcal{GP}(0,k(\cdot,\cdot)), (1) where k:\mathbb{R}^{d}\times\mathbb{R}^{d}\rightarrow\mathbb{R} is a chosen kernel function that aims to determine how similarity is measured and defines the function space the GP can represent. Consequently, the choice of kernel function influences properties such as smoothness and complexity of the GP. Given a set of inputs \mathbf{X}=[\mathbf{x}_{1},\ldots,\mathbf{x}_{n}]^{\top}\in\mathbb{R}^{n\times d} with an observed output \mathbf{f}(\mathbf{X})=\mathbf{y}\in\mathbb{R}^{n} , the posterior predictive distribution