CeQe: Grounding Lexical Retrieval

in Semantic Evidence · 2026

Read CeQe: Grounding Lexical Retrieval by in Semantic Evidence (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00452.txt.

Introduction

Kahirov, Deshpande, and Sundararaman ground lexical retrieval in semantic evidence with CE-QE. BM25 catches exact keyword matches and corpus-wide term weight. It is blind to the semantic vocabulary gap, though. A relevant document phrased differently is never retrieved. No reranking downstream can recover a document outside the candidate set.

Cross-Encoder Query Expansion reads token attributions from a cross-encoder over top semantic results. It picks the terms the cross-encoder treats as decisive and appends them to the BM25 query. Every expansion term is copied verbatim from a retrieved passage. That blocks vocabulary the corpus does not contain. On seven BEIR data sets, recall rose sharply where vocabularies diverge. Natural Questions Recall@100 climbed from 0.32 to 0.47. The BM25 index itself stays unmodified.

Catalog record

CREATORin Semantic Evidence
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2608.00452

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CeQe: Grounding Lexical Retrieval in Semantic Evidence Abstract Abstract. Lexical retrieval (BM25) captures exact keyword matches and weights terms by corpus-wide significance, but it is blind to the semantic vocabulary gap: when a relevant document phrases an answer differently from the query, BM25 never retrieves it, and no amount of downstream reranking or fusion can recover a document that was never in the candidate set. We present Cross-Encoder Query Expansion (CE-QE), which reads the per-token relevance attributions of a cross-encoder applied to top semantic search results, selects the terms the cross-encoder treats as decisive, and appends them to the BM25 query. Unlike classical pseudo-relevance feedback, which reuses BM25’s own (possibly wrong) top results, CE-QE seeds expansion from the semantic retriever’s results, avoiding self-reinforcing query drift. Unlike recent generative query expansion (HyDE, Query2doc), which prompts a large language model to hallucinate text from its parametric knowledge, every CE-QE expansion term is copied verbatim from a retrieved passage, so it cannot introduce vocabulary the corpus does not contain, and its only added cost is attribution extraction on a cross-encoder a hybrid pipeline already runs for reranking. On seven BEIR datasets, CE-QE improves lexical recall substantially where query and answer vocabulary diverge (e.g., NQ Recall@100 from 0.32 to 0.47), and its score-fusion variant (SESF) beats cross-encoder score fusion by 2.5% on Recall@100 and beats SPLADEv2 and ColBERTv2 by 5.3% and 4.6% on nDCG@10, while leaving the underlying BM25 index completely unmodified. Keywords: query expansion, cross-encoder reranking, hybrid search, BM25, dense retrieval, BEIR, retrieval-augmented generation. 1 Introduction Hybrid retrieval that fuses lexical (BM25) and dense semantic search is now the default for retrieval-augmented workloads, because each retriever recovers what the other misses: lexical matching captures exact terms and corpus-wide term significance, while dense retrieval captures synonyms and paraphrase [ 2 ] . The value of the lexical stage is concrete—it captures exact matches (a dense model can rank “Apple” the company and “apple” the fruit as near-identical) and weights rare, discriminative terms by their corpus-wide significance—but it has a structural weakness that fusion alone does not fix. The problem. BM25 retrieves only documents that share surface terms with the query. When a relevant document phrases the answer differently (“side effects” vs. “adverse reactions”, “ibuprofen” vs. “NSAID”), lexical search misses it entirely, and simply fusing its result list with a semantic list does not repair the lexical ranking itself: fusion and reranking can only reorder or combine documents that were retrieved in the first place . If a relevant document shares no surface terms with the query, BM25 never puts it in the candidate set, and no amount of downstream re-scoring can recover it—the recall ceiling is fixed at the first stage. This paper contributes a query-side fix for this problem, together with an account of why it works and how it compares to the two nearest alternatives. • Cross-Encoder Query Expansion (CE-QE) (Section 3 ): a query-expansion method that reads the per-token relevance attributions of a cross-encoder applied to top semantic results, selects the terms the cross-encoder treats as decisive, and appends them to the BM25 query. This injects semantic signal into the lexical stage directly, without modifying the index. Its fusion variant, Semantically Enriched Score Fusion (SESF), combines the enriched lexical results with semantic scores and delivers the best overall quality. • A comparison to the two nearest alternatives (Section 2.1 ): classical pseudo-relevance feedback (RM3), which is self-referential in a way that reinforces exactly the failure CE-QE targets, and recent generative query expansion (HyDE, Query2doc), which expands a query with text an LLM hallucinates from its parametric knowledge rather than from the corpus itself, at the cost of a separate generation call per query. CE-QE expands the query only with terms already present in passages the corpus’s own semantic retriever returned, using a cross-encoder a hybrid pipeline already runs for reranking, which grounds every expansion term in the corpus and adds no separate model call. We evaluate CE-QE and SESF on BEIR through RUMIR, a reproducible pipeline built for this work (Section 4 ), against standard flat BM25 as the lexical stage; a companion paper addresses lexical retrieval’s separate scaling problem at billion-chunk scale, and Section 5 discusses how the two compose. 2 Background and Related Work Lexical retrieval. BM25 scores a document D for query Q as a sum over query terms of an IDF weight times a saturated, length-normalized term-frequency factor [ 1 ] . Term saturation (parameter k_{1} ) stops a single repeated term from dominating; length normalization (parameter b ) discounts long documents. Dense retrieval and ANN. Bi-encoders encode text once and search by similarity [ 6 , 8 ] , using approximate nearest-neighbor indexes such as HNSW [ 4 ] or IVF with product quantization [ 5 ] to remain tractable at scale. Fusion. Two ranked lists are merged by combining ranks or scores. Reciprocal Rank Fusion (RRF) sums 1/(k+\mathrm{rank}_{i}) across lists, needs no tuning, and ignores raw scores [ 3 ] ; it is used by Elasticsearch and LanceDB. Weighted fusion combines normalized scores as \alpha\,L(c)+(1-\alpha)\,S(c) (OpenSearch, Elasticsearch) but is sensitive to score normalization because BM25 and cosine live on different scales. Reranking. Cross-encoders jointly encode the query and each candidate to produce a precise relevance score; they raise quality but cost far more than first-stage retrieval, motivating two-stage pipelines that rerank only a small candidate set [ 7 ] . Query expansion. Classical pseudo-relevance feedback (e.g., relevance models / RM3 [ 11 ] ) expands a query with terms that co-occur in top-ranked documents, using term statistics. CE-QE differs in the selection signal: it picks expansion terms from a cross-encoder’s per-token relevance attributions rather than from co-occurrence counts, so the added terms are those a supervised relevance model treats as decisive in the query–passage interaction. Learned sparse models such as SPLADEv2 [ 9 ] and late-interaction models such as ColBERTv2 [ 10 ] attack the same vocabulary gap by changing the index; CE-QE leaves the BM25 index unchanged and expands the query instead. A more recent line of work expands queries generatively : HyDE prompts an LLM to hallucinate a hypothetical answer document and embeds it for dense retrieval [ 13 ] , and Query2doc few-shot-prompts an LLM to write a pseudo-document that is appended to the query for both sparse and dense retrieval [ 12 ] . Section 2.1 contrasts CE-QE with this generative family directly. Evaluation. BEIR is the standard heterogeneous, zero-shot IR benchmark [ 2 ] . We report Recall@100 (coverage) and nDCG@10 (ranking quality); the two diverge—two rankings with identical Recall@5 can have very different nDCG@5 (e.g., 1.0 vs. 0.62) depending on where the relevant items land—so we track both throughout. Retrieval quality of this kind underlies retrieval-augmented generation broadly [ 14 ] , which is the deployment setting motivating this work. 2.1 Positioning relative to recent work CE-QE vs. generative (LLM) query expansion. HyDE [ 13 ] and Query2doc [ 12 ] both expand a query using text an LLM generates from its own parametric knowledge : a hypothetical answer document or pseudo-document that may contain no terms actually present in the target corpus, and that costs a full LLM decoding pass per query (typically on the order of a

Read the complete text