Regime-Conditional Retrieval: Theory and a Transferable Router for Two-Hop QA
Andre Bacellar · 2026
Read Regime-Conditional Retrieval: Theory and a Transferable Router for Two-Hop QA by Andre Bacellar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09019.txt.
Introduction
Bacellar studies two-hop retrieval, where queries split by whether the second-hop entity appears in the question or in the bridge passage. Bacellar formalizes the split with three theorems, linking ranking quality to the separation margin and routing to two surface-text predicates. The paper then offers RegimeRouter, a light binary router picking between question-only and question-plus-relation retrieval with five text features. It gains about 6 points on its training set and about 5 and 1 points zero-shot on two other sets.
Catalog record
| CREATOR | Andre Bacellar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26788 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.09019
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Regime-Conditional Retrieval: Theory and a Transferable Router for Two-Hop QA Andre Bacellar Abstract Two-hop QA retrieval splits queries into two regimes determined by whether the hop-2 entity is explicitly named in the question (Q-dominant) or only in the bridge passage (B-dominant). We formalize this split with three theorems: (T1) per-query AUC is a monotone function of the cosine separation margin, with R 2 ≥ 0.90 R^{2}\geq 0.90 for six of eight type × \times encoder pairs; (T2) regime is characterized by two surface-text predicates, with P1 decisive for routing and P2 qualifying the B-dominant case, validated across three encoders and three datasets; (T3) bridge advantage requires the relation-bearing sentence B rel B_{\text{rel}} , not entity name alone, since removing it collapses performance by 8.6–14.1 pp ( p < 0.001 p<0.001 ). Building on this theory we propose RegimeRouter , a lightweight binary router that selects between question-only and question + B rel +B_{\text{rel}} retrieval using five text features derived directly from the predicate definitions. Trained on 2WikiMultiHopQA (n = 881, 5-fold cross-fitted) and applied zero-shot to MuSiQue and HotpotQA, RegimeRouter achieves Δ R @ 5 \Delta R@5 of + 5.6 +5.6 pp ( p < 0.001 p<0.001 ), + 5.3 +5.3 pp ( p = 0.002 p=0.002 ), and + 1.1 +1.1 pp (ns, no-regret) respectively, with a single frozen deployment rule: α = 0.25 \alpha=0.25 across all three datasets ( α = 0.5 \alpha=0.5 reported separately as an in-domain ablation upper bound). Human annotation (Cohen’s κ = 1.00 \kappa=1.00 ( Cohen 1960 ) , n = 50 n=50 ) and replication across NV-Embed-v2, BGE-large, and e5-mistral confirm all findings are structural, not artifact. 1 Introduction Multi-hop retrieval systems routinely treat the bridge passage as a second query: encode the bridge in query mode, re-retrieve from the corpus, and fuse the results. This design implicitly assumes that the bridge passage contains retrieval-useful information beyond what the original question encodes. We show that assumption is correct for some queries and incorrect for others , and that the split is predictable from surface text. Consider a comparison question: “Which of Person A or Person B was born earlier?” The question explicitly names both hop-2 candidates. A bi-encoder trained on (question, gold-passage) pairs embeds this question near passages about Person A and Person B, since both targets are already named in the question. The bridge passage (about one of them) adds no disambiguation the question has not already provided. Dense re-encoding of the bridge is redundant; the question embedding alone ranks the correct passage first. This is the Q-dominant regime : P1=True (both answer entities appear in the question). Now consider a compositional question: “What nationality is the director of Film X?” The question refers to the hop-2 entity only indirectly, as “the director of Film X” , never by name. The hop-1 bridge passage about Film X contains the sentence “Film X was directed by Person Y” : a relation-bearing sentence that names Person Y explicitly. Without this sentence, no embedding knows to retrieve Person Y’s nationality page. With it, fusing the bridge sentence into the retrieval score corrects the ranking. This is the B-dominant regime : P1=False (the answer entity is not named in the question), P2=True (it is named in the bridge). We formalize this dichotomy as two retrieval regimes (Section 3 ), prove three theorems characterizing their structure (Section 4 ), and build a practical transferable router exploiting the theory (Sections 5 – 6 ). Contributions. 1. Regime theory (T1–T3): the retrieval outcome of any two-hop query is characterized by two binary surface-text predicates: P1 is decisive for routing; P2 qualifies the B-dominant case when P1 is false. Validated across three encoders and three datasets. 2. RegimeRouter : a five-feature binary router trained on predicate proxies, requiring no oracle labels and no embeddings at inference time; routing decisions use only surface-text features. 3. Cross-dataset no-regret : significant gain on MuSiQue ( p=0.002 , zero-shot) and positive non-significant transfer on HotpotQA, with a single frozen deployment rule for \alpha . 4. Structural validation : bridge knockout experiment (T3), pool invariance (T1 attack surface), and human annotation ( \kappa=1.00 ) rule out artifact explanations. 2 Background Multi-hop retrieval. Given a two-hop question q and corpus \mathcal{C} , the task is to return the top- k passages under R@k , where both a bridge passage g_{1} and a gold passage g_{2} must appear in the retrieved set. Dominant methods iterate: retrieve g_{1} (hop-1), then use g_{1} to generate or retrieve g_{2} (hop-2). Asymmetric bi-encoders. Modern retrievers like NV-Embed-v2 ( Lee et al. 2024 ) , BGE-large ( Xiao et al. 2023 ) , and e5-mistral ( Wang et al. 2024 ) use separate encoder modes for questions ( f_{q} ) and passages ( f_{d} ), trained contrastively on (question, gold-passage) pairs. The 49^{\circ} principal angle between query and document subspaces (measured on 2WikiMultiHopQA) is by design: it maximizes retrieval discriminability. We exploit this geometry: encoding a full bridge passage as a query ( f_{q}(B) ) is out-of-distribution for the encoder and is, on aggregate, worse than encoding the question itself ( f_{q}(q) ), though this aggregate masks a regime split. For Q-dominant queries (P1=True), the question already names the hop-2 entity and f_{q}(q) dominates. For B-dominant queries (P1=False), the relation-bearing sentence B_{\mathrm{rel}} inside the bridge explicitly names the hop-2 entity, and fusing f_{q}(B_{\mathrm{rel}}) with f_{q}(q) corrects the ranking. Existing work and its assumption. IRCoT ( Trivedi et al. 2023 ) reformulates the bridge as a query for hop-2 retrieval; HippoRAG2 ( Gutiérrez et al. 2025 ) uses PPR over a bridge-passage graph; PropRAG ( Wang and Han 2025 ) does beam search over extracted propositions. All assume the bridge passage is the right signal for hop-2. We show this is regime-dependent: true for B-dominant queries (P1=False, P2=True), harmful for Q-dominant queries (P1=True). 3 Two Retrieval Regimes 3.1 Empirical Observation We measure micro-AUC for hop-2 retrieval on 200 hop-1-correct queries per dataset (pool k=50 , question-built pool): AUC (micro) Dataset n q B_{q} B_{d} \Delta(q{-}B_{q}) MuSiQue 727 .805 .663 .657 +.142 HotpotQA 940 .977 .845 .854 +.132 2Wiki 947 .904 .590 .595 +.314 The aggregate \Delta>0 appears to confirm universal question dominance, but this is a mixture reversal artifact (Corollary 1 ). Type-stratified analysis (2WikiMultiHopQA). Type Prev. \Delta (Q - B) Regime comparison 48% +0.650 Q-dominant bridge_comp. 18% + 0.000 transition compositional 22% - 0.108 B-dominant inference 12% - 0.118 B-dominant The aggregate \Delta=+0.314 is driven entirely by comparison queries (48% of the dataset, \Delta=+0.650 ). Compositional and inference queries, where the bridge identifies the hop-2 entity by name, show \Delta<0 : the bridge embedding outperforms the question. This reversal motivates a formal characterization of when bridge information helps. 3.2 The Two Predicates We identify two binary predicates that determine retrieval regime: Definition 1 (P1 and P2) . Let q be a two-hop question and b the bridge passage. Let e_{2} denote the hop-2 target entity. • P1 : e_{2} (or its canonical title) appears in q . “The answer entity is already named in the question.” • P2 : e_{2} appears in b , specifically in a relation-bearing sentence of b . “The bridge passage names and contextualizes the