Lightweight Query Routing for Adaptive RAG: A Baseline Study on RAGRouter-Bench

Prakhar Bansal, Shivangi Agarwal · 2026

Read Lightweight Query Routing for Adaptive RAG: A Baseline Study on RAGRouter-Bench by Prakhar Bansal, Shivangi Agarwal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03455.txt.

Introduction

Bansal and Agarwal study lightweight routing for retrieval-augmented generation, picking the cheapest suitable retrieval strategy per query. They evaluate five classical classifiers under three feature regimes on RAGRouter-Bench, spanning 7,727 queries across four domains. The best setup, TF-IDF with a support vector machine, reaches about 93 percent accuracy while simulating about 28 percent token savings over always using the priciest strategy.

Catalog record

CREATORPrakhar Bansal, Shivangi Agarwal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15854
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03455

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lightweight Query Routing for Adaptive RAG: A Baseline Study on RAGRouter-Bench Prakhar Bansal, Shivangi Agarwal Abstract Retrieval-Augmented Generation pipelines span a wide range of retrieval strategies that differ substantially in token cost and capability. Selecting the right strategy per query is a practical efficiency problem, yet no routing classifiers have been trained on RAGRouter-Bench ( 12 ) , a recently released benchmark of 7,727 7,727 queries spanning four knowledge domains, each annotated with one of three canonical query types: factual, reasoning, and summarization. We present the first systematic evaluation of lightweight classifier-based routing on this benchmark. Five classical classifiers are evaluated under three feature regimes, namely, TF-IDF, MiniLM sentence embeddings ( 10 ) , and hand-crafted structural features, yielding 15 classifier feature combinations. Our best configuration, TF-IDF with an SVM, achieves a macro-averaged F1 of 0.928 \mathbf{0.928} and an accuracy of 93.2 % \mathbf{93.2\%} , while simulating 28.1 % \mathbf{28.1\%} token savings relative to always using the most expensive paradigm. Lexical TF-IDF features outperform semantic sentence embeddings by 3.1 3.1 macro-F1 points, suggesting that surface keyword patterns are strong predictors of query-type complexity. Domain-level analysis reveals that medical queries are hardest to route and legal queries most tractable. These results establish a reproducible query-side baseline and highlight the gap that corpus-aware routing must close. 1 Introduction RAG has become the dominant approach for grounding LLM outputs in external knowledge ( 8 ) , but the design space spans multiple retrieval paradigms with very different cost profiles. A simple dense-retrieval step ( NaiveRAG ) is fast and cheap; an iterative pipeline ( IterativeRAG ) that alternates retrieval and generation can handle complex queries but costs 3.5 \times more in tokens ( 12 ) . Most deployed systems apply one paradigm uniformly to every query. Routing each query to the cheapest sufficient paradigm has clear precedent. 6 trained a classifier to predict question complexity and route among three retrieval strategies, showing that lightweight routing can match always-expensive baselines. The broader LLM routing literature shows similar results when routing among model sizes ( 9 ; 5 ; 4 ; 3 ) . 12 recently released RAGRouter-Bench, the first benchmark designed specifically for RAG routing research. It provides 7,727 queries across four domains, each annotated with one of three canonical query types (factual, reasoning, summarization), alongside evaluations of five RAG paradigms. Importantly, the benchmark establishes that paradigm applicability is shaped by query-corpus interactions , not query type alone. To our knowledge as of April 2026 , no classifier has been trained on this benchmark. We fill that gap, establishing the first query-side classification baselines and quantifying how much of the routing signal is captured by query text features before corpus-side signals are incorporated. Our contributions are: (i) 15 classifier–feature baselines on RAGRouter-Bench using query text alone; (ii) a cross-domain breakdown identifying where lightweight routing is most and least reliable; and (iii) a post-hoc cost simulation showing that the best high-accuracy configuration achieves 28.1\% token savings, with an analysis of how cost and accuracy trade off across feature regimes. 2 Background 2.1 RAGRouter-Bench RAGRouter-Bench ( 12 ) comprises four corpora: MuSiQue (Wikipedia, 3,356 queries), QuALITY (literature, 1,200 queries), UltraDomain (legal, 1,277 queries), and GraphRAG-Bench (medical, 1,896 queries). The benchmark annotates each query with one of three canonical query types: factual (single-step fact lookup), reasoning (multi-hop cross-document inference), and summarization (corpus-level aggregation), encoded in the dataset as single_hop , multi_hop , and summary respectively. The label distribution is imbalanced: factual queries account for 52.9\% of all queries, summarization for 30.0\% , and reasoning for 17.1\% . Five RAG paradigms are evaluated with reported relative token costs: LLM-Only ( 1.0\times ), NaiveRAG ( 1.4\times ), GraphRAG ( 2.1\times ), HybridRAG ( 2.8\times ), and IterativeRAG ( 3.5\times ). The paper’s central finding is that no single paradigm universally dominates: optimal paradigm selection is driven by query-corpus interactions , with both query type and structural or semantic corpus properties shaping which paradigm performs best ( 12 ) . This motivates our work as a query-side baseline study— establishing what is achievable from query text alone, before corpus-side signals are incorporated. 2.2 Related Work Adaptive retrieval: Adaptive-RAG ( 6 ) trains a T5-Large classifier on automatically derived complexity labels to route among three retrieval strategies, and demonstrates that a three-class query-complexity router can match always-expensive baselines with substantially lower cost. Our work extends this approach to RAGRouter-Bench with lighter classifiers, a richer domain spread, and a comparison of feature types. Self-RAG ( 1 ) embeds retrieval decisions in the generation process via reflection tokens; FLARE ( 7 ) uses generation probabilities as a retrieval trigger; Probing-RAG ( 2 ) reads LLM hidden states to make binary retrieve-or-not decisions. SKR ( 11 ) routes based on the model’s apparent self-knowledge; CRAG ( 13 ) applies a post-retrieval corrector. None of these train a multi-strategy query-type router on a publicly labeled benchmark. LLM routing: RouteLLM ( 9 ) and FrugalGPT ( 3 ) show that lightweight classifiers can halve API costs when routing between strong and weak models. RouterBench ( 5 ) demonstrates that KNN and MLP routers on sentence embeddings are competitive, and Hybrid LLM ( 4 ) cuts large-model calls by 40% with no quality loss using a DeBERTa router. We apply the same classifier-based paradigm to RAG strategy selection rather than model selection. 3 Method 3.1 Routing Label and Paradigm Mapping We use the query type annotation from RAGRouter-Bench as the routing target: single_hop (factual), multi_hop (reasoning), and summary (summarization). To simulate cost savings, we map each predicted query type to a recommended paradigm following 6 , who show that factual questions are well-served by single-step retrieval, multi-hop questions benefit from richer retrieval, and summarization queries require iterative retrieval: single_hop \to NaiveRAG , multi_hop \to HybridRAG , summary \to IterativeRAG . We stress that this mapping is a literature-motivated simplification for cost estimation only. The benchmark paper itself shows that optimal paradigm selection requires both query type and corpus-side signals ( 12 ) ; our classifiers operate on query text alone, making corpus-side effects a limitation we address in Section 6 . 3.2 Feature Sets All features are extracted from query text at routing time, requiring no retrieval or LLM calls. Lexical (TF-IDF): Unigram and bigram TF-IDF with sublinear term-frequency scaling, a 3,000-feature vocabulary ceiling, and minimum document frequency of 2. Semantic (MiniLM Embeddings): Each query is encoded with all-MiniLM-L6-v2 ( 10 ) , producing 384-dimensional dense vectors. This 22M-parameter model runs on CPU with no GPU required. Structural (Hand-crafted): Twenty-three features: query length, character count, average word length, question-word type (one-hot: who / what / when / where / why / how / which), presence of negation, approximate named-entity count, clause count, and binary flags for comparative, temporal, aggregation, causal, and procedural patterns. Question-word type has been shown to correlate with retrieval complexity by 6 . 3.3 Classifiers and Evaluation Five classifiers are trained on each feature set: Logistic Regression (L2, C =1.0), SVM (RBF, \gamma =scale), Random Forest (200 trees), KNN ( k =7, cosine), and MLP (256–128 units, early stopping). Dense feature sets are z-score standardized before training. We report macro-averaged F1 (macro-F1) as the primary metric to account for label imbalance, with accuracy alongside

Read the complete text