On the Robustness of LLM-Based Dense Retrievers: A Systematic Analysis of Generalizability and Stability Journal: TOIS CCS: Information systems Retrieval models and ranking CCS: Computing methodologies Natural language processing

Yongkang Li, Panagiotis Eustratiadis, Yixing Fan, Evangelos Kanoulas · 2026

Read On the Robustness of LLM-Based Dense Retrievers: A Systematic Analysis of Generalizability and Stability Journal: TOIS CCS: Information systems Retrieval models and ranking CCS: Computing methodologies Natural language processing by Yongkang Li, Panagiotis Eustratiadis, Yixing Fan, Evangelos Kanoulas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16576.txt.

Introduction

Li and colleagues present the first careful study of toughness in LLM-based dense search models. Decoder-only models are taking over from BERT-style backbones with large gains and broad use. For breadth across four benchmarks and 30 datasets, tuned models excel, but reasoning-optimized models pay a focus tax in broader contexts. They resist typos and corpus poisoning better than older rivals, yet stay open to word swaps. Vector shapes predict lexical stability, and larger models mostly prove more robust.

Catalog record

CREATORYongkang Li, Panagiotis Eustratiadis, Yixing Fan, Evangelos Kanoulas
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98892
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16576

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Robustness of LLM-Based Dense Retrievers: A Systematic Analysis of Generalizability and Stability Journal: TOIS CCS: Information systems Retrieval models and ranking CCS: Computing methodologies Natural language processing Yongkang Li, Panagiotis Eustratiadis, Yixing Fan, Evangelos Kanoulas Abstract . Decoder-only large language models (LLMs) are increasingly replacing BERT-style architectures as the backbone for dense retrieval, achieving substantial performance gains and broad adoption. However, the robustness of these LLM-based retrievers remains underexplored. In this paper, we present the first systematic study of the robustness of state-of-the-art open-source LLM-based dense retrievers from two complementary perspectives: generalizability and stability . For generalizability, we evaluate retrieval effectiveness across four benchmarks spanning 30 datasets, using linear mixed-effects models to estimate marginal mean performance and disentangle intrinsic model capability from dataset heterogeneity. Our analysis reveals that while instruction-tuned models generally excel, those optimized for complex reasoning often suffer a “specialization tax,” exhibiting limited generalizability in broader contexts. For stability, we assess model resilience against both unintentional query variations (e.g., paraphrasing, typos) and malicious adversarial attacks (e.g., corpus poisoning). We find that LLM-based retrievers show improved robustness against typos and corpus poisoning compared to encoder-only baselines, yet remain vulnerable to semantic perturbations like synonymizing. Further analysis shows that embedding geometry (e.g., angular uniformity) provides predictive signals for lexical stability and suggests that scaling model size generally improves robustness. These findings inform future robustness-aware retriever design and principled benchmarking. Our code is publicly available at https://github.com/liyongkang123/Robust_LLM_Retriever_Eval . 1. Introduction IR ( IR ) is fundamental to how humans access information in the digital age. Recently, dense retrieval has established itself as a leading paradigm, distinguished by its ability to capture semantic nuances while maintaining efficiency ( 33 ; 15 ) . In this paradigm, queries and documents are encoded into high-dimensional vectors, and relevance is computed via distance functions such as inner product or cosine similarity. Early dense retrievers predominantly employed BERT-style ( 14 ) encoder-only architectures typically trained using contrastive learning or distillation-based objectives, with representative examples including DPR ( 33 ) , Contriever ( 29 ) , TAS-B ( 28 ) , and DRAGON ( 40 ) . With the rise of LLM , decoder-only architectures like LLaMA ( 67 ) , Mistral ( 30 ) , and Qwen ( 2 ) have prompted researchers to explore their potential as dense encoders. This progression spans from initial attempts like RepLLaMA ( 49 ) and LLM2Vec ( 47 ) to current state-of-the-art (SOTA) models like Qwen3-Embedding ( 74 ) and DIVER ( 48 ) . Consequently, these LLM -based retrievers now dominate major authoritative benchmarks, such as BEIR ( 66 ) and BRIGHT ( 62 ) . Despite this remarkable progress, the robustness of these LLM-based retrievers remains largely unexplored. While leaderboard metrics quantify performance on standard test sets, they often fail to reflect reliability in dynamic, open-world environments. This paper addresses that gap by conducting the first systematic analysis of the robustness of SOTA open-source decoder-only LLM-based dense retrievers. Drawing on the framing of 71 and 46 , we study two complementary aspects of robustness: generalizability , which concerns model performance across diverse evaluation scenarios, and stability , which concerns model resilience under perturbations. We further examine which intrinsic model properties are associated with robustness, aiming to provide guidance for the evaluation and design of more reliable retrievers. Specifically, our study is guided by the following three research questions: RQ1: How generalizable are LLM-based dense retrievers across diverse conditions? We address this by evaluating SOTA open-source LLM-based retrievers on a comprehensive suite of 30 datasets spanning 4 benchmarks: MS MARCO ( 3 ) , BEIR ( 66 ) , BRIGHT ( 62 ) , and BrowseComp-Plus ( 11 ) . To enable fine-grained analysis, we categorize these datasets according to 11 task types, 8 query types, and 5 corpus source types. Critically, standard aggregation metrics (e.g., macro-averaging) can be misleading due to significant variances in dataset size and query difficulty. To overcome this, we introduce linear mixed-effects models (LMMs) ( 24 ) to estimate marginal mean performance while controlling for dataset-specific random effects, enabling a fairer assessment of intrinsic model capabilities. Our analysis reveals that instruction-augmented LLM-based retrievers achieve the strongest average estimated performance across all three factors. However, models explicitly optimized for complex reasoning-intensive tasks often suffer from a “specialization tax”, exhibiting limited generalizability across broader retrieval conditions. RQ2: How stable are LLM-based dense retrievers under perturbations? We assess stability from two complementary angles: query-side variations and document-side adversarial attacks. For query-side stability, we consider five query variations—misspelling, reordering, synonymizing, paraphrasing, and naturalizing—following prior work ( 51 ) , and measure the relative performance degradation under each type. For document-side stability, we evaluate resilience against corpus poisoning attacks ( 76 ; 37 ) under both white-box and direct-transfer black-box settings, where adversarial passages are injected to mislead the retriever. Our experiments reveal that while LLM-based retrievers demonstrate improved robustness against misspellings and white-box corpus poisoning over encoder-only models, synonymizing remains broadly challenging across model families, whereas paraphrasing is more dataset-dependent and especially disruptive in shorter-query settings. By contrast, direct-transfer corpus poisoning proves largely ineffective in the no-access setting we study. RQ3: What factors are predictive of robustness in LLM-based retrievers? We investigate potential predictors of robustness, focusing on the geometry of embedding spaces—specifically isotropy—as well as model size and spectral norm. Our analyses suggest that different factors relate to different facets of stability. Angular uniformity (proxied by average pairwise cosine similarity) provides the clearest cross-model signal of vulnerability to lexical and other surface-level perturbations, whereas variance uniformity (proxied by IsoScore) shows only suggestive, context-dependent trends. Beyond isotropy, larger models within the Qwen3 family tend to be more robust, while spectral norm shows limited predictive value in our setting. Two controlled interventions—angular uniformity regularization and bidirectional attention conversion—further show no consistent robustness gains in our intervention setting. Together, these results suggest that angular uniformity is more useful as a diagnostic signal than as a standalone training target, while attention directionality remains a plausible but unverified contributor. Our main contributions are as follows: \bullet To our knowledge, we present the first systematic robustness study of decoder-only LLM-based dense retrievers, synthesizing a two-dimensional framework—generalizability and stability—for comprehensive evaluation. \bullet We propose a refined evaluation protocol integrating linear mixed-effects models to isolate intrinsic model performance from dataset variances, enabling fairer and statistically rigorous comparisons. \bullet We show that robustness gains in LLM-based retrievers are perturbation-specific: instruction-augmented models are more robust to character-level noise and white-box corpus poisoning, yet synonymizing remains broadly challenging and paraphrasing is more dataset-dependent. We further identify embedding isotropy as the clearest cross-model signal of lexical and surface-level robustness. \bullet We conduct controlled intervention experiments to probe the geometry–robustness boundary and synthesize the findings into concrete guidelines for robustness-aware evaluation, evidence-based model selection, and training objective design targeting query reformulation invariance. 2. Related Work We organize related work along three axes: retrieval paradigms (Section 2.1 ), robustness evaluation in neural retrieval (Section 2.2 ), and embedding geometry as a lens for analyzing robustness (Section 2.3 ). 2.1. Retrieval Paradigms and the Rise of LLM-based Dense Retrieval We organize prior retrieval models into three broad paradigms: sparse lexical retrieval, single-vector dense retrieval, and multi-vector late interaction. This

Read the complete text