Influence Guided Sampling for Domain Adaptation of Text Retrievers
Meet Doshi, Vishwajeet Kumar, Yulong Li, Jaydeep Sen · 2026
Read Influence Guided Sampling for Domain Adaptation of Text Retrievers by Meet Doshi, Vishwajeet Kumar, Yulong Li, Jaydeep Sen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21759.txt.
Introduction
Meet Doshi, Vishwajeet Kumar, Yulong Li, and Jaydeep Sen adapt text retrievers to new domains by choosing training data with influence scores. General retrievers train on a big eclectic mix of corpora and tasks. How that mix should be sampled for a new target is an open choice.
Common rules sample evenly, by size, or by expert hunch. The authors instead estimate each source's influence on the target task. Sampling by influence spends the training budget where it helps the new domain most. Smarter sampling could make domain search tools strong without giant new labeled sets.
Catalog record
| CREATOR | Meet Doshi, Vishwajeet Kumar, Yulong Li, Jaydeep Sen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21759
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Influence Guided Sampling for Domain Adaptation of Text Retrievers Meet Doshi, Vishwajeet Kumar, Yulong Li, Jaydeep Sen Abstract General-purpose open-domain dense retrieval systems are usually trained with a large, eclectic mix of corpora and search tasks. How should these diverse corpora and tasks be sampled for training? Conventional approaches sample them uniformly, proportional to their instance population sizes, or depend on human-level expert supervision. It is well known that the training data sampling strategy can greatly impact model performance. However, how to find the optimal strategy has not been adequately studied in the context of embedding models. We propose Inf-DDS , a novel reinforcement learning–driven sampling framework that adaptively reweighs training datasets guided by influence-based reward signals and is much more lightweight w.r.t. GPU consumption. Our technique iteratively refines the sampling policy, prioritizing datasets that maximize model performance on a target development set. We evaluate the efficacy of our sampling strategy on a wide range of text retrieval tasks, demonstrating strong improvements in retrieval performance and better adaptation compared to existing gradient-based sampling methods, while also being 1.5 × − 4 × 1.5{\times}-4{\times} cheaper in GPU compute. Our sampling strategy achieves a 5.03 \mathbf{5.03} absolute ndcg@10 improvement while training a multilingual bge-m3 model and an absolute ndcg@10 improvement of 0.94 \mathbf{0.94} while training all-MiniLM-L6-v2 , even when starting from expert-assigned weights on a large pool of training datasets. 1 Introduction Figure 1 : Trade-off between training time (GPU hours) and average NDCG@10 on the MLDR-13 test set when optimizing bge-m3-dense on the MLDR-13 dev set. Text-to-embedding based dense retriever models have recently gained huge popularity with their strong results across various benchmarks ( Karpukhin et al. 2020 ; Izacard et al. 2022 ; Wang et al. 2023 ; Chen et al. 2024 ; BehnamGhader et al. 2024 ) . These models are prized for their generalizability across domains without domain-specific tuning, typically trained on vast, diverse datasets. For instance, the Sentence-Transformers project, which develops generic sentence embeddings, utilized billions of instances across multiple datasets, with domain-specific data varying widely in size. However, larger datasets don’t inherently improve embedding quality, making it crucial to identify the most informative datasets and their optimal proportions for training. Effective sampling strategies are essential to prevent overfitting or underfitting, making dataset selection a central challenge in developing robust, generalizable, or domain-specific embedding models. While random sampling is a common default, it is limited by ignoring data source informativeness when sampling from large training datasets. Alternatives include temperature sampling and instance-based proportional sampling. A more intensive approach involves creating ad-hoc sampling distributions via iterative experimentation, termed expert weights, requiring expert evaluation. However, these strategies are static and predefined, often suboptimal compared to the unknown ideal distribution for maximizing model performance. A dynamic sampling approach, capable of adaptation, may better approximate this optimal distribution. There has consequently been substantial interest in making sampling adaptive. Gradient-based approaches such as DDS ( Wang et al. 2020a ) and its multi-target extension ( Wang et al. 2020b ) use gradient-derived rewards to adjust the training distribution online. DoGE ( Fan et al. 2024 ) proposes a generalization estimation function to approximate data influence, while methods like DoReMi ( Xie et al. 2023a ; Engstrom et al. 2024 ) rely on proxy models to estimate dataset utility. In practice, these dynamic methods face two main challenges: (1) instability and high variance introduced by stochastic gradients, which we empirically demonstrate in Section 5 , and (2) substantial computational overhead when proxy models or expensive estimators are required. Together, these limitations motivate the design of an online, adaptive optimization strategy that can learn sampling weights efficiently and robustly while remaining computationally tractable. In this paper, we propose Inf luence-guided D ynamic D ata S ampling strategy (Inf-DDS) , a computationally efficient novel algorithm that addresses the critical challenge of data sampling for domain adaptation, overcoming limitations of existing gradient-based methods. Inf-DDS iteratively takes small gradient-update steps on each domain’s data, monitoring the impact on the downstream metric. Domains demonstrating greater performance improvements are subsequently assigned higher rewards. This adaptive sampling strategy, inspired by recent influence-based methods ( Koh & Liang 2017 ; Bae et al. 2022 ; Fan et al. 2024 ; Yu et al. 2024 ; Xia et al. 2024 ) for sampling training data across multiple domains, focuses learning on the most informative subsets of data. Our algorithm offers three key advantages over prior work: (1) it eliminates the dependence on noisy gradient estimates for reward computation, (2) it efficiently reuses computations from updating the parameterized sampling distribution \psi parameters to also update the model parameters \theta , making it much more computationally efficient and (3) it produces more reliable and interpretable sampling trajectories for better downstream gains. Our contributions in this work are as follows: a. We propose Inf-DDS, an influence-guided reinforcement learning approach that learns to adjust sampling probabilities across diverse training datasets, improving target-domain retrieval performance while being much more computationally efficient. b. We validate Inf-DDS against robust benchmarks, including BEIR datasets ( Thakur et al. 2021 ) , Sentence-Transformers all-MiniLM-L6-v2 ( Reimers & Gurevych 2019 ) and MLDR ( Chen et al. 2024 ) , demonstrating significant improvements while optimizing for a target domain. 2 Related Work Recent work on training models with large, diverse data pools has explored both simple heuristic sampling and more adaptive, learned reweighting schemes. A common practice is to sample languages uniformly or via a temperature-scaled distribution that interpolates between uniform and size-proportional sampling. For example in language pretraining, Cooldown ( Li et al. 2024b ) demonstrates improvements in multilingual training by oversampling high-resource languages during the initial phases of training, while shifting to uniform sampling across high- and low-resource languages toward the end to enhance generalization. DoReMi leverages the loss gap between proxy models and the target model to optimize domain sampling weights for train set generalization. Early works on domain- or task-specific adaptation select relevant subsets of data using either cross-entropy differences or simple classifiers ( Moore & Lewis 2010 ; Brown et al. 2020 ) . DSIR ( Xie et al. 2023b ) employs importance sampling by assigning weights to training instances based on their hashed features for the target task, which then guide data selection. In contrast, CRISP ( Grangier et al. 2025b ) clusters the training data and assigns importance weights to clusters based on the frequency of source/target instances that fall into each cluster. Recent influence estimation approaches guide data selection by identifying and prioritizing examples that most impact a model’s predictions or performance, ensuring the most influential data are included in training ( Grosse et al. 2023 ; Nikdan et al. 2025 ; Zhou et al. 2025 ) . Methods such as LESS ( Xia et al. 2024 ) and Quad ( Zhang et al. 2025 ) use first-order approximations of Influence estimates via Taylor expansions of the change in target loss after a gradient update to select relevant instances. In contrast, we focus on learning domain weights online during training. Prior work shows that data models can accurately predict the influence of training samples on held-out target examples ( Ilyas et al. 2022 ; Engstrom et al. 2024 ) . MATES ( Yu et