EvoSelect : Data-Efficient LLM Evolution for Targeted Task Adaptation

Ting-Wei Li, Sirui Chen, Jiaru Zou, Yingbing Huang, Tianxin Wei · 2026

Read EvoSelect : Data-Efficient LLM Evolution for Targeted Task Adaptation by Ting-Wei Li, Sirui Chen, Jiaru Zou, Yingbing Huang, Tianxin Wei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26170.txt.

Introduction

Li and six colleagues address targeted adaptation of large language models when good human-labelled data are scarce and synthetic data are noisy, spare, or off-target. Their EvoSelect method adds a selection step to the usual generation-training loop, picking candidate samples for both task fit and variety. Task fit is judged through optimal transport over proxy gradient representations, while a diversification step promotes complementary coverage. Tests show steady gains over past selection methods with both weak and strong data generators.

Catalog record

CREATORTing-Wei Li, Sirui Chen, Jiaru Zou, Yingbing Huang, Tianxin Wei
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47261
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.26170

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EvoSelect : Data-Efficient LLM Evolution for Targeted Task Adaptation Ting-Wei Li, Sirui Chen, Jiaru Zou, Yingbing Huang, Tianxin Wei Abstract Adapting large language models (LLMs) to a targeted task efficiently and effectively remains a fundamental challenge. Such adaptation often requires iteratively improving the model toward a targeted task, yet collecting high-quality human-labeled data to support this process is costly and difficult to scale. As a result, synthetic data generation has emerged as a flexible and scalable alternative. One straightforward approach is through an iterative generation–training loop , where candidate data are synthesized through an external generator, the model is updated using these data and the process is repeated over iterations. However, generated samples can be noisy, highly redundant, or even misaligned with the targeted task distribution. Training indiscriminately on such data can dilute useful learning signals and even degrade model performance. To address this, we introduce a refined paradigm, namely an iterative generation–selection–training loop , which incorporates a selection step prior to model updates. Building on this paradigm, we propose EvoSelect , a data-efficient framework to evolve LLM effectively. Given candidate samples produced by the data generator, EvoSelect selects training data by jointly modeling targeted task alignment and diversity. We estimate task relevance through optimal transport with proxy gradient representations, which quantifies how well candidate samples align with the targeted task distribution. To mitigate redundancy, we incorporate a diversification mechanism that promotes coverage of complementary training samples. By interleaving alignment and diversification, EvoSelect enables progressive LLM evolution toward targeted tasks. Extensive experiments on various benchmarks demonstrate that with either weak or strong data generators, EvoSelect consistently improves adaptation efficacy over existing data selection methods. 1 Introduction Large language models (LLMs) have demonstrated strong general-purpose capabilities and are also widely deployed as powerful autonomous agents ( 33 ; 48 ) . However, many real-world applications require adapting LLMs to specific task distributions under limited supervision and constrained post-training resources ( 56 ; 15 ; 54 ; 1 ) . To overcome the limitation, one prevalent solution is via a practical setting: iterative generation–training loop ( 53 ; 38 ; 52 ) , where candidate data is synthesized by an external data generator, used to update the base model through fine-tuning, and the process is repeated over multiple iterations. However, even with abundant synthetic data, new challenges emerge: data efficacy and data efficiency . Firstly, not all generated examples are equally useful. Under the iterative setting, these generated samples can progressively drift away from the targeted task, leading to reduced effectiveness for adaptation. Secondly, even well-aligned samples may become redundant over successive iterations, adding little new information while increasing unnecessary computational cost. We demonstrate these issues in Figure 1 , where we visualize validation and synthetic training samples generated in different iterations with t-SNE on the MMLU dataset ( 16 ) . We can observe that newly generated samples exhibit two key behaviors over iterations: (1) progressively mis-aligned with the target distribution (i.e. the blue arrow: iteration 2 generated samples ( green ) move further away from the target distribution ( red ) compared to iteration 1 generated samples ( orange )) and (2) substantial overlap between successive iterations (i.e. orange and green samples). These observations highlight the risk that naively training on all generated data can dilute useful information and even degrade adaptation performance. Thus, we are motivated to study a novel paradigm about effective LLM evolution for targeted task adaptation: an iterative generation-selection-training loop, which selects high-quality data before updating the base model. Accordingly, the key question now becomes: which generated examples should be used within the iterative loop? Figure 1: Issues of synthetic training samples and naive targeted selection. (1) Generated samples ( orange & green ) drift away from the target distribution ( red ); (2) Generated samples increasingly overlap across iterations; (3) Attribution-only methods bias toward the centroid and under-cover the entire target distribution. To solve this puzzle, we argue that effective data selection in an iterative setting must jointly consider two objectives across iterations. On one hand, selected examples should be target-aligned , meaning they need to stay functionally relevant to the targeted tasks. On the other hand, selected examples must maintain diversity , covering complementary regions of the data space to avoid accumulating redundancy over iterations. However, existing approaches typically address these objectives in isolation. Some methods leverage training data attribution ( 6 ) to prioritize target-aligned examples ( 51 ; 57 ; 25 ) , while others emphasize diversity through naive sampling or clustering strategies ( 9 ; 40 ; 26 ) . Even when both aspects are considered, they are often combined in a sequential/heuristic manner, such as through weighted sums, multiplication or local diversity adjustment ( 30 ; 49 ; 55 ) . In response, we propose EvoSelect in this paper, which synergizes data attribution and diversity into a unified, principled framework for effective data selection in targeted task adaptation. Given a pool of generated candidate samples in each iteration, EvoSelect assesses task relevance through an optimal-transport-based alignment and promotes diversity by favoring samples that provide complementary training signals. A key component of EvoSelect is the use of optimal transport (OT) ( 35 ; 13 ) 1 1 1 More background on OT can be found in Appendix A . for target distribution alignment. Instead of matching a single centroid as in attribution-only methods ( 51 ; 25 ; 37 ) , OT aligns the training and full target distribution. In Figure 1 , we demonstrate that due to the naive selection procedure, attribution-only methods may only select data according to the largest cluster (i.e. the red cluster) and fail to cover the entire target distribution. EvoSelect employs an interleaved optimization procedure that iteratively refines sample importance by jointly optimizing target alignment and diversity, synergizing two signals in the iterative process. To demonstrate the superiority of EvoSelect , we conduct evaluation across 10 knowledge-intensive benchmarks with both weak/strong data generators. Experimental results show that EvoSelect outperforms strong data selection baselines and even training on all generated data across different selection ratios and iterations. Notably, EvoSelect is the only approach that consistently improves upon the base model performance throughout the evolution process, preventing harmful adaptation. 2 Preliminaries 2.1 Training Data Attribution Let S=\{x_{1},\dots,x_{n}\} denote a set of training examples drawn from a space \mathcal{X}_{\text{train}} , and let T=\{x^{\prime}_{1},\dots,x^{\prime}_{m}\} denote a set of target examples drawn from a space \mathcal{X}_{\text{validation}} . Each data sample consists of a query–answer pair. We consider a generative model f_{\Theta} parameterized by \Theta . Typically, fine-tuning starts from a pretrained base model with parameters \Theta_{0} , and the adapted parameter \Theta is obtained by minimizing a task-specific objective over the dataset S . Training data attribution ( 6 ) aims to quantify how individual training examples in S relate to the behavior of f_{\Theta} on target validation examples in T . Formally, an attribution method \tau assigns a score \tau(S;f_{\Theta})\in\mathbb{R}^{n} , where the i -th entry \tau(S;f_{\Theta})_{i} reflects the degree to which training example x_{i} is associated with the model’s output on the target samples. For data selection methods that employ training data attribution, a common strategy is to select the top- k training examples according to their attribution

Read the complete text