Evolutionary Task Discovery: Advancing Reasoning Frontiers via Skill Composition and Complexity Scaling

Liqin Ye, Yanbin Yin, Michael Galarnyk, Yuzhao Heng, Sudheer Chava, Chao Zhang · 2026

Read Evolutionary Task Discovery: Advancing Reasoning Frontiers via Skill Composition and Complexity Scaling by Liqin Ye, Yanbin Yin, Michael Galarnyk, Yuzhao Heng, Sudheer Chava, Chao Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11666.txt.

Introduction

Ye and five others present EvoTD, evolutionary task discovery for advancing reasoning frontiers via skill mixes and hardness scaling. Post-training like reward-based learning remains constrained by training data variety and hardness, while random mutation methods suffer sameness collapse. EvoTD treats data making as directed search over skills and hardness levels. Crossover mixes novel skills for variety, and parametric mutation scales size and depth limits for transfer. A dynamic learnable-zone filter keeps tasks within the model's learnable region.

Catalog record

CREATORLiqin Ye, Yanbin Yin, Michael Galarnyk, Yuzhao Heng, Sudheer Chava, Chao Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE123726
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11666

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evolutionary Task Discovery: Advancing Reasoning Frontiers via Skill Composition and Complexity Scaling Liqin Ye, Yanbin Yin, Michael Galarnyk, Yuzhao Heng, Sudheer Chava, Chao Zhang Abstract The reasoning frontier of Large Language Models (LLMs) has advanced significantly through modern post-training paradigms (e.g., Reinforcement Learning from Verifiable Rewards (RLVR)). However, the efficacy of these methods remains fundamentally constrained by the diversity and complexity of the training data. One practical solution is data synthesis; yet, prevalent methods relying on unstructured mutation or exploration suffer from homogeneity collapse , failing to systematically expand the reasoning frontier. To overcome this, we propose Evo lutionary T ask D iscovery ( EvoTD ), a framework that treats data synthesis as a directed search over a dual-axis manifold of Algorithmic Skills and Complexity Attributes . We introduce structured evolutionary operators to navigate this space: a Crossover operator that synthesizes novel skill compositions to enhance diversity, and a Parametric Mutation operator that scales structural constraints (e.g., input size, tree depth) to drive robust generalization. Crucially, we integrate a dynamic Zone of Proximal Development filter, ensuring tasks lie within the learnable region of the model. Empirically, EvoTD delivers substantial reasoning gains that generalize consistently across model architectures, pretraining regimes, and scales, demonstrating that structured evolutionary curricula can effectively support reasoning improvement. We release our code on https://github.com/liqinye/EvoTD . 1 Introduction The reasoning abilities of LLMs have advanced significantly, with models like DeepSeek-R1 ( 9 ) and Gemini 3 Pro ( 45 ) achieving impressive performance on challenging benchmarks such as Humanity’s Last Exam ( 31 ) and AIME ( 2 ) . A key driver of this progress is Reinforcement Learning with Verifiable Rewards (RLVR), which leverages programmatically validated signals such as code correctness or solution accuracy, instead of relying on human-annotated examples ( 18 ; 9 ) . Yet the effectiveness of RLVR is tied to the diversity and quality of the training corpus. Reasoning training relies heavily on costly human-curated question–answer pairs ( 5 ) or noisy web-scraped corpora ( 27 ) , both of which remain static and constrain scalability as well as the exploration of reasoning difficulty ( 58 ) . One promising response to these data limitations is data synthesis, where strong LLMs manufacture training samples ( 15 ) . However, current methods suffer from critical structural limitations. Standard training synthesis approaches ( 59 ; 54 ; 26 ; 24 ) typically rely on unstructured mutation elicited via prompting (e.g., “make this problem harder”, “add more constraints”). This frequently results in generating near-duplicate samples ( 41 ; 17 ) . Diversity-aware approaches regularize this by preserving samples with low textual similarity scores (e.g., BLEU distance, ROUGH-L) ( 53 ; 13 ; 51 ) ; yet, such textual similarity is not necessarily equivalent to the algorithm diversity. A single algorithm can be expressed using completely different linguistic formulations. Recent works have begun to organize synthesis around explicit skill taxonomies ( 37 ; 56 ; 16 ) , ensuring that the training distribution covers a diverse set of logical concepts. While these methods successfully categorize what logic is required (the skill), they fundamentally neglect how that logic is constrained (the complexity). This leads to a “flat” curriculum that covers the breadth of algorithmic concepts but fails to systematically scale the computational complexity to induce generalization. Consequently, there remains a critical gap for a generative framework capable of automatically manipulating both logical backbones and structural scales of reasoning tasks to drive robust, post-training improvement. In light of this, we propose Evo lutionary T ask D iscovery ( EvoTD ), a novel data synthesis framework that treats task generation as a directed search over a structured abstraction space. As the total complexity of a task is a product of both intrinsic complexity of the general logic and the extrinsic constraints of the problem instance ( 42 ; 7 ) , we conceptualize a reasoning task as a composition of two orthogonal dimensions: Algorithmic Skills (the logic backbone, e.g., binary search, heaps) and Complexity Attributes (the structural constraints, e.g., input size, graph size). Rather than relying on black-box prompting to “make this diverse and harder”, we introduce a principled evolutionary task discovery mechanism. Motivated by Evolutionary Algorithms ( 12 ) , we formalize a Attribute Mutation operator (which scales complexity attributes) and a Skill Crossover operator (which explores novel skill combinations) to systematically traverse the task space. Our framework adopt a proposer-solver paradigm where the proposer synthesizes tasks and the solver learns from the tasks. To ensure the task falls within solver’s Zone of Proximal Development (ZPD) ( 49 ) , we retain tasks that are neither trivial nor impossible. Crucially, because learnability is assessed against the current solver policy \pi_{\theta} , our filter implements a dynamic curriculum: as the solver improves, previously impossible tasks become learnable, and the training distribution automatically shifts toward harder instances. Complementing this learnability filter, we leverage LLM’s metacognitive capability ( 6 ) to verify the skill alignment of synthesized tasks. Through this rigorous cycle of evolutionary proposal and filtering, EvoTD constructs a diverse, adaptive curriculum that continuously pushes models’ reasoning frontier. Empirical evaluations across five diverse benchmarks, spanning code generation and mathematical reasoning, demonstrate that EvoTD significantly outperforms standard heuristic synthesis paradigms. Notably, on the Qwen3-4B reasoning model, our method achieves substantial gains on the AIME 24 (+8.2%) and AIME 25 (+7.2%) benchmarks. We further show that our method generalizes across three orthogonal axes of model variation: architecture (Qwen3, LLaMA), pretraining regime (Base, Instruct), and parameter scale (3–8B), attaining the best performance on every evaluated backbone. Beyond code and math, gains transfer cleanly to general-domain reasoning benchmarks (MMLU-Pro, SuperGPQA), with the largest improvements concentrated on STEM-adjacent disciplines where rigorous reasoning is the binding constraint. We make the following contributions: • We formalize reasoning task synthesis as directed traversal over a dual-axis manifold: Algorithmic Skills and Complexity Attributes . This abstraction moves beyond naive prompting, allowing control of logic and constraints to generate quality reasoning curricula. • We introduce two evolutionary operators for task synthesis: Attribute Mutation for complexity scaling and Skill Crossover for composition discovery. This dual-operator design empowers EvoTD to systematically explore the boundaries of the task space. • We conduct extensive evaluations across five benchmarks including code generation and mathematical reasoning, demonstrating the utility of our framework. 2 EvoTD Figure 1 : EvoTD Framework. (1) Skill-based Seeding: generate skill conditioned programs. (2) Complexity Attribute Mutation: mutate existing programs based on applicable complexity attributes. (3) Skill Crossover: synthesize programs with new skill combinations. (4) Fitness Check: verify programs via executability, skill alignment, and learnability. (5) Train: train solvers with valid tasks. In this section, we introduce EvoTD , an automated framework designed to systematically expand the diversity and complexity of reasoning tasks through the learning process. We begin by formalizing the space of executable reasoning tasks across deduction, abduction, and induction modes (§ 2.1 ). We then define our dual-axis abstraction, which explicitly decouples algorithmic skills from structural complexity to enable precise evolutionary control (§ 2.2 ). Finally, we detail the evolutionary synthesis engine, describing how attribute mutation and skill crossover operators cooperatively traverse this space to discover novel training samples (§ 2.3 ). Our training pipeline is built upon verifier-based RL paradigm;

Read the complete text