Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination

Jiasheng Zheng, Boxi Cao, Boxi Yu, Yuzhong Zhang, Jialun Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun · 2026

Read Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination by Jiasheng Zheng, Boxi Cao, Boxi Yu, Yuzhong Zhang, Jialun Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31058.txt.

Introduction

Zheng and colleagues scale code reward learning via atomic splitting and rebuild. Proven-reward learning has shaped coding skills, but growth is limited by lack of hard tasks near the edge. Prior seed growth limits novelty and toughness, so training value fails to scale with making size. Their Atomic Decomposition and Recombination framework makes proven code tasks by splitting into atoms and rebuild, giving novel and hard tasks. Tests show ADR tops baselines in originality, toughness, and diversity, raising code ability across programming, tool usage, and data science.

Catalog record

CREATORJiasheng Zheng, Boxi Cao, Boxi Yu, Yuzhong Zhang, Jialun Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78896
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.31058

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination Jiasheng Zheng, Boxi Cao, Boxi Yu, Yuzhong Zhang, Jialun Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun Abstract Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as the cornerstone for shaping the remarkable coding abilities of Large Language Models (LLMs). However, the scalability of RLVR is severely constrained by the scarcity of sufficiently challenging verifiable code tasks that target near the model’s edge of competence. Prior studies often rely on heuristic seed expansions for data synthesis, which severely limits both novelty and difficulty. Consequently, the training value of such data fails to scale proportionally with the size of its synthesis. To this end, we propose A tomic D ecomposition and R ecombination (ADR), a novel framework that generates verifiable code tasks via decomposition into atomic elements and controlled recombination, thereby enabling the generation of genuinely novel and challenging verifiable code tasks. Experiments and analysis demonstrate that ADR achieves superior originality, difficulty, diversity, and test quality over existing baselines, and consistently delivers greater improvements in code ability across RLVR in diverse downstream domains, including algorithmic programming, tool usage, and data science. Our work sheds light on a new paradigm for novel code task synthesis and scalable RLVR training 1 1 1 Our source code and datasets are available at https://github.com/icip-cas/ADR . 1 Introduction Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as the cornerstone for shaping the strong coding capabilities of large language models (LLMs) 10 ; 29 ; 38 . Leveraging the executability of code, RLVR based on deterministic unit tests can substantially enhance the logical reasoning and code generation abilities of LLMs, enabling their broad adoption in scenarios such as code agents and software development pipelines 5 ; 14 ; 26 . However, the effectiveness of RLVR critically depends on the availability of large-scale, challenging code tasks equipped with rigorous test cases 28 . Unfortunately, manually constructing such datasets requires substantial human effort 25 ; 39 , making it difficult to scale. Therefore, data scarcity has become a primary bottleneck limiting the further development of RLVR. Figure 1 : Overview of the Atomic Decomposition and Recombination (ADR) framework. ADR extracts atomic elements from domain seeds to build an element space, then synthesizes and validates new tasks via controlled recombination and adversarial refinement. An intuitive approach for alleviating this data scarcity is data synthesis. Nevertheless, existing methods for synthesizing verifiable code data lag behind the advances observed in pretraining or instruction-tuning data. A key reason lies in prior findings that RLVR produces true capability gains only when the tasks are sufficiently challenging and target near the model’s edge of competence 34 ; 18 ; 23 ; 37 ; 32 , a threshold existing methods fail to reach 8 ; 27 . In particular, existing approaches predominantly rely on heuristic expansions of existing tasks, such as in-context or recursive prompting 1 ; 35 ; 30 ; 19 . While these methods increase linguistic diversity, they fail to expand logical diversity or task difficulty, thereby offering limited challenge to the agent’s exploration policy. In practice, such superficial expansion restricts agent exploration and leads to premature reward saturation during RLVR. Therefore, we believe that this bottleneck is not a matter of implementation, but an intrinsic limitation of the heuristic expansion paradigm: by preserving the original compositional structures of seeds, it precludes the generation of genuinely novel logical topologies. Building on these insights, we propose a novel verifiable code data synthesis framework, A tomic D ecomposition and R ecombination (ADR). Unlike prior approaches that rely on heuristic seed expansions, ADR constructs data by intersecting orthogonal logical primitives, thereby enabling the generation of genuinely novel and challenging verifiable code tasks. Specifically, as illustrated in Figure 1 , given a small set of domain-specific seed data, we first extract atomic elements via a schema-based, information-theoretically optimized process to form an element space. We then synthesize new tasks through controlled recombination, generate solutions and test generators for execution-based validation, and further enhance test quality via adversarial solution-space optimization. By navigating this combinatorial space, ADR transcends the distributional boundaries of seed data to produce structural intersections unattainable via mere extrapolation. Notably, ADR’s fully automated design enables rapid adaptation to diverse code tasks such as algorithmic programming, tool usage, and data science with minimal seed data, achieving scalable coverage across both task domains and data scale. To comprehensively evaluate the quality of the synthesized verifiable data, we introduce a multi-dimensional evaluation taxonomy, including originality, difficulty, diversity, and test quality. Results demonstrate that ADR-synthesized data significantly outperforms prior synthesis data (e.g., KodCode 30 and Educational Instruct 8 ), across all evaluative dimensions. Furthermore, we conduct RLVR training across diverse code domains and base models. Extensive experimental results reveal that: (1) Previous synthetic data methods, constrained by heuristic expansions of real-world data, fail to surpass original data performance; (2) ADR-synthesized data consistently yield improvements across various base models and code domains. On LCB-v5, ADR achieves 25.37% (+9.20%) on Qwen2.5-Coder-7B, outperforming the best baseline’s 22.75%; (3) Crucially, unlike prior methods that merely enhance sampling density without improving core reasoning (resulting in only +0.60% Pass@8 gains), ADR achieves a remarkable +4.79% Pass@8 improvement, effectively expanding the model’s capability frontier. Our main contributions are summarized as follows: 1. We propose the ADR framework, a novel paradigm that shifts from heuristic seed expansion to atomic decomposition and compositional recombination. 2. We establish a multi-dimensional evaluation taxonomy for verifiable synthetic data that integrates data quality metrics with downstream RLVR performance. 3. Through extensive experiments on large-scale RLVR, we show the strong generalization ability and practical effectiveness of ADR across multiple code domains. 2 Related Work 2.1 Reinforcement Learning with Verifiable Rewards RLVR has emerged as an effective paradigm for eliciting complex reasoning behaviors in LLMs via automatically verifiable signals 5 ; 7 ; 28 . Most prior work focuses on domains with well-defined correctness criteria, particularly math and code 35 . In the math domain, systems such as Kimi K1.5 24 , Tulu 3 14 , and SimpleRL-Zoo 36 scale RLVR on datasets like GSM8K and MATH. In the code domain, RLEF 2 use code dataset CodeContests in RLVR. Beyond strictly verifiable tasks, recent work extends RLVR to less structured domains using soft reward signals, including generative scoring in unstructured answers scenarios 22 and rubric-based rewards in medical and scientific scenarios 4 . Despite these advances, existing work largely overlooks the role of RLVR on synthetic data, particularly in the code domain. Since code naturally exhibits strong structural and verifiable properties, most prior approaches rely heavily on limited pools of real-world or curated datasets. This reliance constrains the scalability of RLVR and restricts its potential for further improving code reasoning and generation capabilities. In contrast, systematically leveraging synthetic data under RLVR remains underexplored, leaving a significant gap in current research. 2.2 Synthetic Code Data Generation High-quality code data is essential for improving the programming capabilities of LLMs, but the high cost and limited scalability of manual annotation have motivated extensive research on synthetic data generation 25 ; 39 ; 33 . Most existing methods primarily focus on the pretraining and instruction fine-tuning stages, while largely ignoring the verifiability of code. These methods can be

Read the complete text