ANDES: Agent Native Data Evolving Synthesis Tool for Autonomous Instruction Alignment
Zhengyang Zhao, Shengjie Ye, Lu Ma, Hao Liang, Hengyi Feng, Wentao Zhang · 2026
Read ANDES: Agent Native Data Evolving Synthesis Tool for Autonomous Instruction Alignment by Zhengyang Zhao, Shengjie Ye, Lu Ma, Hao Liang, Hengyi Feng, Wentao Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01279.txt.
Introduction
Zhao and co-authors give AI agents a skill for building training data. Agents now help automate AI research itself. Post-training turns base models into aligned assistants. That step rests on high-quality data above all. Web hunts for data are long and noisy. They can swamp an agent's limited context. Dataset quality then falls, and training suffers too.
Andes reframes data generation as a plug-and-play skill. A self-evolving World Tree routes the synthesis work. Diagnostic reports let trainer agents steer the loop. Agents guide the process through a closed feedback cycle. Under tight compute limits, weaker agents gain a lot. Andes tops PostTrainBench and generalizes across tasks.
Catalog record
| CREATOR | Zhengyang Zhao, Shengjie Ye, Lu Ma, Hao Liang, Hengyi Feng, Wentao Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01279
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ANDES: Agent Native Data Evolving Synthesis Tool for Autonomous Instruction Alignment Zhengyang Zhao, Shengjie Ye, Lu Ma, Hao Liang, Hengyi Feng, Wentao Zhang Abstract AI agents are increasingly being tasked with automating AI research itself, particularly the critical post-training phase that transforms base LLMs into aligned assistants. However, recent evaluations reveal that even frontier agents struggle to perform this task. While the success of post-training fundamentally relies on acquiring high-quality data, relying on agents to autonomously curate targeted training datasets from the open web introduces severe challenges. Executing the long-horizon tasks of searching, filtering, and balancing data within noisy web environments frequently overwhelms an agent’s limited context, ultimately leading to degraded dataset quality and suboptimal downstream training performance. To bridge this gap, we introduce Andes (Agent Native Data Evolving Synthesis), a framework that reimagines data generation as a plug-and-play agent skill . Rather than forcing agents to devise complex data-gathering strategies from scratch, Andes provides an intelligent abstraction layer. By leveraging a self-evolving World Tree routing mechanism and actionable diagnostic reports, it allows trainer agents to dynamically steer data synthesis through an interactive, closed-loop interface. We demonstrate that under strict compute constraints, equipping foundationally weaker agents with Andes improves automated alignment, securing state-of-the-art performance on PostTrainBench and robust cross-task generalization. Our project is available at https://github.com/zzy1127/ANDES . * * footnotetext: Equal contribution. $\dagger$ $\dagger$ footnotetext: Corresponding author. Figure 1: Andes achieves SOTA performance on PostTrainBench. Compared to the bare execution baseline GLM-4.7 (Scaffold-only), Andes drives a definitive alignment leap to 33.4%, outperforming Opus-4.7 by 4.8%. 1 Introduction Driven by the rapid advancements in agentic capabilities, current research trends are increasingly focusing on applying autonomous agents to orchestrate the Large Language Model (LLM) post-training process 25 —encompassing techniques such as SFT and RL 27 ; 31 ; 35 ; 36 . By delegating the complex decision-making of model alignment to an agent, researchers aim to replace tedious manual trial-and-error with continuous, self-correcting workflows 22 ; 14 ; 16 ; 19 . In this context, post-training agents are expected to autonomously diagnose capability deficits and actively acquire targeted training signals to patch these weaknesses. Unlike traditional static training pipelines, this dynamic evolution requires the agent to continuously intervene with tailored data scenarios. Consequently, the efficiency and precision with which an agent can procure high-quality, diverse data fundamentally dictate the upper bound of the entire training loop. However, existing data acquisition strategies present a severe capability trap for post-training agents. On one hand, frameworks that rely on external environments, such as open web search, demand profound foundational capabilities—including complex long-horizon planning, raw HTML parsing, and zero-shot noise filtering 38 ; 9 . This imposes a prohibitively high barrier, causing weak-to-medium models to fail catastrophically before they can form a functional closed training loop. As for advanced agents equipped with comprehensive web information-gathering capabilities—such as Opus 4.7—they often remain hindered by the organization and balancing of data from disparate sources, as well as by the control of data quality; this, in turn, leads to suboptimal post-training performance. On the other hand, conventional synthetic data pipelines are predominantly implemented as static, one-shot scripts. They operate in isolation from the agent’s active training cycle, stripping the agent of the ability to dynamically steer the generation direction based on real-time diagnostic feedback 32 ; 20 . Therefore, once the agent encounters a new downstream task scenario, these methods are very likely to fail due to data domain mismatch. This disconnect inevitably leads to diversity collapse, wasted compute, and severe over-fitting to surface-level benchmark distributions. In short, there is a critical absence of an accessible, dynamically interactive high quality data synthesis interface tailored for post-training agents. To fill this void, we introduce Andes (Agent Native Data Evolving Synthesis), the first agent-native data synthesis framework. Rather than forcing agents to navigate the chaotic open web or execute rigid offline scripts, Andes elegantly encapsulates the complexities of high-fidelity data generation into a plug-and-play agent skill . By exposing a simple tool-calling interface, it empowers even foundationally weak agents to orchestrate sophisticated data synthesis. The trainer agent simply declares its target cognitive capability according to the downstream benchmarks, and Andes handles the underlying scenario abstraction, returning a highly aligned data batch alongside a real-time diagnostic report to provide guidance for adjustments in the next invocation. Under the hood, this steerable process is driven by a self-evolving World Tree routing mechanism that autonomously expands to provide diverse contexts. Coupled with the report-driven feedback loop, Andes transforms data generation into a dynamic, closed-loop game, allowing the agent to actively filter data, seamlessly calibrate its configurations for subsequent invocations, and proactively steer the trajectory away from logical repetition. The main contributions of this work are summarized as follows: • We introduce a new perspective on agentic post-training, reconceptualizing data synthesis not as a static, offline pipeline, but as a plug-and-play agent skill . This conceptual shift significantly lowers the capability threshold, enabling agents to autonomously acquire targeted, high-quality training data. • We implement Andes , a plug-and-play synthesis tool for trainer agents. Powered by self-evolving World Tree routing and report-driven feedback, Andes abstracts away the intricate mechanics of data curation, allowing the trainer agent to focus entirely on high-level optimization strategies and therefore enables precise control over data generation to acquire high-quality, diverse training data. • We comprehensively evaluate Andes across diverse benchmarks, demonstrating that its integration into the active post-training loop enables foundationally weaker models to achieve remarkable autonomous self-improvement and secure state-of-the-art performance. Furthermore, extensive ablation and analytical studies validate the efficacy of our core designs. 2 Related Works 2.1 SFT Data Synthesis The growing demand for high-quality supervised fine-tuning (SFT) data has driven extensive research into synthetic data generation. Early works bootstrap instruction data from seed prompts (Self-Instruct 30 , WizardLM 32 , Condor 4 ), but often suffer from limited seed diversity. To reduce explicit seed dependence, Magpie 33 and MATRIX-Gen 29 explore template-based and multi-agent generation, though trading flexibility for higher orchestration costs. Another thread focuses on structured synthesis and quality verification via base-refine paradigms (BARE 39 ), executable feedback (AutoIF 8 ), and prompt decomposition (UltraIF 1 , DecIF 13 ). More recently, to adapt to evolving model capabilities, Middo 28 and WIST 15 introduced dynamic, closed-loop synthesis frameworks. Despite these advances, existing approaches remain fundamentally human-centric or rely on rigid offline workflows. They critically lack the standardized, dynamically interactive tool interfaces required for an autonomous agent to plug-and-play and proactively steer the data acquisition process. 2.2 Automated Research Automating the full research pipeline has emerged as a central challenge in AI development. Recent works like AIDE 14 , AlphaEvolve 23 , AUTO-SOTA 19 , and the AI Scientist series 21 ; 34 demonstrate the potential of agents to autonomously iterate on experiments and produce algorithmic discoveries. To systematically evaluate these capabilities, benchmarks such as MLE-bench 5 and MLAgentBench 11 provide diverse end-to-end ML tasks for agent assessment. Focusing specifically on the post-training phase, TREK 22 automates the training lifecycle via tree-based exploration, while PostTrainBench 25 reveals that frontier agents still lag significantly behind official instruction-tuned models under bounded compute budgets. Recognizing that the primary bottleneck in these workflows lies in the complex curation of high-quality training data,