TRACE: Capability-Targeted Agentic Training
Hangoo Kang, Tarun Suresh, Jon Saad-Falcon, Azalia Mirhoseini · 2026
Read TRACE: Capability-Targeted Agentic Training by Hangoo Kang, Tarun Suresh, Jon Saad-Falcon, Azalia Mirhoseini (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05336.txt.
Introduction
Kang, Suresh, Saad-Falcon, and Mirhoseini build TRACE, a training loop that turns an AI agent's own failures into lessons instead of fine-tuning blindly on target tasks. It contrasts successful and failed runs to name the missing skills, then builds a small training world for each skill that rewards using it. Compact adapters trained per skill are blended into one model. Gains run to about 15 points on a customer-service benchmark and a software-engineering benchmark alike, beating strong rivals while using under a fourth of their training runs.
Catalog record
| CREATOR | Hangoo Kang, Tarun Suresh, Jon Saad-Falcon, Azalia Mirhoseini |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59528 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05336
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TRACE: Capability-Targeted Agentic Training Hangoo Kang, Tarun Suresh, Jon Saad-Falcon, Azalia Mirhoseini Abstract Large Language Models (LLMs) deployed in agentic environments must exercise multiple capabilities across different task instances, where a capability is performing one or more actions in a trajectory that are necessary for successfully solving a subset of tasks in the environment. Many existing approaches either rely on synthetic training data that is not targeted to the model’s actual capability deficits in the target environment or train directly on the target environment, where the model needs to implicitly learn the capabilities across tasks. We introduce TRACE (Turning Recurrent Agent failures into Capability-targeted training Environments), an end-to-end system for environment-specific agent self-improvement. TRACE contrasts successful and failed trajectories to automatically identify lacking capabilities, synthesizes a targeted training environment for each that rewards whether the capability was exercised, and trains a LoRA adapter via RL on each synthetic environment, routing to the relevant adapter at inference. Empirically, TRACE generalizes across different environments, improving over the base agent by +14.1 points on τ 2 \tau^{2} -Bench (customer service) and +7 perfect scores on ToolSandBox (tool use), outperforming the strongest baseline by +7.4 points and +4 perfect scores , respectively. Given the same number of rollouts, TRACE scales more efficiently than baselines, outperforming GRPO and GEPA by +9.2 and +7.4 points on τ 2 \tau^{2} -Bench. The code is available at https://github.com/ScalingIntelligence/TRACE.git . 1 Introduction Large Language Models (LLMs) have been increasingly deployed in agentic environments, such as customer-service workflows ( 36 ) and coding platforms ( 14 ; 32 ) , that require them to exercise multiple capabilities across different task instances. We define a capability as performing one or more actions in a trajectory that are necessary for successfully solving some subset of task instances in the target environment. For example, in a customer-service environment, retrieving the correct customer record is a capability necessary for tasks such as canceling a flight, changing a seat, or verifying a reservation. A natural approach to improving an LLM in a target agentic environment is to train it directly via Reinforcement Learning (RL) or Supervised Fine-Tuning (SFT). However, the training signal does not reveal which underlying capabilities the agent lacks. The supervision available, whether final outcomes, intermediate rewards, or demonstration traces, assigns credit to task-specific action sequences rather than to the shared capability whose absence was attributed to failure across tasks. As a result, the model must learn lacking capabilities implicitly, making learning sparse and sample-inefficient. Recent approaches have focused on scaling synthetic RL environments and training data ( 26 ; 29 ; 7 ; 28 ; 24 ) . However, because these approaches are not targeted at the specific capabilities the agent lacks, they yield limited gains. Figure 1: Overview of TRACE, an end-to-end system for automated environment-specific agent self-improvement. TRACE automatically identifies the specific capabilities that an agent lacks and synthesizes targeted training environments for each capability. In this work, we introduce TRACE (Turning Recurrent Agent failures into Capability-targeted training Environments), an end-to-end system that automatically identifies the specific capabilities an agent lacks for a target environment and teaches it to exercise those capabilities. TRACE focuses on addressing the following design objectives: 1. Identifying high-impact capability deficits; The agent may fail for many reasons; automatically determining which lacking capabilities clearly distinguish failures from successes and prioritizing those that account for the most failures, is essential for efficient targeted training. 2. Synthesizing capability-targeted training environments. For each identified deficit, the agent needs a training environment that directly isolates and rewards exercising that capability, while preserving the target environment’s interface. 3. Learning and composing multiple capabilities. The agent must effectively acquire all identified capabilities from their respective synthetic environments and apply the right one for each task instance in the target environment. Figure 1 shows an overview of TRACE, which consists of four steps. In step 1, the base agent generates rollouts in the target environment, and an LLM-based analysis agent contrasts successful and failed trajectories to identify capabilities that meaningfully distinguish the two, ranking them by failure coverage. In step 2, for each retained capability, an LLM-based generation agent uses the capability description and corresponding failed trajectories to construct a synthetic environment that isolates the missing capability while preserving the target environment’s interface, such as its tool schemas, interaction protocol, and output format. Task instances are procedurally generated from random seeds, and whether the capability is exercised is verified automatically from tool arguments, state changes, or final outputs. In step 3, we train a LoRA adapter on each capability-specific synthetic environment using RL. In step 4, we use the base model itself to classify which capability is necessary for a task from natural-language descriptions, activating only the selected adapter for generation. Our contributions are as follows: • We propose TRACE, an end-to-end system for environment-specific agent self-improvement. Our approach uses the agent’s trajectories on the target environment to automatically identify the specific capabilities that the agent lacks and then synthesizes targeted training environments for those capabilities. • We show that TRACE generalizes across different environments and complex tasks. Empirically, TRACE significantly outperforms both the base model and state-of-the-art baselines, including direct RL on the target environment, broader synthetic data scaling, and prompt optimization. On \tau^{2} -Bench ( 3 ) , a customer-service benchmark, TRACE achieves a 47.0% overall pass rate , improving upon the base agent by +14.1 points and outperforming the strongest baseline by +7.4 points (Table 1 ). On ToolSandBox ( 16 ) , a tool use benchmark, TRACE achieves a mean similarity score of 0.552 with 26 perfect scores , +0.141 points and +7 perfect scores over the base model, and +0.032 points and +4 perfect scores over the strongest baseline (Table 2 ). • TRACE requires a lightweight training procedure and is highly scalable. For example, we show that with only 2–4 LoRA adapters, each corresponding to a capability identified by our system, we can increase the performance on \tau^{2} -Bench by 9.2%. Each LoRA adapter requires updating only 5.3% of the model parameters. In addition, we observe that TRACE scales much more efficiently with the number of rollouts compared to baseline methods. Given the same number of rollouts, TRACE outperforms GRPO 23 and GEPA 1 by 9.2% and 7.4% points on \tau^{2} -Bench, respectively. • We demonstrate that RL training on capability-targeted environments outperforms adding and optimizing identified capabilities in the prompt, yielding a +7.4 point improvement on \tau^{2} -Bench (Figure 3 ). 2 Related Work LLM Agents and Interactive Environments. Autonomous LLM agents are increasingly deployed in complex, multi-turn environments. Rigorous evaluation requires mastering specific tool interfaces and interaction protocols, driving the adoption of benchmarks like \tau^{2} -Bench, ToolSandBox, WebArena ( 38 ) , WorkArena ( 6 ) , WorkArena++ ( 4 ) , SWE-bench ( 13 ) , Terminal-Bench ( 19 ) and TheAgentCompany ( 31 ) . Agentic Reinforcement Learning and Synthetic Data. Recent alignment methods utilize in-the-wild device control ( 2 ) , implicit step rewards ( 15 ) , or verifiable multi-turn RL ( 9 ; 37 ) . A common capability-acquisition strategy scales training through procedurally synthesized environments ( 26 ) (e.g., AWM ( 30 ) , EnvScaler ( 24 ) ,