PIVOT: Bridging Planning and Execution in LLM Agents via Trajectory Refinement
Tuo Zhang, Alin-Ionut Popa, Yan Xu, Rui Song, Dimitrios Dimitriadis · 2026
Read PIVOT: Bridging Planning and Execution in LLM Agents via Trajectory Refinement by Tuo Zhang, Alin-Ionut Popa, Yan Xu, Rui Song, Dimitrios Dimitriadis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11225.txt.
Introduction
Tuo Zhang and four co-authors present PIVOT, a framework bridging planning and action in LLM agents through trajectory refinement. LLM agents often produce smooth-looking plans that fail in execution through blocked actions, rule breaks, and piling errors over long runs.
PIVOT treats runs as tunable objects refined through world feedback in four stages. PLAN makes new runs, INSPECT runs them and computes set losses with textual gradients showing plan-action gaps. EVOLVE applies these signals to better runs, and VERIFY runs one final global check against task constraints. A steady intake process ensures result quality never drops. On DeepPlanning and GAIA, PIVOT reaches state-of-the-art results, with human-in-the-loop feedback giving up to about 94 percent gain in constraint satisfaction. It uses up to three to five times fewer tokens than rival methods. Agent builders get planning that holds up in action.
Catalog record
| CREATOR | Tuo Zhang, Alin-Ionut Popa, Yan Xu, Rui Song, Dimitrios Dimitriadis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85317 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11225
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PIVOT: Bridging Planning and Execution in LLM Agents via Trajectory Refinement Tuo Zhang, Alin-Ionut Popa, Yan Xu, Rui Song, Dimitrios Dimitriadis Abstract Large language model (LLM)-based agents frequently generate seemingly coherent plans that fail upon execution due to infeasible actions, constraint violations, and compounding errors over extended horizons. PIVOT (Plan–Inspect–eVOlve Trajectories) addresses this plan–execution misalignment through a self-supervised framework that treats trajectories as optimizable objects iteratively refined via environment interaction. The framework comprises four stages: PLAN generates candidate trajectories; INSPECT executes them and computes structured losses with textual gradients encoding plan–execution discrepancies; EVOLVE applies these signals to produce improved trajectories; and VERIFY performs a final global check against task constraints. A monotonic acceptance process ensures a non-decreasing solution quality. Empirical evaluations on DeepPlanning and GAIA demonstrate state-of-the-art performance: with human-in-the-loop (HITL) feedback, PIVOT establishes a strong upper bound up to ∼ \sim 94% relative improvement in constraint satisfaction, while its fully autonomous variant retains substantial gains, showing that the core trajectory-refinement mechanism remains effective without external supervision. At the same time, PIVOT remains computationally efficient, requiring up to 3–5 × \times fewer tokens than competing refinement methods. These findings establish that (self- or human-supervised) feedback-based trajectory optimization is a principled methodology for mitigating plan–execution gaps in autonomous agent systems. Figure 1: Plan–Execution Misalignment in LLM Agents. LLM-generated plans (blue) often appear valid but diverge during execution (red) due to infeasible steps, incorrect state assumptions, or constraint violations. These discrepancies compound over long horizons, lead to undesirable or suboptimal outcomes. Aligning planning with execution to reach an optimal trajectory (green) is therefore a core challenge in reliable agentic systems. 1 Introduction The deployment of agents based on large language models (LLMs) as autonomous decision-makers marks a paradigm shift in how AI systems interact with the world. Rather than merely generating text, these agents plan multi-step action trajectories, invoke tools and APIs, and adapt to environmental feedback 15 ; 14 . Yet as the scope and autonomy of these agents grow, a fundamental reliability gap persists that current architectures fail to adequately address. The core difficulty is plan–execution misalignment : the systematic divergence between an agent’s intended actions and its realized behavior in a dynamic environment. As shown in Fig. 1 , an LLM agent produces seemingly coherent plans, yet fails during execution due to infeasible actions, incorrect assumptions about the environment, or constraint violations that only become apparent upon interaction. Critically, these failures compound throughout the trajectory, triggering cascading errors that often render the remainder of the plan unrecoverable 27 . This problem is not confined to text-based agentic systems; analogous challenges arise in multi-agent robotic planning under partial observability 15 , underscoring a converging insight across the field: planning and execution must remain tightly coupled . Existing agent-improvement methods only partially address this challenge because they lack a trajectory-level optimization view. Diagnostic methods identify failures post-hoc but do not optimize the underlying plan; iterative refinement methods revise local reasoning steps or prompts; constraint-based methods apply localized fixes; and evolutionary methods search over candidate trajectories without directly optimizing the loss induced by execution outcomes (see Sec. 2 ). What is missing is a mechanism that treats the full trajectory as an optimizable object and converts execution feedback into an update signal. To this end, we propose PIVOT (Plan–Inspect–eVOlve Trajectories), a self-supervised framework that formulates trajectory refinement as iterative optimization in a discrete, language-defined space. PIVOT defines a trajectory-level objective combining goal-achievement loss, plan–execution divergence, and execution cost. Since exact gradients are unavailable for language trajectories, PIVOT uses structured natural-language feedback as a surrogate textual gradient 23 , guiding local updates to the unsupported parts of the plan. A preference-based monotonic acceptance rule then keeps only refinements that improve the estimated trajectory loss, yielding a gradient-like optimization procedure over plans without requiring model fine-tuning. We evaluate PIVOT on two complementary benchmarks: DeepPlanning 26 , which stresses long-horizon constraint satisfaction in Travel and Shopping Planning, and GAIA 14 , which tests open-domain tool use and multi-step reasoning. PIVOT performs best on constraint-heavy planning tasks, where execution feedback exposes recoverable violations for trajectory-level repair. HITL feedback provides an upper-bound regime, while the autonomous variant remains competitive without external supervision. On GAIA, gains are more limited by retrieval quality, but PIVOT still improves task success in realistic tool-augmented settings. Across model families, PIVOT complements backbone scaling and remains token-efficient relative to competing refinement methods. PIVOT represents a meaningful scientific advance in closing the plan–execution gap for LLM agents. It proposes safer autonomous systems, democratized capabilities, computational efficiency, and interpretable failure attribution. However, these same capabilities introduce risks around reduced human oversight, dual-use potential, misplaced trust, and labor displacement that must be proactively addressed. The responsible path forward requires coupling PIVOT technical contributions with deployment guardrails, and ongoing evaluation in real-world settings beyond controlled benchmarks. 2 Related Work Trajectory analysis and failure diagnosis. A growing body of work studies the reliability gap between planned and executed agent behavior through trajectory analysis and failure diagnosis 2 ; 4 ; 9 ; 12 ; 24 ; 25 ; 27 . AgentDebug 27 models agent behavior as a modular pipeline and shows how errors propagate across components, while VeriLA 18 introduces human-centered criteria for identifying component-level failures. In multi-agent settings, MAST 2 and attribution benchmarks such as Who&When 25 and AgenTracer 24 highlight the difficulty of localizing failures in long trajectories. These diagnostic efforts motivate closed-loop correction, but do not formulate trajectory improvement as an optimization procedure. Planning robustness and execution-grounded correction. Complementary approaches improve planning robustness before or during execution. Constraint-based methods 9 ; 11 detect violations by checking plans against task requirements and applying localized corrections. Pre-execution refinement includes iterative self-critique 1 , explicit problem modeling 16 , and long-horizon lookahead mechanisms such as FLARE 10 . Hierarchical planning and execution frameworks 3 reduce non-executable plans by structuring decisions across abstraction levels. In multi-agent robotics, LLaMAR 15 introduces a plan-act-correct-verify architecture that decomposes high-level instructions into subtasks and uses a Corrector module to repair failed actions from real-time visual observations under partial observability, without oracle feedback. While LLaMAR demonstrates the value of execution-grounded correction, its repairs remain localized to individual action failures within a centralized multi-agent system and do not optimize the full plan–execution discrepancy. Iterative refinement and trajectory-level optimization. Most closely related are methods that iteratively refine model outputs using feedback. Self-Refine 13 and Reflexion 17 improve outputs or behaviors through self-generated feedback, while CRITIC 5 refines reasoning through tool-interactive self-critique. Recent self-critique methods 1 further show that structured refinement of intermediate reasoning and tool use can yield strong empirical gains, especially when domain expertise is incorporated; however, such approaches remain largely local, operating through step-wise corrections rather than modeling the full trajectory as an optimizable object. PromptAgent 21 similarly frames optimization as search over prompts and intermediate states, but does not directly optimize execution-grounded trajectory discrepancies. SE-Agent 7 moves closer to trajectory-level optimization by treating trajectories as genotypes whose phenotypic expression is problem-solving performance, using revision, recombination, and refinement to exploit cross-trajectory diversity and escape local optima on SWE-bench Verified. This shares PIVOT’s view of trajectories as optimizable objects, but derives its signal from cross-trajectory diversity and recombination rather than from how intended plans diverge