Generative Trajectory Stitching through Diffusion Composition
Yunhao Luo, Utkarsh A. Mishra, Yilun DuDanfei Xu · 2025
Read Generative Trajectory Stitching through Diffusion Composition by Yunhao Luo, Utkarsh A. Mishra, Yilun DuDanfei Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05153.txt.
Introduction
A robot planning a long task must chain short moves it already knows into a route it has never seen. Yunhao Luo and co-authors taught a generative model to do that stitching in 2025. Their system, CompDiffuser, cuts example trajectories into overlapping chunks and learns how the chunks condition each other through a single diffusion model that looks both ways along the path.
Because the chunks share information while a new route is generated, the joins stay physically consistent. On planning benchmarks of varied size, difficulty, and data quality, the method beat existing approaches by a clear margin. The authors present it as a way to solve new long-horizon tasks from pieces of old ones.
Catalog record
| CREATOR | Yunhao Luo, Utkarsh A. Mishra, Yilun DuDanfei Xu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-05153
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generative Trajectory Stitching through Diffusion Composition Yunhao Luo, Utkarsh A. Mishra, Yilun DuDanfei Xu Abstract Effective trajectory stitching for long-horizon planning is a significant challenge in robotic decision-making. While diffusion models have shown promise in planning, they are limited to solving tasks similar to those seen in their training data. We propose CompDiffuser, a novel generative approach that can solve new tasks by learning to compositionally stitch together shorter trajectory chunks from previously seen tasks. Our key insight is modeling the trajectory distribution by subdividing it into overlapping chunks and learning their conditional relationships through a single bidirectional diffusion model. This allows information to propagate between segments during generation, ensuring physically consistent connections. We conduct experiments on benchmark tasks of various difficulties, covering different environment sizes, agent state dimension, trajectory types, training data quality, and show that CompDiffuser significantly outperforms existing methods. Project website at https://comp-diffuser.github.io/ . 1 Introduction Generative models have demonstrated remarkable capabilities in modeling complex distributions across domains like images, videos, and 3D shapes. In robot planning, these models offer a promising approach by modeling distributions over plan sequences, which allows amortizing the computational cost of traditional search and optimization methods. This effectively transforms planning into sampling likely solutions given start and goal conditions. Recent works like Diffuser [ 26 ] and Decision Diffuser [ 1 ] have shown how diffusion models can learn to generate entire plans for long-horizon robotics tasks. However, exhaustively modeling joint distributions over entire plan sequences for all possible start and goal states remains extremely sample-inefficient, as it requires collecting long-horizon plan data covering all possible combinations of initial states and goals. The concept of trajectory stitching [ 88 ] from Reinforcement Learning literature [ 62 ] presents a potential solution by combining chunks of different trajectories to create new, potentially better policies. The methods work by identifying high-reward trajectory chunks and stitching them together at states where they overlap or are similar enough, creating composite trajectories that can inform better policy learning. This effectively enables compositional generalization since collecting long consecutive trajectories is costly, and these short chunks can be flexibly assembled to complete new tasks. The key challenge lies in finding appropriate stitching points where trajectories can be combined while maintaining dynamic consistency and feasibility. Our goal is to enable generative planners to solve long-horizon tasks without requiring long-horizon training data, while retaining their ability to generate physically feasible, goal-directed plans. We propose a novel diffusion-based approach, Compositional Diffuser (CompDiffuser), that enables effective trajectory stitching through goal-conditioned causal trajectory generation. Figure 1: Compositional Trajectory Generation . CompDiffuser enables generative trajectory stitching through diffusion composition. Left: Monolithic generative planner fails to generalize to tasks of longer horizon and collapses to the maze center. Right: Our method successfully navigates the ant agent from start to goal by compositionally stitching together shorter trajectories. Our key insight is that we can model the trajectory distribution compositionally by subdividing it into distributions of overlapping chunks and learning their conditional relationships. Rather than learning separate models for each chunk, we train a single diffusion model that can generate trajectory chunks conditioned on neighboring chunks’ states ( Figure 1 ). This allows information to propagate bidirectionally during the reverse diffusion process as illustrated in Figure 2 : each chunk’s generation is influenced by both past and future chunks. This architecture naturally enables both parallel generation of chunks and causal autoregressive generation, each with different trade-offs in computational cost and planning quality. We conduct extensive experiments across benchmark tasks of varying difficulty levels, including different environment sizes (from simple U-mazes to complex giant mazes), agent state dimensions (from 2D point agents to 50D humanoid robots), trajectory types (from maze navigation trajectories to ball dribbling trajectories), and training data quality (from clean demonstrations to noisy exploration data). Our results demonstrate that CompDiffuser significantly outperforms multiple imitation learning and offline reinforcement learning baselines across all settings. We show that our approach can effectively solve long-horizon tasks while maintaining plan feasibility and goal-reaching behavior. We validate the importance of our key technical components including the bidirectional conditioning mechanism, the autoregressive sampling process, and the flexible replanning capability. In summary, the key contributions of this work are: • A noisy-sample conditioned diffusion planning framework that enables learning compositional trajectory distributions by decomposing the trajectory generation procedure into a sequence of segments each generated by a separate diffusion denoising process. • A compositional goal-conditioned trajectory planning method that uses bidirectional information propagation during denoising to maintain physical consistency between trajectory chunks. • A set of empirical results showing significant improvements over existing methods across multiple trajectory stitching benchmarks, with detailed analysis of model capabilities and limitations. 2 Related Work Diffusion Models For Planning. Many works have studied the applications of diffusion models [ 58 , 24 ] for generative planning [ 26 , 1 , 54 , 72 , 22 , 64 , 42 , 86 , 7 ] . Diffusion planning has been widely applied in various fields, such as motion planning [ 5 , 43 ] , procedure planning [ 67 ] , task planning [ 76 , 16 ] , autonomous driving [ 75 , 37 , 68 ] , reasoning [ 79 ] , and reward learning [ 49 ] . Many techniques have also been combined with diffusion planning, including hierarchical planning [ 35 , 8 , 45 ] , self-evolving planner [ 36 ] , preference alignment [ 10 ] , tree branch-pruning [ 17 ] , refining [ 31 ] , replanning [ 84 ] , uncertainty-aware planning [ 60 ] , equivariance [ 4 ] . However, these works are usually constrained to plan within similar horizons as training data. Our work instead proposes a compositional diffusion planning approach that generalizes to much longer horizon via generative trajectory stitching. Trajectory Stitching. A flurry of works have explored the trajectory stitching problem given offline data. One typical category of solution is based on data augmentation or goal relabeling along with various techniques, such as generative models [ 33 , 41 , 28 , 30 , 34 , 40 ] , model-based approaches [ 6 , 32 , 85 , 23 ] , and clustering [ 21 ] . Other supervised learning based methods, such as sequence modeling [ 9 , 25 , 73 , 87 , 71 ] , latent space learning [ 80 , 66 , 83 ] , and learning with dynamic programming [ 18 , 27 , 74 ] , have also demonstrated some extent of stitching capability. In this work, we propose a different trajectory stitching approach based on generative modeling, where the model only learns from plain short trajectory segments while is able to directly perform goal-conditioned trajectory stitching through test-time compositional generation. Compositional Generative Models. Compositional Generative Models [ 13 , 11 , 19 , 12 , 46 , 3 , 50 , 63 ] are widely studied in various domains, including visual content generation [ 39 , 11 , 77 , 82 , 59 , 57 ] , human motion generation [ 56 , 61 , 81 ] , traffic generation [ 38 ] , robotic planning [ 78 , 2 , 43 ] , and policy learning [