Trace : Object Motion Editing in Videos with First-Frame Trajectory Guidance
Quynh Phung, Long Mai, Cusuh Ham, Feng Liu, Jia-Bin Huang, Aniruddha Mahapatra · 2026
Read Trace : Object Motion Editing in Videos with First-Frame Trajectory Guidance by Quynh Phung, Long Mai, Cusuh Ham, Feng Liu, Jia-Bin Huang, Aniruddha Mahapatra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25707.txt.
Introduction
Phung and co-authors present Trace, a tool for editing object motion in videos. A user draws the wanted path in a single anchor frame. The system then rebuilds the video with the object on that path. A first module turns the drawn path into frame-by-frame boxes, even when the camera moves. A second module resynthesizes the video along those boxes. The rest of the scene stays intact. On varied real-world videos, the authors report more coherent and realistic edits than recent rival methods.
Catalog record
| CREATOR | Quynh Phung, Long Mai, Cusuh Ham, Feng Liu, Jia-Bin Huang, Aniruddha Mahapatra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32503 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25707
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Trace : Object Motion Editing in Videos with First-Frame Trajectory Guidance Quynh Phung, Long Mai, Cusuh Ham, Feng Liu, Jia-Bin Huang, Aniruddha Mahapatra Abstract We study object motion path editing in videos, where the goal is to alter a target object’s trajectory while preserving the original scene content. Unlike prior video editing methods that primarily manipulate appearance or rely on point-track-based trajectory control, which is often challenging for users to provide during inference, especially in videos with camera motion, we offer a practical, easy-to-use approach to controllable object-centric motion editing. We present Trace , a framework that enables users to design the desired trajectory in a single anchor frame and then synthesizes a temporally consistent edited video. Our approach addresses this task with a two-stage pipeline: a cross-view motion transformation module that maps first-frame path design to frame-aligned box trajectories under camera motion, and a motion-conditioned video re-synthesis module that follows these trajectories to regenerate the object while preserving the remaining content of the input video. Experiments on diverse real-world videos show that our method produces more coherent, realistic, and controllable motion edits than recent image-to-video and video-to-video methods. Figure 1 : Trace enables intuitive object-centric motion editing in videos. Left: Given an input video (e.g., a girl flying a kite), the user specifies a desired 2D trajectory in the first-frame view using sparse bounding boxes. Two editing examples (Path Edit I and II) are shown. The solid yellow box denotes the initial bounding box, the dashed yellow box denotes the final bounding box, and the yellow curve represents the user-defined motion path. Our method re-synthesizes the video such that the object follows the new trajectory while preserving the remaining scene content. Right: Additional examples demonstrate robust motion editing under diverse camera movements, where Trace transforms the first-frame path design into temporally consistent object motion in the generated videos. Please find associated videos in Supplementary Material. $\ast$ $\ast$ footnotetext: Work was done while interns at Adobe 1 Introduction Generative video modeling has facilitated rapid advances in video content creation makevideo ; videocrafter1 ; videocrafter2 ; moviegen ; lvdm ; wan2025 ; ge2023preserve ; cogvideox . Modern video editing systems excel at transforming video’s appearance ( e.g . , style transfers wang2023zero ; yang2023rerender ; chung2024style ; bai2025uniedit or local edits videopainter ; truong2024local ; gu2024via ). However, many professional workflows require the adjustment of temporal dynamics. For instance, a creative director editing a dynamic scene of a child running with a kite may be satisfied with the child’s motion but want to alter the kite’s motion, changing its speed or direction to fit different creative intents (Fig. 1 ). Existing tools largely lack the ability to manipulate this object-specific motion and timing while preserving the rest of the video content. We present Trace , a framework for flexible editing of object motion in videos. The goal is to control the motion of a selected object to follow the user-specified path while meticulously preserving all other content in the input video. We note that this problem setup requires synthesizing novel motion of the selected object rather than copying the motion from the original videos or re-rendering the original motion from different angles since the synthesized motion characteristics ( e.g . , action type, pacing) needs to conform to the user’s specified motion path. Existing techniques for object re-synthesis in videos typically require dense, frame-level spatiotemporal control signals, such as mask sequences or per-frame bounding boxes vace ; hunyuancus ; gencompositor . Consequently, users must consciously translate their desired scene-aware motion path into local per-frame placements. This is a tedious process that becomes especially difficult for videos with dynamic camera motion. Inspired by the success of previous video appearance editing works that highlight the user-friendliness of applying edits to an anchor frame and automatically propagating them temporally genprop ; schneider2025neural , we introduce a novel problem setting: Video Editing with First-Frame Object Motion Design . Our key idea is to allow users to define a target motion path directly on the first frame, specifying how the object would move if the camera remained fixed at that viewpoint. This enables the use of the first frame as a scene proxy, providing an intuitive mapping between the on-screen 2D trajectory and the actual scene-space motion. Guided by this first-frame design, our proposed framework, Trace , re-synthesizes the video to move the object along the new path while preserving the original video content. This anchor-frame path design introduces a critical technical challenge: cross-view spatial misalignment. The user-provided motion path on the first frame naturally differs from the object’s actual screen-space position in subsequent frames due to camera dynamics, whereas modern video synthesis models typically require spatially aligned frame-level guidance. To address this, Trace utilizes a two-stage pipeline. First, a learnable cross-view motion transformation module predicts the corresponding per-frame bounding box sequence in the original video’s dynamic view. Second, a conditional video re-synthesis model uses this predicted sequence to effectively erase the original motion and regenerate the object along the new path, preserving the background and other scene elements. By enabling users to re-synthesize input videos with intuitive control over a selected object’s new motion path, Trace offers new possibilities for creative applications, such as post-production motion re-planning and video object insertion with motion control. We validate Trace ’s effectiveness on real-world videos with diverse content and motion-editing scenarios, demonstrating high-quality resynthesis and flexible user controls. Our experiments show that Trace can facilitate flexible manipulation of object motion that was not possible with conventional video editing models. In summary, our work makes the following contributions: 1. We propose the problem of video editing with first-frame motion design. This novel setting enables users to re-synthesize input videos with intuitive control of a new motion path for selected objects. 2. We present Trace , the dedicated approach to the proposed motion editing problem. We develop a two-stage framework that first transforms the user-motion design specified in the first-frame view into the corresponding per-frame object placements, providing suitable control signals for the second-stage video-diffusion-based synthesis model. 3. We evaluate our framework on a wide range of real-world videos, demonstrating its effectiveness in producing high-quality editing results and providing flexible user controls. 2 Related Work Figure 2 : Trace Overview. Our system consists of two modules. First, the Cross-View Motion Transformation Module converts a user’s 2D input path drawn on the first-frame into a scene- and camera-aware bounding-box trajectory in the video view. Second, the Video Re-Synthesis Module uses this transformed box sequence to guide the generation of a new video where the object follows the desired path while inpainting the original path of the object and preserving the other parts of the input video. Both models in the figure are diffusion models. Object motion control for video synthesis. Motion-controllable video generation has recently gained significant traction, especially in image-to-video (I2V) synthesis. This line of work animates a single image using control signals, ranging from text descriptions lvdm ; xing2023dynamicrafter ; videocrafter1 ; videocrafter2 ; moviegen ; wiles2020synsin ; xing2025motioncanvas to explicit point tracks trajectoryattn ; levitor ; mou2024revideo ; qiu2024freetraj ; wang2024motionctrl , or bounding boxes li2023trackdiffusion ; huang2025fine ; wang2024boximator . While powerful for generating new content, these