Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Video
Yifan Wang, Tong He · 2026
Read Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Video by Yifan Wang, Tong He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15182.txt.
Introduction
Yifan Wang and Tong He propose Warp-as-History, a training-free interface for camera-controlled video generation. Existing methods need large camera-annotated post-training or costly test-time optimization. Their interface turns camera-induced warps into warped pseudo-history. It aligns its positional encoding with the target frames and drops tokens lacking valid source observations. Fed through the model's visual-history pathway, it reveals zero-shot camera following in a frozen generator, and light LoRA tuning on a single annotated video improves it further.
Catalog record
| CREATOR | Yifan Wang, Tong He |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53566 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15182
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Video Yifan Wang, Tong He Abstract Camera-controlled video generation has made substantial progress, enabling generated videos to follow prescribed viewpoint trajectories. However, existing methods usually learn camera-specific conditioning through camera encoders, control branches, or attention and positional-encoding modifications, which often require post-training on large-scale camera-annotated videos. Training-free alternatives avoid such post-training, but often shift the cost to test-time optimization or extra denoising-time guidance. We propose Warp-as-History , a simple interface that turns camera-induced warps into camera-warped pseudo-history with target-frame positional alignment and visible-token selection. Given a target camera trajectory, we construct camera-warped pseudo-history from past observations and feed it through the model’s visual-history pathway. Crucially, we align its positional encoding with the target frames being denoised and remove warped-history tokens without valid source observations. Without any training, architectural modification, or test-time optimization, this modification reveals a non-trivial zero-shot capability of a frozen video generation model to follow camera trajectories. Moreover, lightweight offline LoRA finetuning on only one camera-annotated video further improves this capability and generalizes to unseen videos, improving camera adherence, visual quality, and motion dynamics without test-time optimization or target-video adaptation. Extensive experiments on diverse datasets confirm the effectiveness of our method. Figure 1: Warp-as-History generalizes to unseen scenes and unseen trajectories after finetuning on one video and one camera trajectory. Figure 2: From zero-shot history conditioning to one-training-video finetuning. Given the first image and a predefined camera trajectory, the four rows show ground truth, the camera-induced warp, zero-shot Warp-as-History, and one-training-video finetuning. The frozen model already turns the warp into visible camera-follow behavior through the pretrained history interface; one-training-video finetuning further stabilizes this behavior using a single separate training video, without test-time fitting to the shown video. 1 Introduction Camera motion is a primary control signal for interactive video generation. It determines not only the viewpoint, but also which regions become visible, how objects move relative to the observer, and whether a generated scene can be explored beyond its initial frame. This makes camera control in dynamic video more demanding than static novel-view synthesis: the model must enforce a prescribed camera trajectory while preserving appearance, disoccluding new content, and allowing foreground objects to move independently of the camera. Recent progress in camera-controlled and interactive video generation has largely been driven by dedicated camera-control mechanisms. Training-based methods inject camera information through camera encoders, control branches, attention or positional-encoding modifications, or related architectural changes, and typically require post-training on camera-annotated videos ( He et al. 2024 ; Li et al. 2025 ; Zhang et al. 2025 ; Ren et al. 2025 ; Yu et al. 2024 ; Huang et al. 2025a ) . Training-free methods avoid such post-training, but often enforce the desired trajectory at inference time through test-time optimization, denoising-time guidance, warp-and-repaint procedures, or other sampling-time constraints ( Hou and Chen 2024 ; You et al. 2024 ; Liu et al. 2024 ; Zhou et al. 2025 ; Song et al. 2025a ) . At the same time, recent video generation models already exhibit surprisingly rich camera-motion behavior, suggesting that camera control may be latent in video generation models. The challenge is therefore to expose and reliably steer this capability with minimal additional machinery, ideally without collecting large-scale camera-annotated videos, adding camera-specific modules, or imposing extra inference-time objectives. We approach this question from the perspective of history-conditioned video generation. Many video generation models already condition on visual history to continue a scene from previously observed frames. This history pathway is usually treated as temporal context, but it is also a learned interface for interpreting appearance continuity, motion evidence, and incomplete observations. We ask whether camera-induced geometric evidence can be presented through this existing interface. Specifically, can warped observations induced by a target camera trajectory be used as history evidence, rather than as a dedicated adapter, camera-aware attention or positional encoding, or inference-time guidance objective? Our answer is yes, when the geometric cue is expressed as history-conditioned evidence. We construct target-frame-aligned, visibility-aware warped observations: source-visible regions provide history evidence, while newly revealed regions are left to the pretrained generator for completion. Warping itself is not new; it appears in prior camera-control, view-synthesis, guidance, and repainting methods. Our distinction is where the warp enters generation: through the visual-history pathway, rather than as a sampling-time constraint or repainting signal. Given the first frame and a pre-defined camera trajectory, Figure 2 presents examples of: ground truth observation, the camera-induced warp, zero-shot Warp-as-History, and one-training-video finetuning. The warp captures the prescribed camera-induced motion but remains an imperfect geometric cue. When encoded through the pretrained history-conditioning pathway, this imperfect cue already elicits zero-shot camera-following capability from the frozen model, even in scenes with substantial foreground motion. Although this zero-shot effect is not robust enough to serve as a final method on its own, it reveals a useful latent capability: pretrained video generators can interpret camera-induced geometric evidence when provided as history-conditioned visual evidence. This observation motivates Warp-as-History , a low-resource camera-control framework rather than a new camera-conditioned video generation model. It keeps the control signal visual and geometry-aware, injecting it through the model’s native history-conditioning pathway rather than converting it into a hard rendering target or an inference-time guidance objective. We further enhance this capability with lightweight offline LoRA finetuning on only one single camera-annotated video, improving camera adherence, visual quality, and motion dynamics without test-time optimization or target-video adaptation. Section 3 gives the exact construction. The same view also clarifies the role of finetuning. If zero-shot Warp-as-History already produces measurable camera-follow behavior, lightweight finetuning can be studied as behavior stabilization: it adjusts when the model follows visible warp evidence, when it ignores unreliable warp regions, and when it relies on its generative prior for dynamics and disocclusion. We use one-training-video finetuning as a diagnostic: when a single separate training video improves camera adherence on unrelated test videos, it supports the view that the proposed history interface exposes behavior partially supported by pretraining. In our experiments, one-training-video finetuning makes the zero-shot behavior visibly clearer, as shown in Figure 2 . This update is trained offline on a video separate from the test videos; it is not test-time fitting, per-video optimization, or adaptation to the test instance. Our contributions are: • We show that pretrained history-conditioned video models contain a weak camera-follow prior, and introduce Warp-as-History to expose it: target camera trajectories are converted into camera-warped pseudo-history with temporal alignment and visibility-aware evidence selection, allowing the frozen model to produce measurable zero-shot camera-following behavior through its native history pathway. • We demonstrate one-training-video activation: offline LoRA finetuning on a single separate video stabilizes the exposed behavior and generalizes to unseen videos, supporting the view that finetuning amplifies an existing prior rather than learning camera control from scratch. • Experiments on WorldScore, RE10K, and DAVIS show that Warp-as-History, after finetuning on only one separate video, is competitive with recent state-of-the-art camera-control baselines trained on orders of magnitude more data, with comparable camera adherence and strong visual-quality and consistency metrics. 2 Related Work Camera-controlled video generation. Camera-controlled video generation has largely followed two routes. Camera-matrix conditioning methods such as CameraCtrl ( He et al. 2024 ) , PRoPE ( Li et al. 2025 ) , and UCPE ( Zhang et