CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding
Ishani Mondal *, Yiwen Song, Mihir Parmar, Palash Goyal, Jordan Boyd-Graber, Tomas Pfister, Yale Song · 2026
Read CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding by Ishani Mondal *, Yiwen Song, Mihir Parmar, Palash Goyal, Jordan Boyd-Graber, Tomas Pfister, Yale Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13452.txt.
Introduction
Mondal and six colleagues introduce CANVAS, a multi-agent framework for visual storytelling that plans shot-to-shot consistency. Existing models make strong single frames but lose that consistency. CANVAS enforces it with character tracking, background anchors, and location-aware scenes. On three benchmarks it beats the best baseline by about 22 percent on background continuity, about 10 percent on character consistency, and about 8 percent on props consistency. In short, the system plans a whole story in advance, so faces, places, and props stay the same from shot to shot.
Catalog record
| CREATOR | Ishani Mondal *, Yiwen Song, Mihir Parmar, Palash Goyal, Jordan Boyd-Graber, Tomas Pfister, Yale Song |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118494 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13452
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding Ishani Mondal *, Yiwen Song, Mihir Parmar, Palash Goyal, Jordan Boyd-Graber, Tomas Pfister, Yale Song Abstract Long-form visual storytelling requires maintaining continuity across shots, including consistent characters, stable environments, and smooth scene transitions. While existing generative models can produce strong individual frames, they fail to preserve such continuity, leading to appearance changes, inconsistent backgrounds, and abrupt scene shifts. We introduce CANVAS ( C ontinuity- A ware N arratives via V isual A gentic S toryboarding), a multi-agent framework that explicitly plans visual continuity in multi-shot narratives. CANVAS enforces coherence through character continuity, persistent background anchors, and location-aware scene planning for smooth transitions within the same setting We evaluate CANVAS on two storyboard generation benchmarks ST-BENCH and ViStoryBench and introduce a new challenging benchmark HardContinuityBench for long-range narrative consistency. CANVAS consistently outperforms the best-performing baseline, improving background continuity by 21.6%, character consistency by 9.6% and props consistency by 7.6%. argmax argmax Project Website: https://ishani-mondal.github.io/canvas-project-page/ \uselogo \reportnumber 0001 1 Introduction Figure 1: Visual storyboards generated by AutoStudio ( Cheng et al. 2025 ) , Gemini-3.1-pro, and CANVAS on a multi-shot museum heist story from our HardContinuityBench. Prior approaches exhibit character appearance drift, unstable scene geometry across consecutive shots, and logical inconsistencies such as artifact state changes, room layout drift across non-consecutive shots. In contrast, CANVAS preserves character identity, stable room layout, artifact state consistency, and object persistence across shots. We use similar colors in the shot descriptions highlighting that those should maintain identical appearance throughout the entire storyline. Long-form visual storytelling requires generating a sequence of images that together form a coherent narrative world ( Li et al. 2026 ; Natangelo 2025 ) . Unlike single-image generation, storyboard generation must preserve long-range consistency across multiple shots: characters should retain stable visual identities, environments should remain consistent when locations reappear, and objects should evolve logically as narrative events unfold. A natural way to enforce such coherence is through world-state modeling for visual generation ( Xiao et al. ; Ha and Schmidhuber 2018 ) . In this formulation, the generation process maintains an explicit representation of the narrative world—including characters, environments, and object states—that evolves over time. Image generation at each step is conditioned on this evolving narrative representation, enabling the system to maintain long-range visual consistency while faithfully reflecting narrative state changes. Most existing approaches generate story frames sequentially , conditioning each new image on previously generated frames or reference images ( Dinkevich et al. 2025 ; Mao et al. 2026 ; Cheng et al. 2024 ; Cheng et al. 2025 ; Zhou et al. 2024 ) . Auto-regressive methods generate frames one-by-one from earlier frames, while reference-based approaches maintain subject identity through latent anchor or diffusion-based techniques using a small set of reference images (Table 1 ). More recent iterative methods (e.g., Story-Iter ( Mao et al. 2026 ) ) refine frames by repeatedly conditioning on previously generated story frames to improve global visual similarity. However, these methods primarily enforce short-range consistency and do not explicitly model the evolving narrative world. As a result, inconsistencies accumulate over time, leading to common failure modes such as character appearance drift, unstable environments when locations reappear, and incorrect object states after narrative events (Figure 1 ). These issues arise because story world itself is never explicitly represented. In coherent narratives, characters maintain identity unless the plot changes their appearance, environments preserve spatial structure when revisited, and objects follow causal state transitions (e.g., present \rightarrow stolen \rightarrow absent). We formulate storyboard generation as explicit world-state modeling , maintaining structured representations of characters, locations, and object states as the narrative evolves. We introduce CANVAS , a multi-agent framework that enforces continuity through world-state transitions via iterative planning, generation, and memory updates (Section 3 ). The system first constructs a global continuity plan, then generates each shot by retrieving visual anchors from memory or initializing new ones when needed (e.g., rendering a fireplace in the first Santa Claus scene in Fig 9 (a) enables smooth transitions to later shot (b), whereas without this, the background must change abruptly to accommodate future events, as seen from (c) to (d)). Memory is updated after every generation of each frame, ensuring consistency across long-range narrative dependencies. Another challenge in studying narrative consistency is evaluation. Existing storyboard benchmarks ( Zhuang et al. 2025 ; Zhang et al. 2025a ) rarely require long-range reasoning: recurring locations are uncommon, character appearance changes are limited, and object state transitions seldom influence future scenes. Hence, they barely capture subtle forms of narrative drift that occur in longer sequences. To address this limitation, we introduce HardContinuityBench (Section 4 ), a benchmark specifically designed to stress-test long-range narrative continuity (Details in Appendix A.1 ). We evaluate CANVAS against several state-of-the-art story visualization baselines on multiple storyboard generation benchmarks like ViStoryBench ( Zhuang et al. 2025 ) , ST-Bench ( Zhang et al. 2025a ) and our new benchmark HardContinuityBench . We propose ContinuityEval , a VLM-based fine-grained metric on assessing character, background and props continuity. CANVAS consistently outperforms the best-performing baseline on ContinuityEval, improving background continuity by 21.6%, character consistency by 9.6% and props consistency by 7.6% (Section 5 ). Besides, CANVAS outperforms all the existing training-free storyboard generation methods on standard ViStoryBench metrics (Table 3 ) and video generation performances on standard FilmEval metrics ( Huang et al. 2025 ) (Table 17 ). Our contributions are threefold: 1. We introduce CANVAS , a training-free multi-agent framework that models storyboard generation as explicit world-state tracking through global planning, memory-guided retrieval, and sequential memory updates. 2. We propose HardContinuityBench , a benchmark designed to stress-test long-range narrative consistency, capturing subtle drift in character identity, environment structure, and object state transitions. 3. Extensive experiments show that CANVAS significantly improves character, background, and prop consistency across multiple storyboard benchmarks. Method Char BG Future Multi- Training Consist Consist Cond Agent Free StoryGen ( Zhang et al. 2025b ) ✓ ✗ ✗ ✗ ✗ StoryDiffusion ( Zhou et al. 2024 ) ✓ ✗ ✗ ✗ ✗ Story2Board ( Dinkevich et al. 2025 ) ✓ ✗ ✗ ✗ ✓ Story-Iter ( Mao et al. 2026 ) ✓ Partial ✗ ✗ ✓ AutoStudio ( Cheng et al. 2025 ) ✓ ✗ ✗ ✓ ✓ CANVAS ✓ ✓ ✓ ✓ ✓ Table 1: Comparison of existing Story Visualization methods. Most prior methods focus on preserving character consistency across frames using reference images or attention mechanisms. However, these methods do not explicitly maintain recurring location representations or future-conditioned scene planning. Our multi-agent training-free approach tackles these challenges. 2 Related Work Figure 2: Overview of CANVAS Pipeline. The framework generates a sequence of visually coherent cinematic keyframes from a story script through global planning, sequential generation, and persistent visual memory. 2.1 Visual Story Generation from Text Early work on visual storytelling focused on generating sequences of images from textual narratives using generative models. One representative approach is StoryGen ( Liu et al. 2024 ) , which introduces an autoregressive diffusion-based framework for open-ended visual storytelling. The model generates each frame conditioned on the text description and preceding image-caption pairs using a vision–language context module integrated into Stable Diffusion. During generation, features extracted from earlier frames are injected into the diffusion denoising