iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation
Zhoujie Fu, Xianfang Zeng, Jinghong Lan, Xinyao Liao, Cheng Chen, Junyi Chen, Jiacheng Wei, Wei Cheng, Shiyu Liu, Yunuo Chen, Gang Yu Guosheng Lin, [4pt] Nanyang Technological University · 2025
Read iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation by Zhoujie Fu, Xianfang Zeng, Jinghong Lan, Xinyao Liao, Cheng Chen, Junyi Chen, Jiacheng Wei, Wei Cheng, Shiyu Liu, Yunuo Chen, Gang Yu Guosheng Lin, [4pt] Nanyang Technological University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-20635.txt.
Introduction
Fu, Zeng, Lan, and co-authors retrain a video model into an all-purpose image studio. Their 2025 paper presents iMontage for many-to-many image generation. Video models learn strong priors for smooth, coherent sequences. Image data carries far wilder variety than video frames. Merging both promises consistent yet dynamic picture sets.
The framework takes variable-length image sets as input and output. One model then covers generation plus many editing tasks. The adaptation is deliberately light and minimally invasive. Curated data plus a staged training recipe teach image skills. Original motion priors survive the retraining intact. Outputs keep strong consistency across images in a set. Scene dynamics exceed what single-image models usually manage. Best quality currently comes with up to four inputs. Long-context many-to-many cases remain unexplored so far. Code and weights are promised publicly.
Catalog record
| CREATOR | Zhoujie Fu, Xianfang Zeng, Jinghong Lan, Xinyao Liao, Cheng Chen, Junyi Chen, Jiacheng Wei, Wei Cheng, Shiyu Liu, Yunuo Chen, Gang Yu Guosheng Lin, [4pt] Nanyang Technological University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-20635
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation Zhoujie Fu, Xianfang Zeng, Jinghong Lan, Xinyao Liao, Cheng Chen, Junyi Chen, Jiacheng Wei, Wei Cheng, Shiyu Liu, Yunuo Chen, Gang Yu Guosheng Lin, [4pt] Nanyang Technological University Abstract † † ‡ Project Leader † Corresponding Author Pre-trained video models learn powerful priors for generating high-quality, temporally coherent content. While these models excel at temporal coherence, their dynamics are often constrained by the continuous nature of their training data. We hypothesize that by injecting the rich and unconstrained content diversity from image data into this coherent temporal framework, we can generate image sets that feature both natural transitions and a far more expansive dynamic range. To this end, we introduce iMontage, a unified framework designed to repurpose a powerful video model into an all-in-one image generator. The framework consumes and produces variable-length image sets, unifying a wide array of image generation and editing tasks. To achieve this, we propose an elegant and minimally invasive adaptation strategy, complemented by a tailored data curation process and training paradigm. This approach allows the model to acquire broad image manipulation capabilities without corrupting its invaluable original motion priors. iMontage excels across several mainstream many-in-many-out tasks, not only maintaining strong cross-image contextual consistency but also generating scenes with extraordinary dynamics that surpass conventional scopes. Our code and model weights will be made publicly available. Figure 1 : iMontage can flexibly deal with many input images, and can generate many output images with highly consistency. We use three different colors to represent three settings. The dotted-line box images are the input. 1 Introduction Large-scale diffusion-based generative models ( 44 ; 46 ; 39 ; 26 ; 16 ; 38 ) have sparked a revolution in creative and high-quality image generation, accelerating progress in downstream tasks such as image editing. A recent trend in the field is to unify diverse image tasks within a single framework ( 59 ; 35 ; 33 ; 40 ) , inspired by the success of Large Language Models (LLMs) and large vision language models (VLMs) ( 36 ; 12 ; 60 ; 14 ) . While most unified image models remain specialized for single-in-single-out image tasks, certain commercial model has taken an early lead in extending unified image generation to multi-input, multi-output settings ( 3 ) very recently. Accordingly, the many-to-many (multi-input, multi-output) setting warrants systematic exploration by the academic and open-source communities. The many-to-many paradigm splits into two approaches: (i) token-centric models that represent text and images as a unified multimodal token stream and autoregressively generate target tokens conditioned on the inputs ( 59 ) , thereby achieving many-to-many mappings; and (ii) video-centric pipelines that repurpose video diffusion generation as backbones, casting the task as discontinuous video generation and naturally accommodating variable numbers of input and output frames ( 10 ; 30 ) . While the first approach provides an appealing and promising modal-unified solution, it’s generation quality and instruction following capability is challenged by common sense compared to diffusion paradigm. In contrast, the second approach elegantly leverages pre-trained motion priors to markedly enhance temporal coherence and handle variable-length inputs and outputs. Specifically, ( 10 ) trained a model of video generation from scratch and constructed a large-scale dataset of captioned frame pairs for instruction-tuned editing, demonstrating strong consistency and faithful detail preservation with respect to the input images. Despite these advances for the diffusion-based paradigm, a critical question persists: How can a model generate highly dynamic multi-image outputs while maintaining temporal and semantic consistency? To our empirical knowledge, image-only models can produce highly diverse images based on the same inputs, yet they struggle with temporal consistency due to limited implicit understanding of world dynamics. Meanwhile, video-based models bring strong motion priors that improve temporal consistency; however, most foundation video models are trained predominantly on contiguous clips, which rarely contains hard cuts, abrupt transitions, or large camera/subject motions, and thereby transferring poorly to highly dynamic content and limiting task versatility. In response, we present iMontage , a unified generative model that produces multiple, highly dynamic images conditioned on instructions and arbitrary reference images. Following the video-based paradigm, iMontage builds on a large pretrained video model and treats both inputs and outputs as pseudo-frames. We introduce a novel rotary positional embedding (RoPE) strategy to prevent conceptual ambiguity between multiple image frames and video frames. Our strategy explicitly maintains the model’s pre-trained capability in modeling temporal coherence, while clearly differentiating the discrete nature of image sets from the continuous flow of video sequences. We further provide a data-curation pipeline, which is carefully categorized and filtered for motion diversity and instruction quality, supporting broad, highly dynamic scenario. Finally, we detail a training regimen that offers practical insights into multi-task unification. Together, these components marry video generation with many-to-many image generation, achieving both temporal and content consistency. We evaluate iMontage across three settings: one-to-one image editing, many-to-one image generation, and many-to-many image generation. For each setting, we present strong qualitative performances across all sub-tasks, showcasing robust instruction following, high-dynamic outputs, and consistent content generation, as presented in Fig. 1 . Furthermore, we provide state-of-the art quantitative metrics on image editing benchmark (one-to-one), in-context learning benchmark (many-to-one) and storyboard generation evaluation (many-to-many). In summary, our contributions are as follows: • We introduce iMontage , a unified model that handles variable numbers of input and output frames, bridging video generation and highly dynamic image generation. • We develop a task-agnostic, temporally diverse data curation pipeline paired with a multi-task training paradigm, ensuring learnability across heterogeneous tasks and temporal structures and enabling robust many-to-many generalization. • Our model showcases convincing results over huge number of variable experiments, including most mainstreaming image generation and editing tasks. Massive visualization results and comprehensive evaluation metrics provide SOTA results in open-source community and even comparable results with commercial models. Figure 2 : Overview of iMontage. The model accepts a flexible set of reference images and produces N outputs conditioned on a text prompt. Images are encoded by a 3D VAE separately, text by a language model, and both token streams are processed by an MMDiT. We concatenate clean reference-image tokens with noisy target tokens before denoising. Right: training uses fixed-length text tokens and variable-length image/noise tokens, transitions from dual stream to single stream blocks. For image branch, we apply Marginal RoPE , a head–tail temporal indexing that separates input and output pseudo-frames, preserves spatial RoPE, and supports many-to-many generation. In figure, notation H and W with subscription denote the height/width indices of the 2D RoPE computed at the image’s native resolution, while notation T represents assigned time index for temporal dimension. 2 Related work 2.1 Unified Generation and Editing Models Recent research has increasingly focused on consolidating diverse visual synthesis tasks into single, unified frameworks. Early efforts ( 58 ; 17 ; 28 ) like OmniGen ( 59 ) and ACE++ ( 35 ) pioneered monolithic architectures capable of handling generation, editing, and other vision tasks without requiring task-specific modules. This trend evolved with the integration of powerful multimodal large language models (MLLMs) as reasoning engines. Models such as Step1X-Edit ( 33 ) and Qwen-Image ( 14 ) leverage an MLLM to interpret complex user instructions, which then guide a diffusion decoder to