OmniGen2: Exploration to Advanced Multimodal Generation
Chenyuan Wu, Pengfei Zheng, Ruiran Yan, Shitao Xiao, Xin Luo, Yueze Wang, Wanli Li, Xiyan Jiang, Yexin LiuJunjie Zhou , Ziyi Xia , Ze Liu , Chaofan Li , Haoge Deng , Jiahao Wang , Kun Luo, Bo Zhang, Defu Lian, Xinlong Wang, Zhongyuan Wang, Tiejun Huang, Zheng Liu Beijing Academy of Artificial Intell · 2025
Read OmniGen2: Exploration to Advanced Multimodal Generation by Chenyuan Wu, Pengfei Zheng, Ruiran Yan, Shitao Xiao, Xin Luo, Yueze Wang, Wanli Li, Xiyan Jiang, Yexin LiuJunjie Zhou , Ziyi Xia , Ze Liu , Chaofan Li , Haoge Deng , Jiahao Wang , Kun Luo, Bo Zhang, Defu Lian, Xinlong Wang, Zhongyuan Wang, Tiejun Huang, Zheng Liu Beijing Academy of Artificial Intell (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-18871.txt.
Introduction
Chenyuan Wu and a large team introduce OmniGen2, an open model that creates and edits images from instructions, in a 2025 paper. The head of the text states the title as a move toward instruction-aligned multimodal generation. The model unifies text-to-image creation, image editing, and generation that uses example images for context. Unlike its predecessor, it uses separate decoding paths for text and images, with unshared settings and its own image tokenizer.
That split lets the model build on existing image-understanding systems without retraining their inputs, keeping their text skills intact. The team also built data pipelines for editing and in-context examples, which are scarce training resources. OmniGen2 aims to serve as a flexible base for many creative and practical image tasks.
Catalog record
| CREATOR | Chenyuan Wu, Pengfei Zheng, Ruiran Yan, Shitao Xiao, Xin Luo, Yueze Wang, Wanli Li, Xiyan Jiang, Yexin LiuJunjie Zhou , Ziyi Xia , Ze Liu , Chaofan Li , Haoge Deng , Jiahao Wang , Kun Luo, Bo Zhang, Defu Lian, Xinlong Wang, Zhongyuan Wang, Tiejun Huang, Zheng Liu Beijing Academy of Artificial Intell |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-18871
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OmniGen2: Exploration to Advanced Multimodal Generation Chenyuan Wu, Pengfei Zheng, Ruiran Yan, Shitao Xiao, Xin Luo, Yueze Wang, Wanli Li, Xiyan Jiang, Yexin LiuJunjie Zhou , Ziyi Xia , Ze Liu , Chaofan Li , Haoge Deng , Jiahao Wang , Kun Luo, Bo Zhang, Defu Lian, Xinlong Wang, Zhongyuan Wang, Tiejun Huang, Zheng Liu Beijing Academy of Artificial Intelligence{stxiao, yzwang}@[email protected] Abstract In this work, we introduce OmniGen2, a versatile and open-source generative model designed to provide a unified solution for diverse generation tasks, including text-to-image, image editing, and in-context generation. Unlike OmniGen, OmniGen2 features two distinct decoding pathways for text and image modalities, utilizing unshared parameters and a decoupled image tokenizer. This design enables OmniGen2 to build upon existing multimodal understanding models without the need to re-adapt VAE inputs, thereby preserving the original text generation capabilities. To facilitate the training of OmniGen2, we developed comprehensive data construction pipelines, encompassing image editing and in-context generation data. Additionally, we introduce a reflection mechanism tailored for image generation tasks and curate a dedicated reflection dataset based on OmniGen2. Despite its relatively modest parameter size, OmniGen2 achieves competitive results on multiple task benchmarks, including text-to-image and image editing. To further evaluate in-context generation, also referred to as subject-driven tasks, we introduce a new benchmark named OmniContext. OmniGen2 achieves state-of-the-art performance among open-source models in terms of consistency. We will release our models, training code, datasets, and data construction pipeline to support future research in this field. Project Page: https://vectorspacelab.github.io/OmniGen2 ; GitHub Link: https://github.com/VectorSpaceLab/OmniGen2 1 Introduction Figure 1: Overview of versatile abilities in OmniGen2 and reflection model Unified image generation has attracted significant attention in recent years [ 80 ; 92 ; 73 ; 48 ] . For instance, OmniGen [ 80 ] employs a streamlined Transformer architecture capable of addressing diverse image generation tasks without the need for additional plugins or preprocessors. The recent breakthroughs of models like Gemini-2.0-flash [ 22 ] and GPT-4o [ 53 ] have further demonstrated the vast potential of this field, and heralded a new paradigm in multimodal intelligence, shifting the frontier from specialized models [ 3 ; 33 ] towards powerful, unified systems. Chameleon [ 72 ] and Emu3 [ 76 ] utilize discrete autoregressive methods across all modalities, while the Janus series [ 78 ; 11 ] introduces dual image encoders specifically designed for understanding and generation tasks. Transfusion integrates both autoregressive and diffusion processes within a single Transformer framework. However, the range of image generation tasks supported by these models remains limited. In this work, we introduce OmniGen2, an open-source generative model that demonstrates competitive performance across a wide range of generation tasks. Unlike its predecessor, OmniGen [ 80 ] , our observations indicate that simple parameter sharing is insufficient for simultaneously handling autoregressive text modeling and diffusion-based image modeling. To address this, OmniGen2 adopts distinct architectural pathways for autoregressive and diffusion tasks. Although models like GPT-4o [ 53 ] exhibit strong prompt-following abilities, they often lack the consistency required for precise image editing and maintaining subject identity in in-context generation. We speculate that this observed lack of consistency is a characteristic limitation of models that rely exclusively on high-level semantic encoders, which often struggle to capture fine-grained visual details necessary for such tasks. To address this gap, OmniGen2 enhances its predecessor’s core strategy of using VAE features for low-level visual information. Recent models such as Mogao [ 40 ] and BAGEL [ 13 ] , which also employ unshared parameters for text and image modalities and utilize dual vision tokenizers (VAE [ 31 ] and ViT [ 15 ] ) for image processing. In contrast. OmniGen2 feeds VAE-derived features exclusively into the diffusion model, rather than the multimodal large language model (MLLM). This design choice preserves the inherent multimodal understanding capabilities of the MLLM by avoiding the influence of VAE encodings, while also reducing redundant image representations. As a result, OmniGen2 maintains the simplicity and strong text generation capabilities of the original MLLM. Beyond the model, we also explore to tackle the foundational data and evaluation challenges that impede progress in this domain. We started by collecting and reorganizing relevant open-source datasets. However, most of them are plagued by inherent quality limitations, especially in tasks such as image editing and in-context generation. This limitation has substantially contributed to the significant performance gap between open-source and commercial models. To address this issue, we developed a comprehensive pipeline for generating image editing and in-context data from video sources, and we plan to release these datasets to the community. Additionally, we constructed reflective data for image generation through an iterative generative process, with the aim of incorporating the reasoning and reflection capabilities of LLMs into multimodal generation. Our extensive evaluation of OmniGen2 reveals its competitive performance across various task domains, including text-to-image (T2I) generation, image editing, and in-context generation. Notably, for the in-context generation task, there is currently a lack of well-established public leaderboards to systematically assess and compare the key capabilities of different models. Existing resources, such as DreamBench [ 64 ] , are insufficient to capture the complexity and requirements of real-world scenarios. To mitigate this limitation, we introduce the OmniContext benchmark, which includes eight task categories specifically designed to evaluate consistency with respect to individuals, objects, and scenes. Experimental results show that OmniGen2 achieves state-of-the-art consistency performance among open-source models. Our primary contributions can be summarized as follows: • We open-source OmniGen2, a powerful multimodal generative model that demonstrates exceptional performance in various image generation tasks. In addition to its robust image synthesis capabilities, OmniGen2 also maintains strong text generation capability. Building on this foundation, we further explore the application of multimodal reflection mechanisms in image generation. • Novel data generation pipelines and a suite of high-quality datasets derived from videos, specifically designed to address the data scarcity for advanced image editing and in-context learning tasks. • The OmniContext Benchmark, a comprehensive evaluation suite designed to rigorously assess and standardize the measurement of in-context visual generation capabilities across diverse scenarios. Furthermore, it is important to emphasize that the text generation capability in OmniGen2 primarily originates from the MLLM component within its decoupled architecture, rather than from explicit end-to-end training of the MLLM in the OmniGen2 base model—apart from the incorporation of a special token. End-to-end, full-parameter training is only performed in the reflection model. Therefore, OmniGen2 should be regarded as a multimodal generative model that supports simultaneous output of both images and text, rather than a native multimodal model. 2 Model Figure 2: Architecture of OmniGen2. OmniGen2 employs separate transformer architectures for autoregressive and diffusion. Two distinct image encoders are utilized: ViT encodes images for input into the text transformer, while VAE encodes images for the diffusion transformer. 2.1 Design Princeple In the original OmniGen [ 80 ] framework, we employed autoregressive modeling for text and a diffusion-based approach for image generation, both implemented within a transformer architecture initialized with phi-3 [ 1 ] . Following the release of OmniGen, we conducted a series of further experiments. Firstly, we replaced phi-3 with the more powerful Qwen model. Surprisingly, despite leveraging a stronger large language model (LLM), we observed a decline in image generation quality. Secondly, we explored a mixture-of-experts (MoE) strategy to independently route