MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing

Ziqian Liu, Stephan Alaniz · 2026

Read MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing by Ziqian Liu, Stephan Alaniz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05180.txt.

Introduction

Liu and Alaniz give MIRAGE, a tool for precise local editing when images contain multiple similar cases needing single edits. Models suffer over-editing and mix-ups with multiple same cases and mixed orders. MIRAGE parses orders into local subsets with a model, then uses joint cleaning, adding codes of target regions into the space while keeping background wholeness through a path. Tests on MIRA-Bench and RefEdit-Bench show it beats old methods on precise changes while keeping backgrounds steady.

Catalog record

CREATORZiqian Liu, Stephan Alaniz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63024
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.05180

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing Ziqian Liu, Stephan Alaniz Abstract Instruction-guided image editing has seen remarkable progress with models like FLUX.2 and Qwen-Image-Edit, yet they still struggle with complex scenarios with multiple similar instances each requiring individual edits. We observe that state-of-the-art models suffer from severe over-editing and spatial misalignment when faced with multiple identical instances and composite instructions. To this end, we introduce a comprehensive benchmark specifically designed to evaluate fine-grained consistency in multi-instance and multi-instruction settings. To address the failures of existing methods observed in our benchmark, we propose Multi-Instance Regional Alignment via Guided Editing (MIRAGE), a training-free framework that enables precise, localized editing. By leveraging a vision-language model to parse complex instructions into regional subsets, MIRAGE employs a multi-branch parallel denoising strategy. This approach injects latent representations of target regions into the global representation space while maintaining background integrity through a reference trajectory. Extensive evaluations on MIRA-Bench and RefEdit-Bench demonstrate that our framework significantly outperforms existing methods in achieving precise instance-level modifications while preserving background consistency. Our benchmark and code are available at https://github.com/ZiqianLiu666/MIRAGE . 1 Introduction The field of visual content creation has been revolutionized by the emergence of diffusion models [ 34 , 12 , 30 ] , which now achieve unprecedented fidelity in image synthesis. This success has paved the way for instruction-guided image editing [ 6 , 46 ] , where users can modify complex visual scenes using only natural language. While these models excel at global transformations and single object adjustments, current models still struggle with handling multi-instance scenarios where multiple similar objects require distinct, independent modifications. Figure 1 : Limitations of current state-of-the-art image editing models. Although these models successfully follow the editing instructions, noticeable limitations remain. (i) blue circles indicate failures in preserving local consistency within the target regions; (ii) green circles highlight unintended modifications in the background. In these complex settings, even state-of-the-art (SOTA) models like FLUX.2 [ 4 ] and Qwen-Image-Edit [ 42 ] exhibit spatial misalignment and over-editing. For example, as shown in Fig. 1 , when given the instruction “Change the material of the leftmost sculpture to marble” in a scene containing three sculptures, FLUX.2 changes the material of all sculptures in the image. Existing benchmarks lack the density and complexity required to diagnose these fine-grained errors. To better measure progress in such challenging settings, we introduce MIRA-Bench, a comprehensive benchmark specifically designed to evaluate fine-grained consistency in multi-instance and multi-instruction scenarios. While previous benchmarks like MagicBrush [ 46 ] or RefEdit-Bench [ 28 ] focus on single-object edits or referring expressions, MIRA-Bench is the first to systematically test models against images containing three to five similar instances with five simultaneous, compositional edit instructions. This benchmark provides the community with a rigorous diagnostic tool for assessing model performance in complex editing tasks. To address the challenge of accurately editing images with fine-grained instructions on the model side, we propose Multi-Instance Regional Alignment via Guided Editing (MIRAGE), a training-free framework designed for precise, localized image editing. Unlike prior approaches that require fine-tuning or rely on attention maps, MIRAGE leverages the inherent reasoning of Vision-Language Models (VLMs) [ 2 ] to decompose complex, global instructions into regional sub-tasks. By introducing a multi-branch parallel denoising strategy, MIRAGE enables the independent editing of specific instances while enforcing background integrity through a reference trajectory. This allows the model to perform high-fidelity edits on specific targets without disturbing the rest of the scene. As shown in Fig. 1 , MIRAGE resolves the over-editing issues of FLUX.2 and Qwen-Image-Edit resulting in more reliable editing results. In summary, our contributions are as follows: i) We introduce MIRA-Bench, a novel benchmark focused on multi-instance scenes and compositional instructions, filling an important gap in image editing evaluation; ii) We propose MIRAGE, a training-free, multi-branch inference framework that improves the precision of mainstream diffusion models without additional training or computational overhead; iii) Through extensive experiments, we demonstrate that integrating MIRAGE into SOTA models yields significant gains in prompt following and consistency on both MIRA-Bench and the existing RefEdit benchmark, effectively resolving persistent issues of over-editing and spatial misalignment. 2 Related Work Text-Guided Image Editing . As diffusion models have made significant progress in image generation [ 34 , 30 , 31 ] , they exhibit superior detail fidelity and local controllability compared to GAN-based [ 27 ] methods, and have increasingly become the dominant paradigm for image editing. E4C [ 14 ] and FlexiEdit [ 16 ] invert images into the latent space and incorporate attention constraints to improve structural consistency. However, such methods typically rely on correspondences between source and target texts, which introduces inconvenience in practical usage. Subsequently, InstructPix2Pix [ 6 ] performed conditional fine-tuning to enable Stable Diffusion to learn a mapping from (\mathrm{X_{src}},\mathrm{Instruction}) to \mathrm{X_{trg}} . Although this approach improves both performance and usability over prior methods, it is prone to over-editing [ 21 , 10 , 18 ] , motivating a large body of follow-up work that explores improvements from the perspectives of attention control [ 10 , 18 ] , spatial conditioning [ 35 ] , and inference strategies [ 15 , 21 ] . On the other hand, recent studies indicate that replacing the conventional U-Net architecture with Transformers leads to stronger generative performance [ 29 , 9 , 24 ] . Representative SOTA models, such as Qwen-Image-Edit [ 42 ] and FLUX [ 3 , 4 ] , achieve significant gains on multiple generation and editing benchmarks. However, in scenarios involving multiple similar instances and compositional instructions, we observe that SOTA models [ 4 , 42 ] , while broadly following the editing intent, frequently exhibit over-editing, fail to preserve fine-grained detail consistency in target regions, and introduce unintended changes to non-target background areas. With MIRAGE, we effectively mitigate these issues with a training-free method without computational overhead. Localization of Regions of Interest. Accurate localization of target regions is critical for consistency of detailed textures and for avoiding over-editing. Even for SOTA generative models [ 42 , 4 , 25 ] , reliably identifying the target object in complex scenes remains challenging. Among existing approaches, FOI [ 10 ] , LOV [ 26 ] , and LIME [ 36 ] extract spatial masks by analyzing attention maps or feature attributions, while DiffEdit [ 8 ] and WYS [ 21 ] infer editing regions based on differences between predicted noise signals. These methods rely on model-internal signals, whose generalization tends to degrade in complex settings such as multi-instance scenes or when handling semantically complex instructions. In contrast, GIP2P [ 35 ] , InstructEdit [ 39 ] , and OIR [ 44 ] leverage external models [ 33 , 32 ] to localize target regions, though their performance is sensitive to the fine-grained accuracy of the external masks. RIE [ 19 ] disentangles referring expressions from editing instructions via a self-attention mechanism and relies on an additional trained module to predict target masks for local edits. However, this design introduces additional training cost and computational overhead. Our work falls into the category of external priors, and we employ a vision–language model (VLM) [ 2 ] to parse instructions and ground target references, enabling more precise localization of regions of

Read the complete text