MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance

Xuehai Bai, Xiaoling Gu, Akide Liu, Hangjie Yuan, YiFan Zhang, Jack Ma · 2026

Read MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance by Xuehai Bai, Xiaoling Gu, Akide Liu, Hangjie Yuan, YiFan Zhang, Jack Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07993.txt.

Description

Instruction-based image editing handles simple commands well but falters on complex, compositional instructions and often damages the background. Xuehai Bai and five co-authors propose MCIE-E1, a multimodal language-model-driven editor with two attention modules: one aligns instructions to spatial regions during denoising, the other preserves features in unedited areas.

A dedicated data pipeline supports training, and new evaluation protocols target the failures of earlier methods. The design tackles the two central weaknesses head-on, instruction compliance and background consistency, rather than scaling up a single mechanism. Image-editing researchers and product teams gain a system aimed at the messy, multi-part edits real users actually request.

Catalog record

CREATORXuehai Bai, Xiaoling Gu, Akide Liu, Hangjie Yuan, YiFan Zhang, Jack Ma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07993

Browse the full library · About the Tower of Babel