MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance
Xuehai Bai, Xiaoling Gu, Akide Liu, Hangjie Yuan, YiFan Zhang, Jack Ma · 2026
Read MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance by Xuehai Bai, Xiaoling Gu, Akide Liu, Hangjie Yuan, YiFan Zhang, Jack Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07993.txt.
Description
Instruction-based image editing handles simple commands well but falters on complex, compositional instructions and often damages the background. Xuehai Bai and five co-authors propose MCIE-E1, a multimodal language-model-driven editor with two attention modules: one aligns instructions to spatial regions during denoising, the other preserves features in unedited areas.
A dedicated data pipeline supports training, and new evaluation protocols target the failures of earlier methods. The design tackles the two central weaknesses head-on, instruction compliance and background consistency, rather than scaling up a single mechanism. Image-editing researchers and product teams gain a system aimed at the messy, multi-part edits real users actually request.
Catalog record
| CREATOR | Xuehai Bai, Xiaoling Gu, Akide Liu, Hangjie Yuan, YiFan Zhang, Jack Ma |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07993