SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding

Qianqian Sun, Jixiang Luo, Dell Zhang, Xuelong Li · 2025

Read SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding by Qianqian Sun, Jixiang Luo, Dell Zhang, Xuelong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12704.txt.

Description

Qianqian Sun, Jixiang Luo, Dell Zhang, and Xuelong Li present SmartFreeEdit in a 2025 paper on image editing with text prompts. Most tools need a hand-drawn mask to mark the spot to change, and they often fail on busy scenes. The team built a system that takes plain words alone and still finds the right spot.

SmartFreeEdit pairs a large model that reads both text and images with a part that fills in the changed area. New region tokens and a mask step help the system grasp where things sit in a scene. Tests on the Reason-Edit set show gains in mask match, prompt fit, and image quality over past tools. The work points to edits that need less hand work from the user.

Catalog record

CREATORQianqian Sun, Jixiang Luo, Dell Zhang, Xuelong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-12704

Browse the full library · About the Tower of Babel