DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model

Shibo Hong 1,2,*, Boxian Ai 1,*, Jun Kuang 2, Wei Wang 2, FengJiao Chen 2, Zhongyuan Peng 1, Chenhao Huang 1, Yixin Cao 1, † \dagger · 2026

Read DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model by Shibo Hong 1,2,*, Boxian Ai 1,*, Jun Kuang 2, Wei Wang 2, FengJiao Chen 2, Zhongyuan Peng 1, Chenhao Huang 1, Yixin Cao 1, † \dagger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23622.txt.

Description

Shibo Hong and seven co-authors introduce DLEBench, the first benchmark for small-scale object editing by instruction-based image editing models. Current models follow instructions plausibly and reason strongly on benchmarks, yet editing small objects remains underexplored despite its importance for precise local edits and detail refinement.

The testbed holds 1889 samples across seven instruction types, with target objects covering only 1 to 10 percent of image area, including partial occlusion and multi-object editing. A refined evaluation protocol with score rubrics reduces subjectivity and ambiguity on two criteria: instruction following and visual consistency. A dual-mode framework, tool-driven and oracle-guided modes, addresses misalignment between LMM-as-a-Judge and human judgments. Tests on 10 models reveal significant performance gaps in small-scale object editing.

Catalog record

CREATORShibo Hong 1,2,*, Boxian Ai 1,*, Jun Kuang 2, Wei Wang 2, FengJiao Chen 2, Zhongyuan Peng 1, Chenhao Huang 1, Yixin Cao 1, † \dagger
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE143 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-23622

Browse the full library · About the Tower of Babel