gen2seg : Gen erative Models Enable Gen eralizable Instance Seg mentation

Om Khangaonkar Hamed Pirsiavash · 2025

Read gen2seg : Gen erative Models Enable Gen eralizable Instance Seg mentation by Om Khangaonkar Hamed Pirsiavash (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15263.txt.

Description

Om Khangaonkar and Hamed Pirsiavash show that image-making AI can also split a scene into single objects. Their paper from twenty twenty-five starts from a known fact: models trained to build images learn where objects end and scenes begin. They fine-tune two such models, Stable Diffusion and MAE, for this splitting task, called instance segmentation.

Training used only a narrow set of object types, such as home goods and cars. Even so, the tuned models split new kinds of objects they had never been shown. Their best scores came close to a strong supervised tool called SAM. They even beat it on fine parts and unclear edges. The authors say image-making training builds a sense of grouping that carries across kinds of scenes.

Catalog record

CREATOROm Khangaonkar Hamed Pirsiavash
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15263

Browse the full library · About the Tower of Babel