Diffusion Model as a Generalist Segmentation Learner
Haoxiao Wang ∗,†,1, Antao Xiang ∗,2, Haiyang Sun ∗,1, Peilin Sun 3, Changhao Pan 1, Yifu Chen 1, Minjie Hong 1, Weijie Wang 1, Shuang Chen 1, Yue Chen 4, Zhou Zhao ‡,1 · 2026
Read Diffusion Model as a Generalist Segmentation Learner by Haoxiao Wang ∗,†,1, Antao Xiang ∗,2, Haiyang Sun ∗,1, Peilin Sun 3, Changhao Pan 1, Yifu Chen 1, Minjie Hong 1, Weijie Wang 1, Shuang Chen 1, Yue Chen 4, Zhou Zhao ‡,1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24575.txt.
Description
Wang and colleagues turn a pretrained image-diffusion model into a general segmentation tool called DiGSeg. The method encodes the image and its mask together as conditioning for the diffusion network, while a text pathway aligned with CLIP injects language features at several scales. The result is a single system that produces masks from appearance plus arbitrary text prompts, with strong results on standard benchmarks and transfer to medical, remote-sensing and farming images.
Catalog record
| CREATOR | Haoxiao Wang ∗,†,1, Antao Xiang ∗,2, Haiyang Sun ∗,1, Peilin Sun 3, Changhao Pan 1, Yifu Chen 1, Minjie Hong 1, Weijie Wang 1, Shuang Chen 1, Yue Chen 4, Zhou Zhao ‡,1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50449 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24575