From Pixels to Concepts: Do Segmentation Models Understand What They Segment?
Shuang Liang 1,3,† , Zeqing Wang 2,† , Yuxian Li 1,† , Xihui Liu 1 , Han Wang 1,3∗ · 2026
Read From Pixels to Concepts: Do Segmentation Models Understand What They Segment? by Shuang Liang 1,3,† , Zeqing Wang 2,† , Yuxian Li 1,† , Xihui Liu 1 , Han Wang 1,3∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09591.txt.
Introduction
Liang and four colleagues ask whether promptable segmentation models truly grasp the concepts they are asked to find. Models like Segment Anything 3 turn text prompts into masks, moving past fixed categories toward concept guided localization. Existing tests mostly score mask accuracy or object presence. They leave open whether a model grounds the queried concept or merely follows eye catching but misleading visual cues.
Their CAFE benchmark holds the target region and true mask fixed while changing surface looks, context, or material to plant false cues. It offers 2,146 paired samples across three trap types: superficial mimicry, context conflict, and ontological conflict. Models often draw accurate masks even for misleading prompts. Strong mask skill, the authors conclude, does not prove faithful concept grounding, and CAFE gives a controlled way to tell the difference.
Catalog record
| CREATOR | Shuang Liang 1,3,† , Zeqing Wang 2,† , Yuxian Li 1,† , Xihui Liu 1 , Han Wang 1,3∗ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09591
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Pixels to Concepts: Do Segmentation Models Understand What They Segment? Shuang Liang 1,3,† , Zeqing Wang 2,† , Yuxian Li 1,† , Xihui Liu 1 , Han Wang 1,3∗ Abstract Segmentation is a fundamental vision task underlying numerous downstream applications. Recent promptable segmentation models, such as Segment Anything Model 3 (SAM3), extend segmentation from category-agnostic mask prediction to concept-guided localization conditioned on high-level textual prompts. However, existing benchmarks primarily evaluate mask accuracy or object presence, leaving unclear whether these models faithfully ground the queried concept or instead rely on visually salient but semantically misleading cues. We introduce CAFE: C ounterfactual A ttribute F actuality E valuation, a novel benchmark for evaluating concept-faithful segmentation in promptable segmentation models. Our CAFE is built on attribute-level counterfactual manipulation: the target region and ground-truth mask are preserved, while attributes such as surface appearance, context, or material composition are modified to introduce misleading semantic cues. The benchmark contains 2,146 paired test samples, each consisting of a target image, a ground-truth mask, a positive prompt, and a misleading negative prompt. These samples cover three counterfactual categories: Superficial Mimicry ( SM ), Context Conflict ( CC ), and Ontological Conflict ( OC ). We evaluate various model types and sizes on our CAFE. Experiments reveal a systematic gap between localization quality and concept discrimination: models often generate accurate masks even for misleading prompts, suggesting that strong mask prediction does not necessarily imply faithful semantic grounding. Our CAFE provides a controlled benchmark for diagnosing whether promptable segmentation models perform concept-faithful grounding rather than shortcut-driven mask retrieval. Project Page: https://t-s-liang.github.io/CAFE Code: https://github.com/T-S-Liang/CAFE Dataset: https://huggingface.co/datasets/teemosliang/CAFE 1 Introduction Segmentation has long been a central problem in computer vision, evolving from category-level dense prediction in semantic segmentation [ 2 , 34 ] , to instance-aware mask prediction [ 8 , 3 , 23 ] , and more recently to open-vocabulary and promptable segmentation [ 5 , 37 , 26 , 35 ] . This progression relaxes closed-set categories and enables a prompt-guided region association. Early promptable segmentation models, such as SAM [ 13 ] and SAM2 [ 25 ] , focus on visual prompts, such as points, boxes and primarily address spatial grounding without explicit textual concept conditioning. In parallel, open-vocabulary segmentation and grounding-segmentation pipelines use language queries to localize semantic regions, often by coupling a grounding or detection model, such as Grounding DINO [ 20 ] , with a mask generator [ 26 ] . Recently, SAM3 [ 1 ] introduced promptable concept segmentation (PCS), an end-to-end formulation that directly produces masks from concept prompts, without relying on an explicit grounding or detection stage to generate intermediate boxes. Standard benchmarks such as COCO [ 18 ] , ADE20K [ 38 ] , and LVIS [ 6 ] primarily evaluate segmentation accuracy over predefined visual categories. Recent counterfactual benchmarks, such as HalluSegBench [ 17 ] further tests object-level counterfactual hallucination by pairing factual images with counterfactual images in which the referred object is absent. However, counterfactual segmentation is not limited to object-level presence or absence. Fine-grained conflicts can arise when the target region remains visible and localizable, but attributes that affect concept identity, such as surface appearance, surrounding context, or material composition, are deliberately modified. In this setting, a model may produce a geometrically accurate mask for a semantically invalid prompt. Existing benchmarks therefore provide limited diagnosis of whether promptable segmentation models distinguish concept-faithful grounding from shortcut-driven responses to misleading attribute cues. Figure 1 : Examples in our CAFE. Each sample contains a counterfactually edited target image, a ground-truth mask for the target region, a positive prompt that is semantically valid for the target, and a misleading negative prompt that is visually plausible but semantically invalid. The examples cover three attribute-level intervention types: Superficial Mimicry ( SM ), Ontological Conflict ( OC ), and Context Conflict ( CC ). To this end, we propose CAFE , the C ounterfactual A ttribute F actuality E valuation for promptable segmentation models. CAFE preserves the target region and its annotation mask while counterfactually manipulating attributes that affect concept identity, including surface appearance, surrounding context, and material composition. This design tests whether model responses remain consistent with human semantic judgments when the target region remains localizable but contains misleading attribute cues. We design three categories of attribute-level interventions: superficial mimicry , context conflict , and ontological conflict . Each intervention preserves the target region and its segmentation mask while modifying one attribute dimension that affects concept identity. Superficial mimicry modifies surface appearance to make the target visually resemble another category while preserving its underlying object identity. Context conflict modifies the surrounding context to introduce environmental evidence associated with another category while preserving the target object’s identity. Ontological conflict modifies material composition so that the target region changes its substance while preserving its global shape. These interventions create cases where the target remains localizable, but the misleading negative prompt is semantically invalid according to human judgment despite being supported by salient attribute cues. Fig. shows representative examples. These examples demonstrate that promptable segmentation models may produce confident masks for semantically invalid negative prompts when the edited target remains localizable and contains misleading attribute cues. In superficial mimicry , a suitcase is painted with giraffe-like patterns while its object identity remains a suitcase. The positive prompt is therefore “suitcase”, whereas the misleading negative prompt is “giraffe”, which is supported only by the edited surface appearance. In context conflict , a teddy bear is placed in a snowy scene while its object identity remains a teddy bear. The positive prompt remains “teddy bear”, whereas the misleading negative prompt is “polar bear”, which is supported by the edited surrounding context rather than the target object itself. In ontological conflict , an airplane-shaped target is re-rendered as cloud while preserving its global shape. The target region is therefore materially a cloud rather than an airplane. In this case, the positive prompt is “cloud”, whereas the misleading negative prompt is “real airplane”, which is supported only by the retained global shape rather than the material composition of the edited target. We collect source images and annotations from COCO [ 18 ] , LVIS [ 6 ] , and SA-Co/Gold [ 1 ] , and perform controlled attribute-level image editing using category-specific prompts. After multi-stage filtering and validation by three human annotators, CAFE contains 2,146 paired test samples. Each test sample consists of a target image, a ground-truth mask, a positive prompt that describes a semantically valid concept, and a misleading negative prompt that is visually plausible but semantically invalid for the target region. Our contributions are summarized as follows: i) We introduce CAFE , a benchmark for evaluating concept-faithful grounding in promptable segmentation models under controlled counterfactual attribute interventions. CAFE covers three categories of attribute-level semantic conflict, namely superficial mimicry , context conflict , and ontological conflict , which, respectively, manipulate surface appearance, surrounding context, and material composition while preserving the target region and its annotation mask. ii) We construct 2,146 paired test cases, each containing an edited target image, a ground-truth mask, a positive prompt, and a misleading negative prompt. All cases are validated by human annotators to ensure that the target region remains localizable and that the positive and