On the Reliability of Cue Conflict and Beyond

Pum Jun Kim, Seung-Ah Lee, Seongho Park, Dongyoon Han, Jaejun Yoo · 2026

Read On the Reliability of Cue Conflict and Beyond by Pum Jun Kim, Seung-Ah Lee, Seongho Park, Dongyoon Han, Jaejun Yoo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10834.txt.

Introduction

Pum Jun Kim and co-authors question how reliable the cue-conflict benchmark is for measuring shape-texture bias in neural networks. The benchmark probes whether models judge images by shape or texture, and shape bias has been linked to better performance. The team finds the stylization version can give unstable estimates: stylized cues may not be valid or separable, ratio scores hide absolute sensitivity, and preset classes distort predictions. Their REFINED-BIAS framework builds balanced, recognizable cue pairs and scores sensitivity over the full label space.

Catalog record

CREATORPum Jun Kim, Seung-Ah Lee, Seongho Park, Dongyoon Han, Jaejun Yoo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65391
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.10834

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Reliability of Cue Conflict and Beyond Pum Jun Kim, Seung-Ah Lee, Seongho Park, Dongyoon Han, Jaejun Yoo Abstract Understanding how neural networks rely on visual cues offers a human-interpretable view of their internal decision processes. The cue-conflict benchmark has been influential in probing shape-texture preference and in motivating the insight that stronger, human-like shape bias is often associated with improved in-domain performance. However, we find that the current stylization-based instantiation can yield unstable and ambiguous bias estimates. Specifically, stylization may not reliably instantiate perceptually valid and separable cues nor control their relative informativeness, ratio-based bias can obscure absolute cue sensitivity, and restricting evaluation to preselected classes can distort model predictions by ignoring the full decision space. Together, these factors can confound preference with cue validity, cue balance, and recognizability artifacts. We introduce REFINED-BIAS , an integrated dataset and evaluation framework for reliable and interpretable shape–texture bias diagnosis. REFINED-BIAS constructs balanced, human- and model- recognizable cue pairs using explicit definitions of shape and texture, and measures cue-specific sensitivity over the full label space via a ranking-based metric, enabling fairer cross-model comparisons. Across diverse training regimes and architectures, REFINED-BIAS enables fairer cross-model comparison, more faithful diagnosis of shape and texture biases, and clearer empirical conclusions, resolving inconsistencies that prior cue-conflict evaluations could not reliably disambiguate. Our code is publicly available at REFINED-BIAS . 1 Introduction Figure 1: Empirical instability of stylized image-based bias evaluation. (a) illustrates the core insight of cue-conflict that stronger shape bias, similar to humans, improves in-domain performance. (b) shows examples of unrecognizable cues in the cue-conflict dataset. (c) illustrates conflicting findings on this core insight of cue-conflict. Do neural networks (NNs) exhibit biases in human-like perception, and can we diagnose them in cognitively meaningful terms? Addressing these questions is important for bridging machine and human vision, revealing how models internalize visual information and providing a basis for more human-like systems [ 3 , 29 , 21 , 11 , 18 , 15 ] . Accordingly, a growing line of work has developed diagnostic benchmarks [ 22 , 30 , 42 , 56 , 12 , 5 ] that evaluate model biases through a human-perceptual lens. Among them, the cue-conflict benchmark [ 22 ] remains the de facto standard and the most widely adopted framework for bias analysis, consistently used in recent studies [ 61 , 29 , 44 , 11 , 45 , 34 , 19 , 54 , 63 , 31 , 32 ] . The cue-conflict benchmark probes cue preference using stylized cue-conflict images that combine the shape of one class with the texture of another. It introduced a core insight that has been highly influential: a human-like strong shape bias is associated with higher in-domain performance (Fig. 1 a). While this idea remains highly valuable, we find that the current stylization-based instantiation yields empirically unstable evaluations. Many cue-conflict images are difficult to interpret even at the stimulus level: the intended shape or texture cue is often weak, visually mixed, or hard to recognize for both human and machine (Fig. 1 b). Such ambiguity helps explain conflicting conclusions in recent studies on whether shape or texture drives performance [ 45 , 2 , 38 , 19 ] (Fig. 1 c), and why the benchmark can fail to reflect explicitly shape-inducing training strategies. These observations raise fundamental reliability questions for stylized cue-conflict evaluation: do cue-conflict images actually instantiate perceptually valid and separable shape and texture signals, are the two cues mixed with controlled and comparable informativeness, and are the resulting cues reliably recognizable for both humans and models? If not, measured “preference” can be confounded by cue construction artifacts rather than reflecting genuine perceptual bias. Motivated by this concern, we identify key limitations of the current cue-conflict instantiation that undermine precise bias diagnosis (Fig. 2 ). On the construction side, stylization operationalizes shape and texture through model-dependent features, which can yield imperfect cue separation and perceptual impurity (Fig. 2 a), and provides no mechanism to control cue mixing ratios, often producing imbalanced cue informativeness (Fig. 2 b). On the evaluation side, the ratio-based bias score obscures cue sensitivity, making models with vastly different absolute cue utilization appear similar (Fig. 2 c), and restricting evaluation to a small subset of labels can distort model predictions, obscuring cue usage in the full decision space (Fig. 2 d). Figure 2: Limitations of the cue-conflict benchmark: Although it has offered a valuable and well-designed framework for studying shape and texture biases, we argue that several limitations warrant further attention: (a) cue entanglement caused by stylization, where shape and texture information leak into each other, (b) imbalanced cue information caused by stylization, leading to unfair predictive contributions, (c) ignoring differences in cue sensitivity, which prevents distinguishing models with genuine biases, and (d) evaluation restricted to preselected classes. To address these issues, we introduce REFINED-BIAS , a reliable framework for integrated evaluation and a disentangled benchmark of interpretable alignment of shape and texture. We define shape as globally and locally coherent geometric structure and texture as scale-consistent repetitive patterns [ 30 , 20 ] , and construct balanced, non-overlapping cue pairs from classes that are clearly recognizable to both humans and models. Building on this dataset, we further propose a cue-specific sensitivity framework evaluated in the full label space using a ranking-based metric, enabling preference to be interpreted alongside absolute sensitivity. REFINED-BIAS restores diagnostic faithfulness in three ways. (1) It consistently reflects the effects of shape-focused learning strategies on shape-related behavior, whereas cue-conflict exhibits only partial alignment. (2) It separates cue sensitivity from relative preference, allowing fairer cross-model comparison beyond ratio-based bias. (3) It supports more reliable conclusions about how shape and texture sensitivities jointly relate to model performance. As a result, REFINED-BIAS enables clearer empirical insights, including architecture-dependent shape-texture trade-offs and the role of local-to-global mechanisms in improving shape understanding, while resolving prior conflicting conclusions that the original cue-conflict benchmark could not reliably disambiguate. 2 Revisiting Cue Preference Benchmarking Before introducing our benchmark, we first revisit how cue preference has been measured in prior work and why the widely adopted cue-conflict paradigm requires careful re-examination. 2.1 The Cue-conflict Paradigm The cue-conflict benchmark [ 22 ] measures shape-texture bias using conflicting-cue images that combine the shape of one class with the texture of another through image stylization [ 17 ] . Since its introduction, it has become the de facto benchmark for studying cue preference. Importantly, however, this stylization-based design was adopted as a pragmatic solution rather than the only valid way to measure cue preference. In the original study, 22 initially considered more purified stimuli, such as sketches, to isolate visual cues more explicitly. Yet these introduced a substantial domain shift for standard CNNs. Stylization was therefore adopted as a practical workaround that preserved more natural image statistics while still inducing cue conflict. Under this implementation, shape and texture cues are operationalized through a stylization model: shape is associated with content features, and texture with style statistics such as Gram-matrix matching. Based on 16 ImageNet superclasses [ 23 ] , the benchmark contains 1,280 cue-conflict images constructed from 160 shape-source images and 48 texture-source images. Not all possible combinations of shape and texture are used. Instead, a subset is selected

Read the complete text