Do you see what I see? An Ambiguous Optical Illusion Dataset exposing limitations of Explainable AI
Carina Newen TU Dortmund University, Luca Hinkamp, Maria Ntonti, Emmanuel Müller · 2025
Read Do you see what I see? An Ambiguous Optical Illusion Dataset exposing limitations of Explainable AI by Carina Newen TU Dortmund University, Luca Hinkamp, Maria Ntonti, Emmanuel Müller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21589.txt.
Introduction
Carina Newen and three co-authors built a 2025 set of trick images to test how machines see. Each image blends two beasts into one form, so the eye can read it in two ways. Such trick images show the limits of both human sight and machine sight, yet good test sets have been scarce.
The team traced which small cues steer a model's choice, and found that gaze and eye cues sway scores a great deal. They also made the images in a planned way and talked through steps to cut bias. Readers get a fresh test set and a clear case for why core sight ideas count in machine learning.
Catalog record
| CREATOR | Carina Newen TU Dortmund University, Luca Hinkamp, Maria Ntonti, Emmanuel Müller |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-21589
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Do you see what I see? An Ambiguous Optical Illusion Dataset exposing limitations of Explainable AI Carina Newen TU Dortmund University, Luca Hinkamp, Maria Ntonti, Emmanuel Müller Abstract From uncertainty quantification to real-world object detection, we recognize the importance of machine learning algorithms, particularly in safety-critical domains such as autonomous driving or medical diagnostics. In machine learning, ambiguous data plays an important role in various machine learning domains. Optical illusions present a compelling area of study in this context, as they offer insight into the limitations of both human and machine perception. Despite this relevance, optical illusion datasets remain scarce. In this work, we introduce a novel dataset of optical illusions featuring intermingled animal pairs designed to evoke perceptual ambiguity. We identify generalizable visual concepts, particularly gaze direction and eye cues, as subtle yet impactful features that significantly influence model accuracy. By confronting models with perceptual ambiguity, our findings underscore the importance of concepts in visual learning and provide a foundation for studying bias and alignment between human and machine vision. To make this dataset useful for general purposes, we generate optical illusions systematically with different concepts discussed in our bias mitigation section. The dataset is accessible in Kaggle via Ambivision . Our source code can be found at https://github.com/KDD-OpenSource/Ambivision.git . 1 Introduction The motivation of this particular optical illusion dataset stems from a novel problem in the explainability domain (XAI). When we discuss explainable AI, uncovering the black-box nature of models, and visualizing the internal workings of a machine learner for image data, research has so far focused on highlighting pixels that are most important or influential in the decision-making process Ribeiro et al. (2016) ; Selvaraju et al. (2017) . Other approaches highlight important regions Ribeiro et al. (2018) or target the most essential features Lundberg and Lee (2017b) ; Sundararajan et al. (2017) . However, these methods often fall short when confronted with perceptual ambiguity- situations where even human interpretation is uncertain. Take a look at Figure 1 . Figure 1: In this image, you can see both a rabbit and a duck. Common XAI methods that highlight important pixels could output exactly the same explanation for either of those classes without improving human understanding of which class was chosen why. This is a critical research gap in explanations- pixel highlighting is simply not enough. One way of distinguishing the two depends on the way you consider the eyes to be looking in. While this is not the only way to approach the problem, we will highlight the usefulness of the gaze for the classification task in our evaluations. However, we show that with one very small addition, we can erase the ambiguity of an image for humans and improve it for machine learners. We argue that the future in XAI lies in uncovering such concepts rather than highlighting pixels, which is the critical research gap we address in this paper. Depending on the viewer’s perception of the eye’s direction, the image may be interpreted as either a rabbit or a duck. If you were to use any current XAI algorithm to generate explanations of why it is a rabbit or a duck, the explanations could look exactly the same. They would keep the actual reason behind this optical illusion secret. This is due to the fact that current XAI methods highlight important pixels or areas, which, in this case, are shared by both classes. This suggests that standard XAI methods are currently inadequate when semantic interpretation relies on abstract perceptual cues rather than pixel-level interpretation. Examples of this phenomenon on the provided dataset can be seen in Section 3 . Clearly, our internal decision process goes beyond what we see- resolving ambiguity by assigning direction, intent and anthropomorphizing Wan and Chen (2021) . One such so far neglected concept is the viewing direction of the animal, and not just where we look at as the supervisor. In this paper, we introduce three major contributions: First, we expose the existing methodologies of XAI by showing limitations: Highlighting pixels or areas alone, at least in the image domain, is not enough. Second, we introduce a new open-source optical illusion dataset featuring animal images labelled with bounding boxes, gaze and viewing direction annotations. And third, we demonstrate that integrating gaze direction and eye coordinates into the learning process improves model performance, even when all other aspects (architecture, epochs, learning rate, dataset structure, optimizer) remain the same. Our novel dataset is generated with sophisticated ChatGPT OpenAI (2024) models and considerable computational power. It incorporates the understanding of a generative AI model in generating optical illusions while achieving images that are difficult for humans. However, we address how we mitigated potential biases in Section 6.1 . Furthermore, the difficulty of generating convincing optical illusions makes it hard to provide large datasets that are drawn by human artists: We argue that a machine generated set offers a valuable perspective into human vs AI perceptual learning. 2 Related Work Explainable AI, often shortened to XAI, is broadly considered to be split into two categories: transparency design and post-hoc explanations Xu et al. (2019) . We criticize that the current approaches of visualization methods in the image domain highlight pixels or areas of images that show the importance of specific features. Saliency-based methods, such as LIME Ribeiro et al. (2016) , Grad-CAM Selvaraju et al. (2017) , or Anchors Ribeiro et al. (2018) offer local explanations by attributing predictions to pixel importance or localized regions. The broader landscape of explainable AI encompasses countless methods Lundberg and Lee (2017a) from counterfactuals Mothilal et al. (2020) ; Antorán et al. (2020) , prototypes Nauta et al. (2023) ; Chen et al. (2018) , to global explainability methods Setzu et al. (2021) ; Morichetta et al. (2019) ; Newen and Müller (2022) . We highlight the need for concept-based XAI in ambiguous settings. One type of concept-based XAI works is based on predefined concepts and relies on human supervision Kim et al. (2018) ; Bontempelli et al. (2022) ; Yeh et al. (2020) ; Goyal et al. (2019) . This is why this was extended to automatic concept-based extraction, which relies on segmentation strategies that then employ importance scores to dismiss outliers Fel et al. (2023a) ; Ghorbani et al. (2019) ; Zhang et al. (2021) ; Fel et al. (2023b) . However, this type of approach also comes with its limitations: We argue that all of these approaches still segment pixel-based logic. We apply ACE Ghorbani et al. (2019) to our dataset as a prominent representative of the field and show with examples that it also had problems extracting useful concepts. We demonstrate in this work that general concepts for domains exist, such as gaze and the eye, that help the overall performance on a whole domain rather than just a specific type of animal. These concepts were not spotted when applying ACE. In our experimental section in Section 5 , as well as further experiments in the Appendix A , we show the improvement when those concepts are considered versus learning without the concepts on our ambiguous dataset. Figure 2: We feature here several examples of our dataset. For example, on the upper left side,