Navigating Shortcuts, Spurious Correlations, and Confounders: From Origins via Detection to Mitigation
David Steinmann, Felix Divo, Maurice Kraus, Antonia Wüst, Lukas Struppek, Felix Friedrich, Kristian Kersting · 2024
Read Navigating Shortcuts, Spurious Correlations, and Confounders: From Origins via Detection to Mitigation by David Steinmann, Felix Divo, Maurice Kraus, Antonia Wüst, Lukas Struppek, Felix Friedrich, Kristian Kersting (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-05152.txt.
Introduction
David Steinmann and co-authors map the problem of shortcuts in machine learning in 2024. A model may learn a cheap clue that works in training but fails in the real world. Past work uses many names for this flaw, which has split the field. The authors give one clear definition and one shared scheme of types.
Their scheme sorts past ways to find and fix shortcuts. It also links the topic to bias, cause and effect, and security. Those links are real but rarely drawn. The team lists data sets built to study shortcuts. Gaps and open problems are named. The aim is a shared base so fixes improve and models hold up better in new settings.
Catalog record
| CREATOR | David Steinmann, Felix Divo, Maurice Kraus, Antonia Wüst, Lukas Struppek, Felix Friedrich, Kristian Kersting |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-05152
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Navigating Shortcuts, Spurious Correlations, and Confounders: From Origins via Detection to Mitigation David Steinmann, Felix Divo, Maurice Kraus, Antonia Wüst, Lukas Struppek, Felix Friedrich, Kristian Kersting Abstract Shortcuts, also described as Clever Hans behavior, spurious correlations, or confounders, present a significant challenge in machine learning and AI, critically affecting model generalization and robustness. Research in this area, however, remains fragmented across various terminologies, hindering the progress of the field as a whole. Consequently, we introduce a unifying taxonomy of shortcut learning by providing a formal definition of shortcuts and bridging the diverse terms used in the literature. In doing so, we further establish important connections between shortcuts and related fields, including bias, causality, and security, where parallels exist but are rarely discussed. Our taxonomy organizes existing approaches for shortcut detection and mitigation, providing a comprehensive overview of the current state of the field and revealing underexplored areas and open challenges. Moreover, we compile and classify datasets tailored to study shortcut learning. Altogether, this work provides a holistic perspective to deepen understanding and drive the development of more effective strategies for addressing shortcuts in machine learning. August 24, 2026 1 Introduction Deep learning (DL) has achieved remarkable advancements in recent years, with state-of-the-art models demonstrating superhuman performance in games like chess [ 168 ] and Go [ 167 ] as well as versatile language systems capable of addressing diverse tasks in zero- or few-shot settings [ 136 ; 182 ] . Despite these impressive achievements, DL models often rely on shortcuts , leading to unexpected failures when applied in real-world settings [ 61 ] . Overreliance on specific training artifacts can cause these failures, as they do not generalize to data without these artifacts anymore. This phenomenon can take various forms and occur in many settings: In medical applications such as diagnosing pneumonia or dementia, models have been shown to depend on irrelevant factors like hospital identifiers or image quality rather than medically significant features [ 216 ; 27 ] . Image classification models have mistakenly relied on embedded photographer tags [ 95 ] or struggled to identify animals in unusual environments [ 20 ] . Models predicting product quality from sensor data in sheet metal manufacturing prioritized irrelevant production speed instead of critical applied forces [ 89 ] . For sentiment classification, models have used superficial cues such as stop-word distributions instead of focusing on semantically meaningful content [ 111 ] . Even large language models (LLMs) have been found to rely on undesired biases from the input data, negatively impacting their fairness [ 213 ; 59 ] . To discuss the underlying issue in more detail, let us introduce a running example that will serve as a reference throughout this work 1 1 1 This example follows the waterbird dataset by Sagawa et al. [151] . : Figure 1: Models across different settings are susceptible to shortcuts. Models trained on data containing spurious correlations may rely on unintended features for decision-making. These shortcuts can manifest across various domains and tasks, significantly affecting model performance and generalization. Running Example: Classifying Birds into Landbirds and Waterbirds For this illustrative example, let us assume that we have a dataset of images depicting various bird species. The goal is to classify these images into two categories: landbirds and waterbirds , based on the birds’ characteristics. Naturally, images of landbirds are more likely to feature land backgrounds, while images of waterbirds often include water in the background. However, we want the model to perform its predictions based on the bird itself rather than the environment, as the presence of a landbird in front of a water background does not transform it into a waterbird. When training a model on this waterbird and landbird dataset, it often relies on background features rather than focusing on the birds’ relevant characteristics [ 151 ] . Similar to the examples discussed earlier, the model follows a shortcut to complete its task. Using the background information can yield high training accuracy, but does not solve the task based on the right reasons. Consequently, the model struggles to generalize to new data where the shortcut is absent, such as landbirds pictured against a water background (cf. Fig. 1 , left). This approach to solving tasks is a well-known phenomenon that extends beyond machine learning, appearing, for instance, in animal psychology [ 154 ] . In the context of machine learning, it is described using various different terms: shortcuts [ 62 ; 58 ; 126 ] , spurious correlations [ 211 ; 151 ; 200 ] , Clever Hans behaviour [ 95 ; 37 ; 11 ] , or confounders [ 161 ; 224 ; 215 ] . While these terms describe the same fundamental issue, they are often used informally and lack precise definitions, making it challenging to discern their similarities and differences. Moreover, research on the same problem has been independently developed under these different terms, resulting in a fragmented state of the field with many individual research threads. The absence of comprehensive surveys exacerbates this fragmentation, making it challenging for researchers to gain a clear understanding of the field’s current state or to find synergies between methods. In this work, we take a decisive step toward addressing these issues by introducing a clear and formal definition of the underlying fundamental problem centered around the concepts of shortcuts and spurious correlations . We then clarify how this definition relates to other terms like Clever Hans behavior , confounders or biases . Going even one step further, we discuss the connection and overlap between shortcuts and other prominent topics in machine learning, including distribution shifts, causality, or adversarial features. In this light, we explore potential sources of shortcuts in machine learning and why models are prone to using them. Given these building blocks, we introduce a taxonomy of shortcut learning, categorizing the rich body of work in this area and bringing research under the various associated terms together. To further facilitate the field’s progression, we collect datasets targetting shortcut detection and mitigation and point out open challenges and further research opportunities. Overall, the contributions of this work can be summarized as follows: (i) We provide formal definitions of shortcuts, unifying and connecting the terms spurious correlations, Clever Hans behavior, and confounders. (ii) We introduce a taxonomy of shortcut learning - providing an overview of the current state of the field and structuring existing approaches. (iii) Based on this taxonomy, we identify open challenges, like tackling more complex shortcuts, also beyond the typical image classification, that still need to be addressed. (iv) We provide a comprehensive overview of available datasets that explicitly include shortcuts, facilitating the development of new approaches. The structure of the paper is as follows. In Sec. 2 , we provide a formal definition of shortcuts and explore their origins. Next, we establish the building blocks of our taxonomy in Sec. 3 and present the taxonomy itself in Sec. 4 . In Sec. 5 , we discuss methods aimed at detecting shortcuts, followed by methods aimed at mitigating these in Sec. 6 . We then collect and review relevant datasets for detection and mitigation in Sec. 7 . The paper concludes with a discussion of open challenges in