MAVias: Mitigate any Visual Bias
Ioannis Sarridis Christos Koutlis Symeon Papadopoulos Christos Diou · 2024
Read MAVias: Mitigate any Visual Bias by Ioannis Sarridis Christos Koutlis Symeon Papadopoulos Christos Diou (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-06632.txt.
Introduction
Ioannis Sarridis, Christos Koutlis, Symeon Papadopoulos, and Christos Diou present MAVias in 2024, a method to strip bias from image models. Vision models often lean on side cues, such as backgrounds, instead of the true subject. Older fixes target a short list of known biases, which misses unknown ones.
MAVias hunts biases in the open. A tagging model names many visual traits in words, and a language model picks which traits truly define each class. The rest become suspect biases, turned into vectors the trainer then teaches the model to ignore. Tests on four data sets beat current methods across a wide range of biases.
Catalog record
| CREATOR | Ioannis Sarridis Christos Koutlis Symeon Papadopoulos Christos Diou |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-06632
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MAVias: Mitigate any Visual Bias Ioannis Sarridis Christos Koutlis Symeon Papadopoulos Christos Diou Abstract Mitigating biases in computer vision models is an essential step towards trustworthy artificial intelligence systems. Existing bias mitigation methods are limited to predefined biases, preventing their use in visual datasets where multiple, possibly unknown biases exist. To address this limitation, we introduce MAVias, an open-set bias mitigation approach that leverages foundation models to discover spurious associations between visual attributes and target classes. MAVias first captures a wide variety of visual features in natural language via a foundation image tagging model, and then leverages a large language model to select visual features that define the target class, resulting in a set of language-coded potential visual biases. It then translates these biases into vision-language embeddings and introduces an in-processing bias mitigation approach to prevent the model from encoding information related to them. Experiments on diverse datasets, including CelebA, Waterbirds, ImageNet, and UrbanCars, show that MAVias effectively detects and mitigates a wide range of biases in visual recognition tasks, outperforming current state-of-the-art. Figure 1 : MAVias identifies instance-level potential visual biases through foundational models that extract tags representing visual features and assess relevance to the target class. Then, MAVias encodes these features within the vision-language space and integrates them into a bias-aware framework to train a model that is invariant to such visual biases. 1 Introduction Computer Vision (CV) progress has been largely driven by Deep Learning (DL) advances [ 8 , 15 ] and large-scale datasets [ 6 , 26 , 22 ] , enabling models to learn complex patterns and visual features with impressive accuracy. However, alongside this progress, concerns have emerged about biases embedded in these models [ 33 , 30 , 11 , 40 , 42 , 47 ] – often stemming from unintended correlations present in the training data [ 28 , 13 , 31 , 23 ] . The correlated attributes that are irrelevant act as “shortcuts” and can significantly impact the model’s reliability and generalization [ 37 , 38 , 12 ] . It is important to note that in the context of this paper, we define as visual bias any characteristic that does not contribute to defining the target class, which we refer to as “irrelevant”. To address this, several methodologies have been developed. Broadly, these fall into two categories: Bias label-Aware (BA) and label-Unaware (BU) methods. BA methods leverage the annotations of attributes introducing the biases to address them [ 20 , 48 , 44 , 2 ] . BU methods focus on extracting bias pseudo-labels in cases of extreme biases where a bias-proxy model (or bias-capturing classifier) can be trained using the task’s target labels that closely align with the bias labels [ 16 , 32 , 43 , 29 ] . While effective in certain contexts, both BA and BU methods have limited applicability when there are multiple, complex, and possibly unknown biases. Common challenging scenarios include: • Unknown biases : In large general-purpose CV datasets, such as ImageNet, biases are difficult to identify and largely remain unknown, as they vary widely across different classes and are not prominent enough to allow training of bias proxy models. For instance, in the ImageNet9 example of Tab. 1 , a sample labeled as a dog could introduce biases related to the background scene (e.g., armchair , couch , pillow , red ), the color of the dog (e.g., black and white ), or accessories like a neckband . • Potential biases beyond a predefined set : The CelebA example in Tab. 1 , shows that beyond the hair color , additional biases may be present, such as clothing styles (e.g., business suit , tie ). • Poor representation of predefined bias : In some cases, biases are reduced to single labels, such as “rural background” in the UrbanCars dataset. However, as shown in Tab. 1 , more nuanced descriptors at the instance level (e.g., path , tree , wood , forest , hydrant , red , etc.) provide a richer representation of bias. Table 1 : Examples of extracted tags for various datasets. Red color indicates the irrelevant tags ( \mathcal{B}^{(i)} ). Dataset ImageNet9 Waterbirds UrbanCars CelebA Target Class dog bird species car type hair color Bias Type unknown background background and objects gender Sample Extracted Tags armchair , black , chair , couch , dog , neckband , pillow , red , sit , white bamboo , bamboo forest , bird , blue , branch , green , hide , parrot , perch , sit , stand , stem , tree , yellow car , path , forest , hydrant , lush , park , red , road , sedan , silver , SUV , tree , white , wood black , business suit , dress , dress shirt , man , stand , stare , suit , tie , wear Existing BA and BU methods are not designed to mitigate such biases, leading to models that are biased and/or do not achieve their optimal generalization potential. To address this, Mitigate Any Visual bias (MAVias) introduces a flexible and scalable solution, capable of identifying and mitigating open-set biases in CV datasets. MAVias begins by extracting descriptive tags that capture various visual features, such as general-purpose objects, actions, scenes, and visual attributes. Recent advancements in image tagging [ 53 ] cover large and comprehensive vocabularies (i.e., >4,000 tags), effectively meeting the open-set requirements of MAVias. Then, these tags are processed by a Large Language Model (LLM) to identify which ones are irrelevant to each of the target classes, leading to a rich set of language-encoded visual biases , text descriptions of visual characteristics that are irrelevant to the classification task at hand. MAVias translates these biases into vision-language embeddings, projects them to the main model’s backbone space and then to the classification layer. This projection layer is trained simultaneously alongside the main model, and during training, the output logits are a linear combination of the logits of the main model and those of the projection layer that captures visual biases. This setup allows the main model to be exposed to the biased features – those representing irrelevant information to the target class – in a controlled way that leads to bias-invariant representations. Overall, MAVias provides an effective, end-to-end solution for identifying and mitigating biases in open-set scenarios. We evaluate the proposed method on several datasets involving single-attribute biases (CelebA, Waterbirds) as well as multi-attribute predefined biases (UrbanCars), demonstrating state-of-the-art performance. Furthermore, experiments were conducted on ImageNet9, involving unknown biases, where the suggested approach demonstrates significant gains (from 5.24% to 10.21%) in terms of accuracy compared to existing competitive approaches. The main contributions of this paper are the following: • A framework for identifying instance-specific open-set potential visual biases in CV datasets. • A learning strategy that exploits foundation models to learn bias-invariant representations that force the under-training model to avoid encoding any number of identified potential biases per training sample. • An extensive evaluation study including 4 thematically diverse datasets demonstrating the effectiveness and general applicability of MAVias, which outperforms the state-of-the-art. MAVias implementation is available as part of the VB-Mitigator library [ 39 ] . 2 Related Work Bias