Adaptive Concept Bottleneck for Foundation Models Under Distribution Shifts

Jihye Choi, Jayaram Raghuram, Yixuan Li, Somesh Jha · 2024

Read Adaptive Concept Bottleneck for Foundation Models Under Distribution Shifts by Jihye Choi, Jayaram Raghuram, Yixuan Li, Somesh Jha (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-14097.txt.

Introduction

Jihye Choi, Jayaram Raghuram, Yixuan Li, and Somesh Jha make concept-based models adapt after deployment in a paper from 2024. Concept bottleneck models explain predictions through human ideas rather than raw features. They sit on top of large foundation models in fields like medicine and finance. Trouble comes when real-world data drifts from the training data. The authors first map how such pipelines fail under different drifts.

Their framework updates the concept bank and prediction layer using only unlabeled new data. No access to the original training set is needed. Across real-world shifts, accuracy rose by up to twenty-eight percent. Explanations also matched the new data better. The method aims to keep interpretable models trustworthy in the wild.

Catalog record

CREATORJihye Choi, Jayaram Raghuram, Yixuan Li, Somesh Jha
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE97 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-14097

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adaptive Concept Bottleneck for Foundation Models Under Distribution Shifts Jihye Choi, Jayaram Raghuram, Yixuan Li, Somesh Jha Abstract Advancements in foundation models (FMs) have led to a paradigm shift in machine learning. The rich, expressive feature representations from these pre-trained, large-scale FMs are leveraged for multiple downstream tasks, usually via lightweight fine-tuning of a shallow fully-connected network following the representation. However, the non-interpretable, black-box nature of this prediction pipeline can be a challenge, especially in critical domains such as healthcare, finance, and security. In this paper, we explore the potential of Concept Bottleneck Models (CBMs) for transforming complex, non-interpretable foundation models into interpretable decision-making pipelines using high-level concept vectors. Specifically, we focus on the test-time deployment of such an interpretable CBM pipeline “in the wild”, where the input distribution often shifts from the original training distribution. We first identify the potential failure modes of such a pipeline under different types of distribution shifts. Then we propose an adaptive concept bottleneck framework to address these failure modes, that dynamically adapts the concept-vector bank and the prediction layer based solely on unlabeled data from the target domain, without access to the source (training) dataset. Empirical evaluations with various real-world distribution shifts show that our adaptation method produces concept-based interpretations better aligned with the test data and boosts post-deployment accuracy by up to 28%, aligning the CBM performance with that of non-interpretable classification. 1 Introduction Foundation Models (FMs), trained on vast data, are powerful feature extractors applicable across diverse distributions and downstream tasks ( Bommasani et al., 2021 ; Rombach et al., 2022 ) . They can be applied to classification tasks off-the-shelf via zero-shot prediction, or via linear probing using task-specific fine-tuning data ( Kumar et al., 2022 ; Radford et al., 2021 ) . Despite these strong advantages, foundation model-based systems often operate as inscrutable black-boxes, presenting a barrier to user trust and wider deployment in safety-critical settings. Another challenge faced in the standard deployment of FM-based deep classifiers is their vulnerability to distribution shifts at test time caused e.g. , due to environmental changes, which can cause a drop in performance ( Bommasani et al., 2021 ) . This is particularly challenging in high-stakes domains such as healthcare ( AlBadawy et al., 2018 ; Eslami et al., 2023 ) , autonomous driving ( Yu et al., 2020 ) , and finance ( Wu et al., 2023a ) . In this work, we address these challenges by developing an interpretable classification framework that enjoys the rich, expressive feature representations of FMs, while also having enhanced robustness towards distribution shifts at test time . To tackle interpretability, we utilize Concept Bottleneck Models (CBMs) ( Koh et al., 2020 ) , transforming FM-based classifiers into interpretable, concept-based prediction pipelines. With the rapid advancements in FMs, there is strong opportunity to utilize them as powerful backbones, providing robust feature representations from which high-quality concepts can be extracted. Unlike early CBM approaches that required expensive concept annotations, recent advances show potential for constructing concept bottlenecks without any annotations by leveraging vision-language models ( Oikarinen et al., 2023 ; Wu et al., 2023b ) , and achieving performance on par with non-interpretable models. Concept-based predictions provide not only interpretability, but are also beneficial for robustness ; a central premise of CBMs is that as complex feature embeddings go through the concept bottleneck, the resulting predictions should, in theory, become more invariant to inconsequential input changes ( Kim et al., 2018 ; Adebayo et al., 2020 ) . Figure 1: Concept-based predictions are not inherently more robust to distribution shifts than feature-based predictions, necessitating dynamic adaptation after deployment. We observe significant drops in the averaged group accuracy (AVG) and worst-group accuracy (WG) from the source to the target (test) domain under two types of distribution shifts: (1) low-level shift (left), where inputs are perturbed without modifying class-level semantics ( e.g. , Gaussian noise); and (2) concept-level shift (right), where some high-level semantics change. On the left, predictions made through high-level concepts ( e.g. , by PCBM ( Yuksekgonul et al., 2023 ) here) are not necessarily more robust to low-level input perturbations. On the right, the performance of concept-based predictions suffers an even more drastic drop, failing to leverage the expressiveness of the foundation model’s high-level features, and falling behind direct feature-based predictions (here zero-shot and linear-probing based classification). However, with CONDA (our method), we can boost the performance of the deployed concept-based predictor to be on par with, or even better than, its non-interpretable counterparts. However, we observe that CBMs directly deployed under distribution shifts often do not produce more robust predictions compared to FM-based classifiers (either in zero-shot or fine-tuned configurations). For instance, as illustrated in Figure 1 , even when a concept-based prediction pipeline matches or outperforms a feature-based prediction pipeline in the training (source) domain, its test-time (deployment) performance can drop significantly under distribution shifts. This highlights that a naive adoption of CBMs is insufficient for fully leveraging the robustness and expressiveness of FM features under test-time shifts, necessitating a dynamic approach for adapting concept-based predictions in real-world deployments. The problem of test-time (or source-free domain) adaptation (TTA) has recently been explored extensively ( Wang et al., 2021 ; Jung et al., 2023 ; Liang et al., 2023 ) . The goal of TTA is to adapt a deep classifier, trained on source domain data, to a test-time deployment setting where there could be distribution shifts ( e.g. , corruptions, environment changes), and given access to only unlabeled test data and the source domain classifier. While the main focus of TTA methods has been on non-interpretable, deep classifier networks, we present the first approach (to our knowledge) for TTA of concept bottlenecks with a foundation model backbone . Our key contributions are summarized as follows: given unlabeled test data, a frozen FM, and a pre-constructed concept bottleneck, we 1. formally categorize the types of distribution shifts expected during deployment, identifying possible failure modes of the concept bottleneck pipeline under these shifts (Section 2 ); 2. propose a novel framework CONDA (CONcept-based Dynamic Adaptation), where each component of the framework is adapted based on the identified failure modes, without requiring access to the source dataset or any labels for the test data (Section 3 ); 3. empirically demonstrate the robustness and interpretability of CONDA across various FM backbones ( e.g. , CLIP:ViT-L/14) and concept bottleneck construction methods ( e.g. , post-hoc CBM), showing that CONDA improves the test-time accuracy by up to 28%, and provides concept-based interpretations better tailored towards the test inputs (Section 4 ). Related Work. Distribution shifts occur when the data distribution during deployment differs from that during training, leading to degraded model performance ( Quiñonero-Candela et al., 2022 ) . To address this issue, TTA methods adapt the model parameters using only unlabeled test data to enhance the robustness under such shifts. Representative methods include entropy minimization ( Wang et al., 2021 ; Zhang et al., 2022 ) , self-supervised learning at test time ( Sun et al., 2020 ) , class-aware feature alignment ( Jung et al., 2023 ) , and updating batch normalization statistics using test data ( Nado et al., 2020 ) . These methods enable models

Read the complete text