Interpretable Model Drift Detection

Pranoy Panda, Kancheti Sai Srinivas, Vineeth N Balasubramanian, Gaurav Sinha · 2025

Read Interpretable Model Drift Detection by Pranoy Panda, Kancheti Sai Srinivas, Vineeth N Balasubramanian, Gaurav Sinha (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06606.txt.

Introduction

Pranoy Panda and co-authors took on a quiet failure of machine learning in a 2025 study: models go stale as the data around them changes. Knowing that a model has drifted matters twice over, since teams must fix the model and can also learn from what changed. Most drift tools only raise a flag and explain nothing.

The team built a test that names the features behind a drift, using how features act together. Their method carries proof that it can catch real drift, and it works for both sorting and value-guessing tasks. On standard test sets, it beat other tools that explain drift and matched strong tools that do not. A case study showed it points at the features that truly drive the change.

Catalog record

CREATORPranoy Panda, Kancheti Sai Srinivas, Vineeth N Balasubramanian, Gaurav Sinha
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-06606

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Interpretable Model Drift Detection Pranoy Panda, Kancheti Sai Srinivas, Vineeth N Balasubramanian, Gaurav Sinha Abstract . Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowledge of this drift serves two purposes: (i) Retain an accurate model and (ii) Discovery of knowledge or insights about change in the relationship between input features and output variable w.r.t. the model. Most existing works focus only on detecting model drift but offer no interpretability. In this work, we take a principled approach to study the problem of interpretable model drift detection from a risk perspective using a feature-interaction aware hypothesis testing framework, which enjoys guarantees on test power. The proposed framework is generic, i.e., it can be adapted to both classification and regression tasks. Experiments on several standard drift detection datasets show that our method is superior to existing interpretable methods (especially on real-world datasets) and on par with state-of-the-art black-box drift detection methods. We also quantitatively and qualitatively study the interpretability aspect including a case study on USENET2 dataset. We find our method focuses on model and drift sensitive features compared to baseline interpretable drift detectors. DOI: 3632410.3632434 Conference: Joint International Conference on Data Science and Management of Data; Jan 04–07, 2024; Bengaluru, KA, IND Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 1. Introduction A standard assumption in traditional supervised learning settings is that input data is sampled from a stationary distribution. In reality, however, many application domains – including finance, healthcare, energy informatics, and communications – generate data that evolve with time, i.e., they are non-stationary ( Moons et al., 2012 ; Davis et al., 2017 ; Minne et al., 2012 ) . Such an evolution of data over time can make models learned through standard supervised learning techniques underperform, i.e., the decision boundary learned by the model drifts away from the actual decision boundary over time ( Khamassi et al., 2018 ) . This phenomenon of model degradation is termed as model drift . Related settings have been studied under different names in literature – most primarily, as concept drift – which we discuss along with related work in Sec 2 . To better understand model drift, consider a machine learning (ML) or neural network (NN) model trained on data points produced by a data-generating process. This generating process can change over time, due to evolving dynamics of a given application setting, resulting in a shift in the covariate distribution (a.k.a covariate shift ), shift in feature-conditioned output/posterior distribution (a.k.a posterior shift/real concept drift ), or both ( Gama et al., 2014 ) . However, not all data shifts result in significant model performance degradation - i.e. some data shifts are benign w.r.t. the model (for e.g., data that lie far away from the decision boundary in the correct direction). Retraining the model in such scenarios could be unnecessary and rather increase the cost of model deployment. Besides retraining when the model performance degrades, it is useful to understand such a drift in terms of input features. It can be helpful to deduce change in variables of importance, i.e. features that were predictive before the drift but not after, and vice versa. With the growing emphasis on interpretable models, such kinds of insights are helpful for users to understand which variable – say, user demand, geographic location or season – changed in such a drift. Thus, interpretable model drift detection is an important problem to be studied as it has a potentially wide range of applications including predictive maintenance ( Zenisek et al., 2019 ) , social media analysis ( Costa et al., 2014 ; Müller and Salathé, 2020 ) and malware detection ( Jordaney et al., 2017 ) , where model drifts are common. Table 1. Comparison of our method with different model drift detectors in literature. Marginal ( dos Reis et al., 2016 ) and Conditional ( Kulinski et al., 2020 ) are covariate shift methods, which do not focus on model drift. \checkmark and \times represent True and False , respectively. Properties \rightarrow Focus on Feature-level Relevant for Relevant for No assumptions Methods \downarrow model drift interpretability classification task regression task on covariates Marginal ( dos Reis et al., 2016 ) \times \checkmark \checkmark \checkmark \checkmark Conditional ( Kulinski et al., 2020 ) \times \checkmark \checkmark \checkmark \times MDDM ( Pesaranghader et al., 2018 ) \checkmark \times \checkmark \times \checkmark DDM ( Gama et al., 2004 ) \checkmark \times \checkmark \times \checkmark ADWIN ( Bifet and Gavalda, 2007 ) \checkmark \times \checkmark \checkmark \checkmark KSWIN ( Raab et al., 2020 ) \checkmark \times \checkmark \checkmark \checkmark TRIPODD (Ours) \checkmark \checkmark \checkmark \checkmark \checkmark Existing methods in literature to detect model drift include KS test based adaptive WINdowing (KSWIN) ( Raab et al., 2020 ) , McDiarmid Drift Detection Method (MDDM) ( Pesaranghader et al., 2018 ) , Drift Detection Method (DDM) ( Gama et al., 2004 ) , Early Drift Detection Method (EDDM) ( Baena-Garcıa et al., 2006 ) and Adaptive Windowing Algorithm (ADWIN) ( Bifet and Gavalda, 2007 ) . Although these methods detect model drift, they are not interpretable. The limited efforts that have considered interpretability in drift detection ( Kulinski et al., 2020 ; dos Reis et al., 2016 ) are restricted to drifts in the covariate space, which may not always lead to model drift. To the best of our knowledge, no holistic framework exists to address interpretable model drift detection. Existing post-hoc explainability methods are not intended for distribution shifts, and thus give unreliable explanations under drifts ( Lakkaraju et al., 2020 ) . Therefore, in this work, we propose feature-inTeraction awaRe InterPretable mOdel Drift Detection (TRIPODD), a method that leverages hypothesis testing and model risk to detect model drift and simultaneously interpret it w.r.t. input features. Table 1 summarizes the comparison of TRIPODD with existing methods, and shows its usefulness and generalizability over earlier efforts. The proposed TRIPODD method adopts a first-principles approach and uses the base model’s empirical risk to directly study change in model performance on the prediction task w.r.t. a model class. Empirical risk minimization ( Vapnik, 1991 ) has remained a key foundation of the field of machine learning, which is used to train ML and NN models; hence, defining change in decision boundary in terms of model risk is a natural choice. To attain feature-level interpretability of the drift, we formally define feature-sensitive model drift definition (Defn 3.2 ) and construct a hypothesis test around that definition, which is sensitive to feature interactions learned by the underlying NN model. This is then used for detecting and interpreting drifts on real-world datasets. Our key contributions are summarized below: • We propose a new method, TRIPODD, for interpretable model drift detection. To the best of our knowledge, this is the first such work towards feature-interpretable model drift detection, paralleling the significant uptake of interpretability across application domains at this time. • As TRIPODD uses only model risk to achieve this objective, it can be applied to both classification and regression tasks, thus making it a fairly generic method. • We theoretically analyze the hypothesis testing framework underlying our method, and show that

Read the complete text