Conditional Anomaly Detection Using Soft Harmonic Functions: An Application to Clinical Alerting

Michal Valko, Hamed Valizadegan, Branislav Kveton, Gregory F. Cooper, Milos Hauskrecht · 2026

Read Conditional Anomaly Detection Using Soft Harmonic Functions: An Application to Clinical Alerting by Michal Valko, Hamed Valizadegan, Branislav Kveton, Gregory F. Cooper, Milos Hauskrecht (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21956.txt.

Introduction

Valko and four colleagues develop a nonparametric approach to conditional anomaly detection for clinic alerts. It spots data cases with an odd reply, such as a missed important lab test. The method uses the soft harmonic solution to rate label confidence and spot wrong labels. The solution is tuned to avoid flagging lone cases and cases at the edge of data support. It works well at spotting odd labels on a real electronic health record dataset, against several baselines.

Catalog record

CREATORMichal Valko, Hamed Valizadegan, Branislav Kveton, Gregory F. Cooper, Milos Hauskrecht
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14578
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21956

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Conditional Anomaly Detection Using Soft Harmonic Functions: An Application to Clinical Alerting Michal Valko, Hamed Valizadegan, Branislav Kveton, Gregory F. Cooper, Milos Hauskrecht Abstract Timely detection of concerning events is an important problem in clinical practice. In this paper, we consider the problem of conditional anomaly detection that aims to identify data instances with an unusual response, such as the omission of an important lab test. We develop a new non-parametric approach for conditional anomaly detection based on the soft harmonic solution, with which we estimate the confidence of the label to detect anomalous mislabeling. We further regularize the solution to avoid the detection of isolated examples and examples on the boundary of the distribution support. We demonstrate the efficacy of the proposed method in detecting unusual labels on a real-world electronic health record dataset and compare it to several baseline approaches. 1 Introduction With the advances in health-care and with more data being handled and stored electronically, the opportunities increase for machine learning to improve the health care. Despite continuous improvement in medical practice, medical errors remain a very serious problem. According to recent data, medical errors are the 8-th leading cause of death in the US population ( Kohn et al. 2000 ) . We aim to identify medical errors that correspond to unusual patient-management decisions, such as ordering a medication. Our hypothesis is that patient-management decisions that are unusual with respect to past patients may be due to errors and that it is worthwhile to raise an alert if such a condition is encountered. Typical systems for medical error detection rely on the clinical knowledge, such as expert-derived rules. Extracting such knowledge is costly, time-consuming, and very difficult with medical practice constantly changing. Machine learning can offer a viable alternative: using past medical records to detect anomalies. Detecting anomalies in the patient-management decisions has the potential to help avoid medical errors, which could lead to improved quality of care and decreased costs. Traditional anomaly detection methods used in data analysis are unconditional and look for outliers with respect to all data attributes ( Markou & Singh 2003 ) . The conditional anomaly detection (CAD) problem ( Hauskrecht et al. 2007 ; Song et al. 2007 ) seeks to detect unusual values for a subset of variables given the values of the remaining variables. In the special case when the target variable is a class label, the problem is often called mislabeling detection. While we focus on this special case of anomalies in the class label, the main objective is different: we are interested in constructing a system that can raise an alert when an anomalous label of a new example is observed. Formally, we want to solve the following problem: Problem statement ( \bigstar ): Given a set of n past observed examples ({\bf x}_{i},y_{i})_{i=1}^{n} (with possible label noise), check if any instance i in recent m examples ({\bf x}_{i},y_{i})_{i=n+1}^{n+m} is unusual. In general, we seek to reliably identify anomalies on the response (decision or class) variables for all possible values of the context (input or feature) variables. Not knowing the underlying model, that generates the (attributes, label) pairs, may lead to two major complications. First, a given instance may be far from the past observed data points (e.g. patient cases). Because of the lack of the support for alternative responses, it is difficult to asses the anomalousness of these instances. We refer to these instances as isolated points . Second, the examples on the boundary of the class distribution support, also known as fringe points , may look anomalous due to their low likelihood. Because the underlying conditional distribution of the data is unknown, a non-parametric approach that looks for the label consistency of the instances on their neighborhood (e.g. k -nearest neighbor or k -NN) can be very useful ( Papadimitriou & Faloutsos 2003 ) . The problem with relying on models such as k -NN is that they fail to detect clusters of anomalous instances. Our approach differs from typical local neighborhood approaches in two important aspects. First, it respects the structure of the manifold and accounts for more complex interactions in the data. Second, it solves the problem of isolated and fringe points by decreasing the confidence in predicting an opposite label for such points through regularization. 2 Background Label propagation on the graph is widely used for semi-supervised learning (SSL). The general idea is to assume the consistency of labels among the data which are 1) close to each other and 2) lie on the structure (manifold/cluster). The two examples are the Consistency Method of Zhou et al. ( Zhou et al. 2004 ) and the Harmonic Solution of Zhu et al. ( Zhu et al. 2003 ) , which are the instances of unconstrained regularization ( Cortes et al. 2008 ) . Let G be the similarity graph with the nodes corresponding to \{{\bf x}_{i}\}_{i=1}^{n+m} and with the weighted edges W encoding pairwise similarities between the nodes. We denote by \mathcal{L}(W) the (unnormalized) graph Laplacian defined as \mathcal{L}(W)=D-W where D is a diagonal matrix whose entries are given by d_{ii}=\sum_{j}w_{ij} . In the transductive setting, the unconstrained regularization searches for soft (continuous) label assignment such that it maximizes fit to the labeled data and penalizes for not following the manifold structure: {\bm{\ell}}^{\star}=\min_{{\bm{\ell}}\in\mathbb{R}^{n}}\ ({\bm{\ell}}-{\bf y})^{\mathsf{\scriptscriptstyle T}}C({\bm{\ell}}-{\bf y})+{\bm{\ell}}^{\mathsf{\scriptscriptstyle T}}K{\bm{\ell}}, (1) where K is a symmetric regularization matrix and C is a symmetric matrix of empirical weights. C is usually diagonal and the diagonal entries often equal to some fixed constant c_{l} for the labeled data and c_{u} for the unlabeled. In a SSL setting, {\bf y} is a vector of pseudo-targets such that y_{i}\in\{\pm 1\} is the label of the i -th example when the example is labeled, and y_{i}=0 otherwise. The appealing property of ( 1 ) is that it can be computed by the following closed form solution: {\bm{\ell}}^{\star}=(C^{-1}K+I)^{-1}{\bf y} (2) 3 Methodology We now propose a way to compute the anomaly score from ( 2 ). The output \ell^{\star} of ( 1 ) for the example i can be rewritten ( \mathrm{sgn} refers to the sign function) as: \ell_{i}^{\star}=|\ell_{i}^{\star}|\times\mathrm{sgn}(\ell_{i}^{\star}) (3) SSL methods use \mathrm{sgn}(\ell^{\star}_{i}) in ( 3 ) as the predicted label for i . For an unlabeled example, the closer the value of \ell_{i} is to \pm 1 , the more consistent labeling information was propagated to it. The key observation, which we exploit in this paper, is that we can interpret |\ell^{\star}_{i}| as a confidence of the label. We define the anomaly score s_{i} as the absolute difference between the actual label y_{i} and the inferred soft label \ell_{i} : s_{i}=|\ell_{i}^{\star}-y_{i}|. (4) We will now address the problems of isolated examples by setting K=\mathcal{L}(W)+\gamma_{g}I , where we diagonally regularize the graph Laplacian. Intuitively, such a regularization lowers the confidence value |\ell_{i}^{\star}| of all examples; however it reduces the confidence score of outlier points relatively more. In the fully labeled setting, the hard harmonic solution ( Zhu et al. 2003 ) degenerates to the weighted k -NN. To alleviate this problem, we allow labels to spread on the graph by using soft constraints in the unconstrained regularization problem ( 1 ). In particular, instead of c_{l}=\infty we set c_{l}

Read the complete text