Score-Based Quickest Change Detection and Fault Identification for Multi-Stream Signals

Wuxia Chen, Sean Moushegian, Vahid Tarokh, Taposh Banerjee · 2025

Read Score-Based Quickest Change Detection and Fault Identification for Multi-Stream Signals by Wuxia Chen, Sean Moushegian, Vahid Tarokh, Taposh Banerjee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03967.txt.

Introduction

Wuxia Chen, Sean Moushegian, Vahid Tarokh, and Taposh Banerjee propose min-SCUSUM for quickest change detection and fault isolation across many data streams when models are unnormalized or score-based. Classic optimal methods need explicit before-and-after distributions for likelihood ratios, which can be costly or impossible for complex learned models.

Their method replaces log-likelihood ratios with differences of Hyvarinen score functions. Delay and false alarm analysis shows asymptotic performance governed by Fisher divergence between the distributions before and after the change. A bound on the chance of blaming the wrong stream is also established. The approach suits multi-stream monitoring where only scores, not full densities, are available.

Catalog record

CREATORWuxia Chen, Sean Moushegian, Vahid Tarokh, Taposh Banerjee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-03967

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Score-Based Quickest Change Detection and Fault Identification for Multi-Stream Signals Wuxia Chen, Sean Moushegian, Vahid Tarokh, Taposh Banerjee Abstract This paper introduces an approach to multi-stream quickest change detection and fault isolation for unnormalized and score-based statistical models. Traditional optimal algorithms in the quickest change detection literature require explicit pre-change and post-change distributions to calculate the likelihood ratio of the observations, which can be computationally expensive for higher-dimensional data and sometimes even infeasible for complex machine learning models. To address these challenges, we propose the min-SCUSUM method, a Hyvärinen score-based algorithm that computes the difference of score functions in place of log-likelihood ratios. We provide a delay and false alarm analysis of the proposed algorithm, showing that its asymptotic performance depends on the Fisher divergence between the pre- and post-change distributions. Furthermore, we establish an upper bound on the probability of fault misidentification in distinguishing the affected stream from the unaffected ones. I Introduction Detecting abrupt changes in the statistical characteristics of sequentially acquired data is a critical problem that spans a wide spectrum of applications, including power system transmission outage [ 1 ] , quality control [ 2 ] , target identification [ 3 ] , biology [ 4 ] , and more. In statistics, this problem is formulated as the problem of quickest change detection (QCD), where the goal is to detect a change in the distribution of a sequence of random variables as swiftly as possible while controlling the rate of false alarms [ 5 ] . One of the most prominent algorithms for QCD is the Cumulative Sum (CUSUM) algorithm [ 6 ] , which is particularly effective in the context of independent and identically distributed (i.i.d.) data before and after the change. The CUSUM algorithm is not only practical due to its recursive structure but also theoretically optimal in minimizing the worst-case detection delay, as described by Lorden’s criterion [ 7 ] , while adhering to a predefined false alarm rate [ 8 ] . For an overview of QCD and other optimal algorithms, we refer to [ 9 , 10 , 11 , 12 , 13 ] . The CUSUM and other optimal algorithms from the QCD literature depend explicitly on knowing both pre- and post-change distributions, a task that becomes computationally intensive with high-dimensional data or when explicit distributions are not readily available. For instance, in machine learning applications involving energy-based models [ 14 ] or score-based deep generative models [ 15 ] , computing the necessary likelihood ratios for these algorithms can be particularly demanding. To address this issue, the authors in [ 16 , 17 ] developed a score-based approach to QCD using the Hyvärinen score of the probability densities. These score-based algorithms can be applied to data where the densities are available in unnormalized or score-based forms, which is the situation frequently encountered in machine learning applications. In many real-world applications, it is not only important to detect changes quickly but also to accurately identify the nature of the change. This dual objective leads to the problem of sequential change diagnosis, where the goal is to determine the correct post-change distribution among several possibilities once a change has been detected. This problem has also been studied extensively in the literature [ 18 , 19 , 20 , 21 , 10 , 11 ] , often leading to algorithms that are computationally hard to implement. In a recent work [ 22 ] , however, the authors have shown that a popular and computationally efficient min-CUSUM algorithm is also asymptotically optimal for a well-defined problem formulation. In the min-CUSUM algorithm, when there are a finite number of post-change alternatives, the CUSUM statistic is calculated for each alternative. A change is declared when any one of the CUSUM statistics crosses a threshold. The post-change distribution corresponding to the CUSUM statistic that triggered the alarm is identified as the true post-change distribution. While the min-CUSUM algorithm is computationally efficient and optimal, it cannot be applied to high-dimensional data, where the precise form of the distributions is not available. Consider the problem of anomaly detection using parallel video streams. Here, the goal is to detect an anomaly in the sequence of images in each camera. Once an anomaly has been detected, we need to identify the video stream where the anomaly was seen. This problem has applications, for example, in military surveillance and traffic data. Because of the high-dimensional nature of the images, the statistical density of the images is intractable to learn. As a result, the min-CUSUM algorithm from [ 22 ] cannot be applied to this problem. In this paper, we propose the min-SCUSUM algorithm, a Hyvärinen score-based modification of the min-CUSUM algorithm, for QCD and fault isolation in multi-stream data. The min-SCUSUM algorithm is obtained by replacing the log likelihood ratios in the min-CUSUM algorithm by differences of Hyvärinen scores (see Section IV ). The Hyvärinen scores can be learned directly from data using neural networks [ 15 ] [ 23 ] . In this paper, we also analyze the delay, false alarm, and fault identification performance of the min-SCUSUM algorithm. We note that many aspects of our analysis are novel since the classical methods of analysis employed in [ 22 ] must be modified because the min-SCUSUM algorithm is no longer based on likelihood ratios. Finally, we apply our algorithm to an anomaly detection application for video data. To summarize, the main contributions of our paper are as follows: • We propose the min-SCUSUM algorithm, a new multi-stream QCD algorithm designed for quickest detection and fault identification in unnormalized and score-based models. The algorithm replaces the negative log-likelihood terms in CUSUM with a multiple of the differences of Hyvärinen scores. • We provide a detailed analysis of the delay and false alarm performance of the min-SCUSUM algorithm in the i.i.d. setting, showing that it achieves asymptotic optimality under certain conditions. • We give an upper bound on the probability of mis-identification given that there is no false alarm, and further validate the bound in a numerical experiment using synthesized high-dimensional data, where the empirical misidentification probabilities remain below the theoretical upper bound. • Finally, we apply our algorithm to detect changes in multi-channel video streams generated from real-world videos, demonstrating its effectiveness in a high-dimensional data environment. While there can be several ways to detect and isolate anomalies in video data, we remark that our proposed algorithm works for arbitrary high-dimensional data, not just image data. Moreover, we provide an algorithm with provable performance guarantees on delay, false alarm rate, and the probability of mis-identification. The rest of the paper is organized as follows: In Section II , we formulate the quickest change detection and the fault isolation problem. In Section III , we review the Hyvärinen score and the score-based change detection algorithm from [ 16 ] . In Section IV , we introduce the min-SCUSUM algorithm, an algorithm for score-based fault detection and identification. In Section V , we analyze the delay, false alarm, and mis-identification performance of the min-SCUSUM algorithm. In Section VI , we apply the algorithm to real video data and simulated high-dimensional data to verify its effectiveness. I-A Related Work Quickest change detection (QCD) in

Read the complete text