Sequential Change Point Detection via Denoising Score Matching

Wenbin Zhou, Liyan Xie, Zhigang Peng, Shixiang Zhu · 2025

Read Sequential Change Point Detection via Denoising Score Matching by Wenbin Zhou, Liyan Xie, Zhigang Peng, Shixiang Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12667.txt.

Introduction

Wenbin Zhou, Liyan Xie, Zhigang Peng, and Shixiang Zhu wrote this paper in two thousand twenty-five. It spots the moment a data stream's pattern shifts, by way of score matching with noise.

Classic change-point tools lean on set forms for the data before and after the shift. That fails on rich, high-dimensional streams. Here the score of the data law is learned by adding noise, then cleaning it back, a trick called denoising score matching. A CUSUM test runs on those scores, in both offline and online forms. Theory shows the noise scale can be tuned to sharpen the catch. Tests on fake data and on quake precursor hunts back the claim.

Catalog record

CREATORWenbin Zhou, Liyan Xie, Zhigang Peng, Shixiang Zhu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12667

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sequential Change Point Detection via Denoising Score Matching Wenbin Zhou, Liyan Xie, Zhigang Peng, Shixiang Zhu Abstract Sequential change-point detection plays a critical role in numerous real-world applications, where timely identification of distributional shifts can greatly mitigate adverse outcomes. Classical methods commonly rely on parametric density assumptions of pre- and post-change distributions, limiting their effectiveness for high-dimensional, complex data streams. This paper proposes a score-based CUSUM change-point detection, in which the score functions of the data distribution are estimated by injecting noise and applying denoising score matching. We consider both offline and online versions of score estimation. Through theoretical analysis, we demonstrate that denoising score matching can enhance detection power by effectively controlling the injected noise scale. Finally, we validate the practical efficacy of our method through numerical experiments on two synthetic datasets and a real-world earthquake precursor detection task, demonstrating its effectiveness in challenging scenarios. I Introduction Sequential change point detection is a fundamental statistical problem that aims to identify the exact moment when the underlying distribution of a sequential data stream undergoes a structural change [ 1 , 2 , 3 ] . This capability is critical in various real-world applications where detecting and reacting to changes in real time can have significant implications. For example, change point detection is vital in financial markets to identify regime shifts [ 4 , 5 ] , in manufacturing to detect system faults [ 6 ] , and in epidemic control to detect the onset of outbreaks or shifts in infection trends [ 7 ] . Recent advances in sensor technology and signal processing have opened up new opportunities to uncover the intricate dynamics of change in various domains. For instance, in seismology, recent development and application of advanced earthquake detection techniques such as template matching and machine learning have resulted in an exponential growth in the quantity and quality of seismic records [ 8 , 9 ] . These enriched datasets are critical for advancing our understanding of earthquake precursors [ 10 ] – an elusive yet transformative goal that could enable early warnings for catastrophic major earthquakes and significantly mitigate their impacts. While so far no reliable earthquake precursors have been identified [ 11 , 12 , 13 ] , there is a renewed interest in studying them, largely driven by improved dense near-field geophysical observations, availability of big data and new development in machine learning methods in earthquake science [ 8 , 9 , 14 ] . As data streams become increasingly complex and high-dimensional, there is a growing need for more robust and scalable change point detection frameworks [ 15 ] . Many traditional techniques are grounded in modeling the log-likelihood of pre- and post-change distributions, which often involve parametric assumptions on density functions [ 16 , 17 ] . While effective in certain scenarios, these assumptions can pose challenges in capturing the nuances of high-dimensional, interdependent data. This may limit their applicability in modern settings where distributional changes tend to be subtle, non-linear, and situated in complex data spaces that are not easily represented by simple parametric models [ 18 , 19 ] . In this paper, we propose a novel framework for sequential change point detection based on denoising score matching, a method that has demonstrated success in learning deep generative models [ 20 , 21 ] . The most salient feature of this approach is that it avoids parametric assumptions on the pre- and post-change distributions. Instead, we adopt a score network to learn the underlying distributions in a fully data-driven manner. To address the challenge of detecting subtle changes in regions of the data space where samples are scarce, we adopt a denoising strategy [ 22 ] . By injecting controlled noise into the data, this strategy encourages the score network to explore underrepresented regions of the data distribution, improving its ability to detect changes. Furthermore, we develop a theoretical framework to quantify the tradeoff between the injected noise level and the score estimation accuracy. Our analysis reveals that careful selection of the noise level can minimize the error of the estimated distributional change and enable the score network to achieve robust detection performance. Our framework is validated through experiments on both synthetic and real-world datasets, demonstrating its capability to detect changes in complex, high-dimensional data distributions. Our main contributions are summarized as follows: ( i ) We propose a novel change point detection algorithm based on denoising score matching; ( ii ) We provide theoretical insights on the detection efficiency of the proposed method, and demonstrate the tradeoff on the level of injected noise; ( iii ) We validate the proposed method on both synthetic and real datasets, and demonstrate its superior performance against the state-of-the-art approaches. Related work . Classical sequential change detection methods [ 3 , 23 , 2 , 24 ] can be categorized into parametric and non-parametric approaches. Parametric methods estimate the parametric post-change distribution during the detection process, such as the generalized likelihood ratio (GLR) test [ 25 , 16 ] and window-limited tests [ 17 ] . Nonparametric methods circumvent the need for explicit distributional assumptions and have been developed using techniques such as kernel density estimation [ 26 , 27 ] and kernel-based distances [ 18 , 19 ] . Recent advancements have introduced novel perspectives on change point detection. One notable development is the exact score-based detection method proposed by [ 28 ] , which utilizes the Hyvärinen score to detect changes in known unnormalized distributions, offering an alternative to the traditional log-likelihood approach. At the same time, neural network-based methods [ 29 , 30 ] have broadened the applicability of change point detection to settings with unknown and complex distributions through likelihood-based CUSUM techniques. Building upon these advancements, our proposed method bridges the gap between score-based and neural network-based approaches. By effectively leveraging the flexibility of neural networks to parametrize unnormalized models, our approach achieves a robust and computationally efficient solution for detecting change points in complex, high-dimensional settings. II Problem Setup Denote \mathcal{X} as the (possibly high-dimensional) continuous sample space of the observed data. Let p_{0},p_{1} be two distinct 1 1 1 By “distinct” we mean that p_{0} and p_{1} must be different on a set in \mathcal{X} with non-zero Lebesgue measure. and unknown probability distributions on \mathcal{X} . Given data sequence \{x_{t}\in\mathcal{X},t\in\mathbb{N}\} , we suppose that the data-generating distribution changes from p_{0} to p_{1} at some unknown (but deterministic) change-point \nu , i.e., \begin{array}[]{ll}x_{t}\stackrel{{\scriptstyle\text{iid}}}{{\sim}}p_{0},&k=1,2,\ldots,\nu-1,\\ x_{t}\stackrel{{\scriptstyle\text{iid}}}{{\sim}}p_{1},&k=\nu,\nu+1,\ldots\end{array} (1) The objective is to detect the unknown change-point \nu as quickly as possible while controlling the false alarm rate. Such detection is usually performed by designing a stopping time T on the observation sequence at which it is declared that a change has occurred [ 24 ] . The performance of a stopping time T is measured by its average run length (ARL) and worst-case average detection delay (WADD) . The ARL measures the average time to false alarms and is defined as \mathrm{ARL}:=\mathbb{E}_{\infty}[T] , where \mathbb{E}_{\infty} denotes the expectation under the probability measure when no change occurs. WADD is defined as \mathrm{WADD}:=\underset{\nu\geq 1}{\operatorname{\sup}}\esssup\ \mathbb{E}_{\nu}\left[(T-\nu+1)^{+}|x_{1},\ldots,x_{\nu-1}\right], where \mathbb{E}_{\nu} is the expectation when the change-point equals \nu , and the essential supremum is taken over all possible

Read the complete text