Manifold-regularised Large-Margin ℓ p \ell_{p} -SVDD for Multidimensional Time Series Anomaly Detection

Shervin Rahimzadeh Arashloo · 2025

Read Manifold-regularised Large-Margin ℓ p \ell_{p} -SVDD for Multidimensional Time Series Anomaly Detection by Shervin Rahimzadeh Arashloo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23449.txt.

Introduction

Shervin Rahimzadeh Arashloo presents a method for spotting odd patterns in streams of data that change over time, in a paper from 2025. The catalog title differs from the title printed in the text; the text's version names signature-kernel one-class learning. The method learns what normal data looks like and flags what strays. Older tools compare data point by point and miss the shape of the whole path.

His method reads each series as a path, using a kernel built for that view. It also adds a penalty that respects how normal data clusters in space. The math keeps the same form as the base method, so old solvers still run. Tests on five known benchmark sets place the method near the top of the field. It also handles unevenly spaced samples, which real sensors often produce.

Catalog record

CREATORShervin Rahimzadeh Arashloo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23449

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Manifold-regularised Large-Margin ℓ p \ell_{p} -SVDD for Multidimensional Time Series Anomaly Detection Shervin Rahimzadeh Arashloo Abstract We generalise the recently introduced large-margin ℓ p \ell_{p} -SVDD approach to exploit the geometry of data distribution via manifold regularising for time series anomaly detection. Specifically, we formulate a manifold-regularised variant of the ℓ p \ell_{p} -SVDD method to encourage label smoothness on the underlying manifold to capture structural information for improved detection performance. Drawing on an existing Representer theorem, we then provide an effective optimisation technique for the proposed method. We theoretically study the proposed approach using Rademacher complexities to analyse its generalisation performance and also provide an experimental assessment of the proposed method across various data sets to compare its performance against other methods. 1 Introduction The concept of regularisation has a rich mathematical background and plays a fundamental role in various machine learning algorithms. The reasoning behind the idea is to encourage the model to be situated within a more confined region of all potential solutions by injecting supplementary prior knowledge or assumptions to enhance its representational capability. Among others, manifold regularisation (MR) [ 1 ] has been introduced as a mechanism to leverage the geometry of the probability distribution of the data as an additional source of information for function learning. The motivation supporting the idea is based on the assumption that if two points are close in the inherent geometry of the probability distribution that governs the production of examples, it is probable that they will share similar labels. In other words, the labels generally change gradually along the geodesics of the underlying distribution and manifold regularisation tries to benefit from such geometric smoothness assumptions to derive a better solution. While typically used in unsupervised or semi-supervised learning scenarios, MR can also provide advantages within a fully supervised framework. In a fully supervised setting, although labeled samples are utilised for optimisation, these labels alone may not be able to entirely capture the intricate geometric relationships present in high-dimensional or structured data, such as those in time series or sequential observations. On the other hand, since manifold regularisation introduces a geometric prior that promotes consistency between the learned classifier and the inherent structure of the data distribution, it possesses the potential to serve as a useful tool in fully supervised settings. The idea is especially beneficial for detecting anomalies in time series data where normal sequences usually adhere to smooth, low-dimensional dynamic patterns, while anomalies tend to depart from these anticipated paths. In this context, manifold regularisation can capture the regularities in the data by applying constraints that promote conformity to the manifold of normal behavior, thus potentially boosting anomaly detection performance. The idea of manifold regularisation is expansive and has been applied across different learning algorithms, including deep learning approaches. Although deep learning-based methods have improved the performance significantly in different domains and have witnessed increasing attention in recent years, one alternative to these approaches may be considered as kernel-based algorithms [ 2 ] . As compared with deep learning methods, kernel approaches are based on sound mathematical basis and provide theoretical guarantees on their generalisation performance. Furthermore, in the case of a scarcity of training samples, deep learning approaches offer restricted, if any, advantages. In contrast, kernel methods may be trained with much fewer training observations to achieve outstanding performances in different learning scenarios. Among other kernel-based approaches, the method in [ 3 ] presents an effective approach for anomaly detection, outperforming some other alternatives in different anomaly detection problems. Compared to other approaches, the merits of the method presented in [ 3 ] that generalises the well-known SVDD formalism [ 4 ] for outlier detection may be summarised as follows. First, instead of a linear penalty for classification errors, the method in [ 3 ] introduces an \ell_{p\geq 1} -norm cost which enables the model to non-linearly penalise errors in the primal space. The norm penalty in the primal space, corresponds to a norm constraint in the dual space formulation that controls the sparsity of the solution, yielding enhanced adaptability for improved performance. Second, the method in [ 3 ] explicitly maximises the margin between target and non-target samples, thus improving the generalisation capability of the approach. And last but not least, it solves the corresponding optimisation problem via an efficient algorithm tailored to the specific structure of the problem, ensuring improved performance. Despite its remarkable qualities, the large-margin \ell_{p} -SVDD method in [ 3 ] has a number of limitations. First, it does not explicitly capture and benefit from the underlying structural information of data distribution to learn an optimal classifier. This may compromise the anomaly detection performance when dealing with highly structured data with inherent correlation characteristics such as time series or sequential data. Second, conventional kernels such as the Radial Basis Function (RBF) or linear kernel used in [ 3 ] , rely on static, pointwise comparisons, and are thus not only incapable of dynamically capturing a path’s evolution, but also fail to convey a fine representation of nonlinear dependencies and higher-order interactions across multiple dimensions. Additionally, they lack invariance to time reparametrisation, a crucial property for robustness against irregular sampling and distortions along the time axis. Furthermore, when the sequential data are of different lengths, these static kernel are not directly applicable, necessitating additional intermediate warping steps. Driven by these observations, in this work, we generalise the large-margin \ell_{p} -SVDD method [ 3 ] for time series anomaly detection. To this end, our framework exploits the geometry of the data manifold, encoding it as an additional regularisation term. This is intuitive as time series data typically incorporates densely sampled instances through time which increases the possibility of local correlation in the data and the associated labels. In this context, we elaborate on the RKHS (reproducing kernel Hilbert space) formulation of the method in [ 3 ] and illustrate how the geometry of data manifold may be incorporated into the model through a manifold regularisation term to impose structure on the classifier learned to ensure smoothness with regards to the distribution of the data. In particular, we illustrate how the proposed approach sits in a well established Representer theorem presented in [ 1 ] to derive the functional form of the optimal solution. By forming the dual optimisation task, we show that the learning problem of the proposed method resembles that of the method in [ 3 ] with a difference in the effective kernel matrix. As such, the optimisation techniques developed in [ 3 ] become applicable to the proposed technique. Second, as static kernels used in [ 3 ] fall short in capturing the complex structure of time series data, in this work, we resort to more advanced kernel functions, and specifically the signature kernel developed for sequential data analysis. The signature kernel is a powerful mathematical framework for time series analysis, uniquely designed to capture the rich temporal and multivariate structure of sequential data encoding both local and global dependencies within the data stream. We shall illustrate that the signature kernel is especially useful in time series anomaly detection within the proposed approach via extensive evaluations on multiple data sets. In this context, we benefit from a recent theoretical advancement

Read the complete text