Novelty detection on path space
Ioannis Gasteratos [email protected], Antoine Jacquier [email protected], Maud Lemercier [email protected], Terry Lyons [email protected], Cristopher Salvi [email protected] · 2025
Read Novelty detection on path space by Ioannis Gasteratos [email protected], Antoine Jacquier [email protected], Maud Lemercier [email protected], Terry Lyons [email protected], Cristopher Salvi [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03243.txt.
Introduction
Telling new behavior from normal behavior is a core task in data work. Ioannis Gasteratos and co-authors frame that task on path space in this 2025 work. Paths are sequences over time, like price curves or motion traces.
They treat novelty detection as a hypothesis test with signature-based statistics. Signatures summarize a path in a compact way. Using cost inequalities, they bound false positive rates beyond the Gaussian case. Reliable novelty flags help in finance, medicine, and engineering, where rare events can signal trouble. Tail bounds matter, since a novelty alarm that fires too often soon gets ignored.
Catalog record
| CREATOR | Ioannis Gasteratos [email protected], Antoine Jacquier [email protected], Maud Lemercier [email protected], Terry Lyons [email protected], Cristopher Salvi [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-03243
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Novelty detection on path space Ioannis Gasteratos [email protected], Antoine Jacquier [email protected], Maud Lemercier [email protected], Terry Lyons [email protected], Cristopher Salvi [email protected] Abstract We frame novelty detection on path space as a hypothesis testing problem with signature-based test statistics. Using transportation-cost inequalities of 28 , we obtain tail bounds for false positive rates that extend beyond Gaussian measures to laws of RDE solutions with smooth bounded vector fields, yielding estimates of quantiles and p-values. Exploiting the shuffle product, we derive exact formulae for smooth surrogates of conditional value-at-risk (CVaR) in terms of expected signatures, leading to new one-class SVM algorithms optimising smooth CVaR objectives. We then establish lower bounds on type- II \mathrm{II} error for alternatives with finite first moment, giving general power bounds when the reference measure and the alternative are absolutely continuous with respect to each other. Finally, we evaluate numerically the type- I \mathrm{I} error and statistical power of signature-based test statistic, using synthetic anomalous diffusion data and real-world molecular biology data. Ioannis Gasteratos, Antoine Jacquier, Maud Lemercier, Terry Lyons, Cristopher Salvi † † heading: 23 2025 1- NA NA NA † † shortheadings: Novelty detection on path space / † † firstpage: 1 † † editor: My editor keywords Anomaly detection, hypothesis testing, signature features, rough paths MSC 2020: 60L10, 60L20, 62M07 1 Introduction Determining whether an observed trajectory is consistent with a reference process is a fundamental novelty detection problem, with applications ranging from detecting unusual particle motion in biological cells ( 54 ) to identifying rare astronomical signals in telescope data ( 83 ) and detecting malicious activities in network traffic ( 18 ) . Most existing approaches cast this as one-class classification on time series data and focus primarily on feature engineering or representation learning to obtain suitable embeddings ( 43 ; 86 ) . In this paper, we frame trajectory-based novelty detection as a hypothesis testing problem on path space. The goal is to test whether an observed path X:[0,T]\to\mathbb{R}^{d} is drawn from a reference measure \mu representing normal behaviour, or from an alternative distribution \nu\neq\mu , i.e. we want to test the null hypothesis \displaystyle H_{0}:X\sim\mu\text{ against }H_{1}:X\sim\nu\neq\mu, where \nu and \mu are two distributions on some space of paths \mathcal{X}\subset C([0,T];\mathbb{R}^{d}),T>0 . To perform this hypothesis test, we map each sample path X to a scalar statistic via a map f:\mathcal{X}\to\mathbb{R} which takes the form f(X)=\langle w,S(X)\rangle where w\in T((\mathbb{R}^{d})^{*}) is a linear functional acting on the signature of the process, given by the formal tensor series of iterated integrals \displaystyle S(X)=1+\sum_{k=1}^{\infty}S^{k}(X)\in T((\mathbb{R}^{d})),\text{ with }S^{k}(X)=\int_{0<t_{1}<\cdots<t_{k}<T}dX_{t_{1}}\otimes\cdots\otimes dX_{t_{k}}, and \langle\cdot,\cdot\rangle denotes the natural pairing between the infinite formal series T((\mathbb{R}^{d}))=\prod_{k=0}^{\infty}(\mathbb{R}^{d})^{\otimes k} and the finite sequences in T((\mathbb{R}^{d})^{*})=\bigoplus_{k=0}^{\infty}((\mathbb{R}^{d})^{\otimes k})^{*} . The null hypothesis H_{0} is rejected if the observed path X belongs to the rejection region \Omega_{r} of the form X\in\Omega_{r}\iff\langle w,S(X)\rangle>r. (1.1) This framework entails two types of errors. If X\sim\mu , but H_{0} is rejected based on ( 1.1 ), the test incurs a type- \mathrm{I} error. The probability of making such an error—the false positive rate—is given by \alpha:=\mu(x\in\Omega_{r}) . Conversely, if X\sim\nu\neq\mu , but H_{0} is not rejected based on ( 1.1 ), a type- \mathrm{II} error occurs, with probability \beta:=\nu(x\not\in\Omega_{r}) . The power of our test against the alternative \nu is given by 1-\beta . The central challenge is to choose the linear functional w and the threshold r to achieve high power against a broad class of alternative distributions \nu on \mathcal{X} , while maintaining a fixed significance level \alpha\in[0,1] (i.e., controlling the probability of type- \mathrm{I} error). In statistical hypothesis testing, the test can equivalently be formulated in terms of p-values. Specifically, it is common to report the probability of obtaining test results at least as extreme as the result actually observed, as a measure of significance of the test (here, evidence of path X being a novelty) rather than whether or not the null hypothesis was rejected at a pre-determined level of significance \alpha . Regarding critical value selection, the threshold r corresponding to a given significance level \alpha is determined by r(\alpha)=Q_{f(X)}(1-\alpha) , the (1-\alpha) -quantile of the null distribution of the test statistic f(X) . The \alpha -quantile of a real-valued random variable Z with law P_{Z} is defined as Q_{Z}(\alpha):=\inf\{r\in\mathbb{R}\mid P_{Z}(z\leq r)\geq\alpha\}. In risk management contexts, quantiles are also known as values at risk. In the sequel they will be denoted by VaR {}_{\alpha}(Z). If the cumulative distribution function F of the random variable f(X) under the null hypothesis is continuous, this reduces to the relation r(\alpha)=F^{-1}(1-\alpha) . However, in general, for a given measure \mu on \mathcal{X} and test statistic f:\mathcal{X}\to\mathbb{R} the distribution of f(X) is not available in closed form. Therefore, it is rarely possible to conduct the above test. A common workaround is to use a calibration sample X^{(1)},\ldots,X^{(n)}\overset{\text{i.i.d.}}{\sim}\mu and the corresponding empirical estimator F_{n}(f(x))=\frac{1}{n}\sum_{i=1}^{n}\mathds{1}\{f(X^{(i)})\leq f(x)\} to determine the critical value of the test. While simple and widely used, this approach comes with important caveats ( 7 ) . Conditioned on a fixed calibration set, the false positive rate may exceed the target level \alpha ; it is only guaranteed to be controlled marginally over calibration sets. Moreover, when empirical p-values are used, the dependencies introduced by sharing the same calibration set can invalidate certain multiple testing procedures, such as Fisher’s combination test. These limitations are especially relevant in novelty detection applications on data streams, where practitioners must often test multiple data segments sequentially. For instance, in radio astronomy, the task of identifying radio-frequency interference (RFI) in telescope visibility measurements involves repeatedly testing thousands of short time-frequency windows for anomalies ( 5 ) . A similar challenge arises in biological signal analysis, where electrical readouts from RNA molecules are scanned segment by segment to identify potential chemical modifications ( 40 ) . A solution is to derive an upper bound on the tail probabilities of the test statistic, ensuring that the rejection threshold controls the false positive rate regardless of the calibration sample, or with high probability over the sample. Regarding the choice of score function (one-class classifier) f:\mathcal{X}\to\mathbb{R} , it is important to ensure that the test has high statistical power, i.e. is effective at flagging outliers. Since the signature has the universal approximation property on compact subsets of \mathcal{X} (the set of functions of the form f(x)=\langle w,S(x)\rangle is dense in the set of continuous functions on any such compact subset), the class of test statistics we consider is extremely rich ( 4 ) . Leveraging this universal approximation property and other algebraic features, signature methods have rapidly gained traction across domains such as quantitative finance ( 57 ; 21 ; 1 ; 21 ; 10 ) , cybersecurity ( 18 ) , information theory ( 68 ; 65 ; 72 ) , and quantum computing ( 20 ) . They underpin universality results for neural differential equations ( 49 ; 3 ) and state-space models (SSMs) ( 51 ; 52 ; 80 ) . In generative modelling, signatures have been used to synthesise financial time series ( 12 ) , act as universal nonlinearities in Seq2Seq models ( 36 ) , and provide representation spaces for training score-based diffusion models ( 6 ) . An introduction to signature