Subject Information Extraction for Novelty Detection with Domain Shifts
Yangyang Qu, Jicong Fan, Dazhi Fu · 2025
Read Subject Information Extraction for Novelty Detection with Domain Shifts by Yangyang Qu, Jicong Fan, Dazhi Fu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21247.txt.
Introduction
Software that flags odd samples as novel often trips when the test data come from a new setting, even if the subject is the same. Yangyang Qu and co-authors tackle that snag in a 2025 paper on novelty detection under domain shift. A photo of the same machine part under new lighting, for instance, may be wrongly flagged as a fault.
Their method pulls the subject's own signal apart from the background variation that carries the domain. It pushes the two representations to share as little information as possible, and it models the background with a deep Gaussian mixture. Detection then runs on the subject signal alone, untouched by background change. In wide tests the method carried over to unseen domains and beat prior approaches by a clear margin, the authors report.
Catalog record
| CREATOR | Yangyang Qu, Jicong Fan, Dazhi Fu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-21247
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Subject Information Extraction for Novelty Detection with Domain Shifts Yangyang Qu, Jicong Fan, Dazhi Fu Abstract Unsupervised novelty detection (UND), aimed at identifying novel samples, is essential in fields like medical diagnosis, cybersecurity, and industrial quality control. Most existing UND methods assume that the training data and testing normal data originate from the same domain and only consider the distribution variation between training data and testing data. However, in real scenarios, it is common for normal testing and training data to originate from different domains, a challenge known as domain shift. The discrepancies between training and testing data often lead to incorrect classification of normal data as novel by existing methods. A typical situation is that testing normal data and training data describe the same subject, yet they differ in the background conditions. To address this problem, we introduce a novel method that separates subject information from background variation encapsulating the domain information to enhance detection performance under domain shifts. The proposed method minimizes the mutual information between the representations of the subject and background while modelling the background variation using a deep Gaussian mixture model, where the novelty detection is conducted on the subject representations solely and hence is not affected by the variation of domains. Extensive experiments demonstrate that our model generalizes effectively to unseen domains and significantly outperforms baseline methods, especially under substantial domain shifts between training and testing data. 1 Introduction Novelty detection ( Markou & Singh 2003 ; Pimentel et al. 2014 ; Sabokrou et al. 2018 ; Pang et al. 2021 ) has received considerable attention for its essential applications in finance, healthcare, and security. In these fields, models must accurately predict in-distribution data and detect out-of-distribution (OOD) inputs, representing novel or unseen cases. Failing to detect such inputs can have serious consequences. OOD detection, often used interchangeably with novelty detection, is also closely related to outlier detection ( Hodge & Austin 2004 ) , anomaly detection ( Chandola et al. 2009 ) , fault detection ( Isermann 1984 ) , and one-class classification ( Khan & Madden 2014 ) . For instance, unsupervised anomaly assumes most or even all training data represent normal behaviour or patterns and identifies the test data with any large deviations as anomalous. Therefore, it can be regarded as a special case of unsupervised novelty detection. Numerous novelty detection methods ( Rumelhart et al. 1986 ; Schölkopf et al. 1999 ; Breunig et al. 2000 ; Liu et al. 2008b ; Schölkopf et al. 2001 ; Ruff et al. 2018 ; Viroli & McLachlan 2019 ; Hu et al. 2020 ; Cai & Fan 2022 ) have been proposed, For classical methods, kernel density estimation (KDE) ( Parzen 1962 ) utilizes a kernel function to estimate the density of data and treats the density as novelty score. OC-SVM ( Schölkopf et al. 2001 ) tries to separate normal data from novel data by a hyperplane. Local outlier factor (LOF) ( Breunig et al. 2000 ) regards data with lower density than its surrounding data as novel data. Autoencoder (AE) ( Hinton & Salakhutdinov 2006 ) uses reconstruction error as a novelty metric. Isolation forest (IF) ( Liu et al. 2008a ) uses the length of iTree to detect novel samples. As for recent state-of-the-art methods, ALAD ( Zenati et al. 2018 ) based on bi-directional GANs, uses reconstruction errors based on these adversarially learned features to determine if a data sample is novel. ( Ruff et al. 2018 ) released DeepSVDD, which utilizes a neural network to enclose the representations of normal data in a hypersphere in the latent space with minimal volume. MO-GAAL ( Liu et al. 2019 ) can directly generate informative potential outliers based on the mini-max game between a generator and a discriminator and n generate a reference distribution for the whole dataset to provide sufficient information to assist the classifier in describing a boundary that can separate novel samples from normal data effectively. DROCC ( Goyal et al. 2020 ) which is on the basis of low-dimensional manifold assumption on normal data, generates negative samples to provide general and robust identification on novel samples. SUOD ( Zhao et al. 2021 ) , which is a comprehensive acceleration framework for novelty (outlier) detection, generates random low-dimensional subspace for base models and uses the output of unsupervised models as pseudo ground truth. PLAD ( Cai & Fan 2022 ) which is based on perturbation learning, learns small perturbations to perturb normal data and learns a classifier to classify the normal data and the perturbed data into two different classes. Then, data classified as perturbed is considered to be novel (anomalous). DIF ( Xu et al. 2023 ) , a deep-learning version of isolation forest ( Liu et al. 2008b ) , enables non-linear partition on subspaces of varying sizes, offering a more effective novelty (anomaly) isolation solution. Figure 1: An illustration of the novelty detection task. The training data (left) consists of images of the digit ’0’ presented in four backgrounds. The testing data (right) includes images of multiple digits (0-9) in seen backgrounds and entirely unseen backgrounds. Although the ’0’ digits in the test set are normal, some of them are likely to be labelled as novel due to the shift in background. A significant limitation of many existing unsupervised novelty detection (UND) methods is that, while they acknowledge the difference in distributions between training and test data, they often assume that both training and normal test data originate from the same domain. However, in real-world scenarios, it is common for normal test data and training data to be sourced from different domains, a challenge referred to as domain shift. For example, training and normal test data may be collected under varying environmental conditions, from different individuals, or at different times. A typical instance of this issue arises when training and test data describe the same subject but differ in background conditions, as illustrated in Figure 1 . Such domain shifts can significantly affect model performance by leading to misclassifications, particularly when the domain differences in the test data are not accounted for during training ( Wu et al. 2023 ) . To address the challenges of domain shift, methods such as domain generalization, empirical risk minimization(ERM) ( Vapnik 1991 ) and invariant risk minimization (IRM) ( Arjovsky et al. 2019 ) have been developed. These approaches generally require task-specific labels (e.g., classification labels) and domain labels to address domain differences in the training data. In some instances, hybrid or auxiliary labels are necessary to further improve model performance. However, labelling domain-specific information for each data point can be resource-intensive. In contrast, our proposed model simplifies this process by only requiring the number of domains from which the data is sourced, reducing the labelling burden. To address the challenge of background (domain) shifts between training and normal test data in unsupervised novelty detection, we propose a novel and effective method called Subject-Novelty Detection (SND). SND disentangles subject information from background features in the training data, allowing the model to focus on subject-specific features during novelty detection. This enables SND to maintain strong performance even when the normal test data exhibits entirely different background characteristics from