Towards One-for-All Anomaly Detection for Tabular Data

Shiyuan Li, Yixin Liu, Yu Zheng, Xiaofeng Cao, Shirui Pan, Heng Tao Shen · 2026

Read Towards One-for-All Anomaly Detection for Tabular Data by Shiyuan Li, Yixin Liu, Yu Zheng, Xiaofeng Cao, Shirui Pan, Heng Tao Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14407.txt.

Introduction

Li and co-authors present OFA-TAD, a one-for-all detector for anomalies in tabular data. Older detectors train one model per dataset, which costs much and travels poorly. Their framework trains once on many source sets, then runs on new domains with no fresh training. Neighbor-distance patterns act as the portable cue, read through several distance views. A mixture-of-experts scorer fuses the views, and synthetic anomalies support the one-class training. Tests span 34 datasets in 14 domains.

Catalog record

CREATORShiyuan Li, Yixin Liu, Yu Zheng, Xiaofeng Cao, Shirui Pan, Heng Tao Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74229
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14407

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards One-for-All Anomaly Detection for Tabular Data Shiyuan Li, Yixin Liu, Yu Zheng, Xiaofeng Cao, Shirui Pan, Heng Tao Shen Abstract Tabular anomaly detection (TAD) aims to identify samples that deviate from the majority in tabular data and is critical in many real-world applications. However, existing methods follow a “one model for one dataset (OFO)” paradigm, which relies on dataset-specific training and thus incurs high computational cost and yields limited generalization to unseen domains. To address these limitations, we propose OFA-TAD, a generalist one-for-all (OFA) TAD framework that only requires one-time training on multiple source datasets and can generalize to unseen datasets from diverse domains on-the-fly. To realize one-for-all tabular anomaly detection, OFA-TAD extracts neighbor-distance patterns as transferable cues, and introduces multi-view neighbor-distance representations from multiple transformation-induced metric spaces to mitigate the transformation sensitivity of distance profiles. To adaptively combine multi-view distance evidence, a Mixture-of-Experts (MoE) scoring network is employed for view-specific anomaly scoring and entropy-regularized gated fusion, with a multi-strategy anomaly synthesis mechanism to support training under the one-class constraint. Extensive experiments on 34 datasets from 14 domains demonstrate that OFA-TAD achieves superior anomaly detection performance and strong cross-domain generalizability under the strict OFA setting. github.com/Shiy-Li/OFA-TAD 1 Introduction (a) (b) Figure 1 : The difference between OFO and OFA paradigm. Tabular data anomaly detection (TAD) aims to identify anomalies that significantly deviate from the majority of normal samples in tabular data ( 13 ) . As the volume of tabular data continues to grow, TAD is crucial for various scientific and industrial processes, including medical disease diagnosis ( 9 ) , cybersecurity ( 2 ) , and financial fraud detection ( 3 ) . Conventional TAD methods, such as Isolation Forest (IForest) and Local Outlier Factor (LOF), rely on handcrafted heuristics and often struggle to capture complex non-linear relationships ( 15 ) . Recently, deep learning-based approaches have acquired improved performance by learning in a one-class setting with only normal data only, using various unsupervised objectives to model intrinsic irregularities of the data distribution and identify anomalous samples as deviations ( 21 ; 27 ; 25 ) . (a) (b) Figure 2 : The distance varies in different transformations, where R: Raw, S: Standardized, and Q: Quantile. To date, most existing TAD methods adopt a “one model for one dataset (OFO)” paradigm, where a dedicated TAD model is built and trained for each dataset independently, as shown in Figure 1(a) . Despite their strong in-domain performance, this paradigm poses major barriers to practical real-world deployment: ❶ Prohibitive training cost. For every new domain or dataset, the OFO paradigm requires training a detector from scratch, and often incurs costly hyperparameter search or even architecture re-design to achieve satisfactory performance. This requirement leads to substantial computation and operational overhead and makes large-scale rollout expensive in real-world scenarios. ❷ Poor generalizability. OFO models often overfit to the source-data distribution and hence transfer poorly to unseen data. Hence, they struggle to generalize to new scenarios and cannot effectively handle distribution shifts, resulting in unreliable performance after deployment. A promising solution to these limitations is to embrace a “one model for all datasets (OFA)” paradigm, which aligns with the recent surge of foundation models and artificial general intelligence. As shown in Figure 1(b) , in the OFA paradigm, a single generalist TAD model is trained once on multiple-source datasets, and then it can be directly transferred to unseen datasets without any target-domain retraining or finetuning. Compared to its OFO counterpart, the OFA paradigm eliminates dataset-specific dependence by consolidating heterogeneous data patterns into a unified detector, and hence reduces computational redundancy while improving robustness and adaptability of the TAD model. Despite the growing success of generalist OFA models in anomaly detection for other modalities (e.g., images ( 31 ) and graphs ( 29 ; 28 ; 16 ; 17 ; 20 ) ), building an OFA tabular anomaly detector still remains under-explored. A primary obstacle is the “ semantic gap ”: tabular data from diverse domains differ in dimensionality and feature semantics, and thus anomaly patterns are often domain-specific rather than universal. For example, medical anomalies may manifest as atypical physiological measurements (e.g., blood pressure and heart rate), whereas financial anomalies are reflected in irregular transaction behaviors (e.g., amounts and balances). As a result, a detector can easily rely on cues that work well in one domain but break when transferred to a new domain. This motivates the first challenge: Challenge 1 - How to discover transferable anomaly patterns that hold across domains? To address this challenge, we argue that transferable anomaly patterns should be grounded in universal neighborhood structures, which remain meaningful even when feature semantics vary across domains. At its core, anomaly detection aims to identify samples that are more isolated than normal points, i.e., those that lie unusually far from their local neighborhood ( 11 ) . In this case, we can capture this isolation by the “ neighbor distance ” profile (i.e., the Top- k nearest-neighbor distance sequences) and use it as a semantics-agnostic representation to capture transferable anomaly patterns. For example, a patient record with abnormal vital signs or a fraudulent transaction with irregular spending behavior may both deviate from the bulk of normal samples; consequently, their Top- k distance sequences often exhibit a pronounced elbow and a heavy tail, indicating the shared distance-level anomaly signature. While the neighbor distance patterns are potentially transferable, the distance distributions can be highly sensitive to the feature transformations applied to the raw tabular data, which may undermine cross-domain generalization. Due to the heterogeneous scale and distribution of tabular features, feature transformations (e.g., normalization and standardization) are a common pre-processing step for TAD. Nevertheless, the selection of transformations can significantly change the neighborhood structure and distance distribution. As shown in Figure 2(a) , the Top- k nearest-neighbor overlap of the same sample under different transformations can be remarkably low, indicating that transformations reshape the neighbor set and distance ranking. Moreover, Figure 2(b) shows that anomaly separability can vary drastically across transformations, and the optimal transformation differs considerably across datasets. Together, these results demonstrate pronounced transformation sensitivity : different datasets favor different transformations, and a fixed transformation may be insufficient to generalize to all unseen domains. While the OFO methods can leverage prior knowledge or trial-and-error to select a suitable dataset-specific transformation, in OFA settings, the transformations have to be determined automatically without access to target-domain supervision. This leads to the Challenge 2 - How can we construct robust distance representation under suitable transformations without prior knowledge? To address this challenge, we propose OFA-TAD, a multi-view distance-centric learning framework for OFA anomaly detection. Our theme is to treat neighbor-distance profiles under different transformations as complementary data views, and then use a Mixture-of-Experts (MoE) fusion mechanism to adaptively integrate them for robust anomaly scoring. Specifically, we first construct multiple metric spaces induced by different transformations, and for each sample, we extract a multi-view distance profile (Top- k neighbor distance sequences) and encode it into cross-domain comparable representations via distribution normalization. Then, we implement the MoE fusion with view-specific experts that use attention pooling to produce expert scores, while a learned gating network adaptively combines them into the final anomaly score. Additionally, to handle the absence of

Read the complete text