UniFault: A Fault Diagnosis Foundation Model from Bearing Data
Emadeldeen Eldele, Mohamed Ragab, Xu Qing, Edward, Zhenghua Chen, Min Wu, Xiaoli Li, Jay Lee · 2025
Read UniFault: A Fault Diagnosis Foundation Model from Bearing Data by Emadeldeen Eldele, Mohamed Ragab, Xu Qing, Edward, Zhenghua Chen, Min Wu, Xiaoli Li, Jay Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01373.txt.
Introduction
Emadeldeen Eldele and co-authors present UniFault, a foundation model for machine fault diagnosis from bearing data, in a research paper from 2025. Fault diagnosis catches machine damage early for planned repair. Past models fit one operation and fail to transfer, since fault data sets are small and mixed, with varied sampling rates and channel counts across systems.
UniFault starts with a data harmonization pipeline that unifies varied inputs into a standard form. The model then learns features that transfer across data sets. Few-shot and zero-shot use are the goals, as with foundation models in vision and language. The design targets robust extraction from diverse bearing signals in real plants.
Catalog record
| CREATOR | Emadeldeen Eldele, Mohamed Ragab, Xu Qing, Edward, Zhenghua Chen, Min Wu, Xiaoli Li, Jay Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01373
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UniFault: A Fault Diagnosis Foundation Model from Bearing Data Emadeldeen Eldele, Mohamed Ragab, Xu Qing, Edward, Zhenghua Chen, Min Wu, Xiaoli Li, Jay Lee Abstract Machine fault diagnosis (FD) is a critical task for predictive maintenance, enabling early fault detection and preventing unexpected failures. Despite its importance, existing FD models are operation-specific with limited generalization across diverse datasets. Foundation models (FM) have demonstrated remarkable potential in both visual and language domains, achieving impressive generalization capabilities even with minimal data through few-shot or zero-shot learning. However, translating these advances to FD presents unique hurdles. Unlike the large-scale, cohesive datasets available for images and text, FD datasets are typically smaller and more heterogeneous, with significant variations in sampling frequencies and the number of channels across different systems and applications. This heterogeneity complicates the design of a universal architecture capable of effectively processing such diverse data while maintaining robust feature extraction and learning capabilities. In this paper, we introduce UniFault \xspace , a foundation model for fault diagnosis that systematically addresses these issues. Specifically, the model incorporates a comprehensive data harmonization pipeline featuring two key innovations. First, a unification scheme transforms multivariate inputs into standardized univariate sequences. Second, a novel cross-domain temporal fusion strategy mitigates distribution shifts and enriches sample diversity and count, improving the model generalization across varying conditions. UniFault \xspace is pretrained on over 6.9 million samples spanning diverse FD datasets, enabling superior few-shot performance. Extensive experiments on real-world FD datasets demonstrate that UniFault \xspace achieves state-of-the-art performance, setting a new benchmark for fault diagnosis models and paving the way for more scalable and robust predictive maintenance solutions. [orcid=0000-0002-9282-0991] keywords Fault Diagnosis ,Foundation Model ,Time Series ,Few-shot Learning ,Contrastive Learning ,Transformer † † corresponding: Corresponding author Figure 1 : The overall design of UniFault \xspace . (1) We collect datasets from multiple heterogeneous sources with different sequence lengths, sampling rates, and channel counts. (2) Our preprocessing pipeline includes data normalization, sequence length standardization, unifying the channel dimension, and generating new samples via cross-domain temporal fusion. (3) We perform contrastive-based self-supervised pretraining to our Transformer-based backbone. (4) The pretrained model can be fine-tuned with few-shot samples. 1 Introduction Machine Fault Diagnosis (FD) plays a crucial role in predictive maintenance by ensuring the reliability and efficiency of industrial systems Yan et al. (2023) . As industries increasingly adopt automation and cost-effective operations, the demand for scalable and robust FD solutions has grown Gao et al. (2015) . Recent advances in deep learning have revolutionized FD by enabling the automated extraction of complex patterns from sensor data, thereby detecting subtle fault signatures that often elude traditional statistical and rule-based methods Hoang and Kang (2019a) ; Kim et al. (2023) ; Principi et al. (2019) . For instance, Sinitsin et al. (2022b) combined convolutional neural networks (CNN) and multi-layer perceptrons (MLP), while Xu et al. (2023) ; Li et al. (2025) used convolutional graph neural networks to process sensory bearing data and rotating machines. Despite these achievements, significant challenges remain. Many deep learning models are highly operation-specific, struggling to generalize across diverse datasets. For instance, slight variations in sensor calibration or changes in operating conditions can lead to considerable performance degradation Chen et al. (2023) ; Guo et al. (2024) ; Zhao et al. (2021) ; Zhao et al. (2024) . Furthermore, these methods typically depend on large annotated datasets—a critical limitation in real-world FD where faults are rare and manual annotation is both time-consuming and costly Fink et al. (2020) ; Rombach (2023) . Such challenges underscore the need for models that can generalize effectively even with limited labeled data. In response to these challenges, foundation models (FMs) have emerged as a transformative technology in computer vision and natural language processing. By pretraining on large-scale, heterogeneous datasets, FMs learn powerful and flexible representations that transfer effectively to downstream tasks—even when labeled data is scarce Schneider et al. (2024) ; Yuan (2023) . This remarkable generalization capability makes them promising candidates for addressing the data scarcity and domain variability issues in FD. Nonetheless, applying FMs to FD is not straightforward. Two major barriers must be overcome: (1) data scale—FD datasets are typically small and fragmented, lacking the volume required for conventional FM training Su and Lee (2024) ; and (2) data heterogeneity—variations in sensor configurations, data structures, sampling rates, and other system-specific factors pose additional challenges Pacella and Papadia (2020) ; Huang et al. (2021) . Another critical obstacle is the presence of distribution shifts across datasets. Vibration signals collected from different machines, sensors, or operating conditions often follow distinct statistical distributions, even when they represent the same fault type. For example, the spectral profile of an outer-race defect may vary significantly between datasets due to differences in sensor placement, load levels, or sampling hardware. Such distributional mismatches hinder the transferability of features learned on one dataset to another, limiting the robustness of existing FD models. Our work aims to tackle these obstacles by exploring novel approaches for adapting FMs to the unique demands of fault diagnosis. In this paper, we systematically address the aforementioned challenges by proposing a Uni fied foundation model for bearing Fault diagnosis ( UniFault \xspace ), which introduces three key contributions. First, to overcome the scarcity of large annotated datasets, we have constructed a large-scale, diverse FD database comprising over 6.9 million samples collected from heterogeneous sources. UniFault \xspace leverages this extensive dataset for pretraining, allowing the model to learn generalized representations across varied operating conditions. Second, to tackle the issue of data heterogeneity, we develop a comprehensive data harmonization pipeline. This pipeline features a channel unification scheme that converts diverse multivariate sensor inputs into univariate sequences while retaining local inter‐channel relationships. Moreover, a cross-dataset temporal fusion strategy is integrated to mitigate distribution shifts and enrich sample diversity, thereby enhancing both robustness and generalization. Unlike existing FD models that are typically narrow in scope or require manual adaptation across datasets, UniFault \xspace addresses the core challenges of data scarcity, heterogeneity, and the absence of a general-purpose architecture in FD, laying the groundwork for a scalable, robust, and universal solution. We further validate UniFault \xspace through extensive fine-tuning experiments, demonstrating its remarkable ability to achieve high performance with limited labeled data—even with as few as 100 samples. This strong few-shot learning capability positions UniFault \xspace as an effective foundation model for real-world FD applications, particularly in scenarios where labeled data is limited. In summary, the key contributions of this work are as follows: • We introduce UniFault \xspace , a general-purpose foundation model for fault diagnosis pretrained on over 6.9 million samples, significantly surpassing the scale of any prior FD models, to enable generalization across datasets, domains, and machine types. • We present a systematic preprocessing pipeline that standardizes heterogeneous datasets via a normalization scheme and enhances robustness with a cross-domain temporal fusion strategy. • We conduct extensive fine-tuning experiments on real-world FD datasets, demonstrating that UniFault \xspace exhibits remarkable few-shot learning performance and benefits significantly from our preprocessing pipeline. The remainder of this paper is organized as follows: Section 2 provides an overview of related work in fault diagnosis and foundation models. Section 3 details the data preprocessing pipeline, our model architecture, and the self-supervised training strategy. Section 4 presents