Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data
Mingyuan Zhou, Xudong Jian, Ye Xia, Zhilu Lai · 2024
Read Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data by Mingyuan Zhou, Xudong Jian, Ye Xia, Zhilu Lai (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03880.txt.
Introduction
Mingyuan Zhou, Xudong Jian, Ye Xia, and Zhilu Lai tackle bad data in the sensor records used to watch the health of bridges and other large structures. Faulty readings are common in those records and can mislead checks. Deep learning can spot them, but it needs many labeled examples, and labeling is slow and costly for huge data sets.
The team uses self-taught pre-training, where a model first learns from unlabeled data and is then tuned with a few labeled cases. That way, the model can learn useful patterns before it ever sees a label. Tests show the approach can spot faulty readings well while using far fewer labels. The method suits real monitoring work, where labeled data is scarce.
Catalog record
| CREATOR | Mingyuan Zhou, Xudong Jian, Ye Xia, Zhilu Lai |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03880
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data Mingyuan Zhou, Xudong Jian, Ye Xia, Zhilu Lai Abstract Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective utilization. Recently, deep learning has emerged as an efficient and effective approach for anomaly detection in bridge SHM. Despite its progress, many deep learning models require large amounts of labeled data for training. The process of labeling data, however, is labor-intensive, time-consuming, and often impractical for large-scale SHM datasets. To address these challenges, this work explores the use of self-supervised learning (SSL), an emerging paradigm that combines unsupervised pre-training and supervised fine-tuning. The SSL-based framework aims to learn from only a very small quantity of labeled data by fine-tuning, while making the best use of the vast amount of unlabeled SHM data by pre-training. Mainstream SSL methods are compared and validated on the SHM data of two in-service bridges. Comparative analysis demonstrates that SSL techniques boost data anomaly detection performance, achieving increased F 1 F_{1} scores compared to conventional supervised training, especially given a very limited amount of labeled data. This work manifests the effectiveness and superiority of SSL techniques on large-scale SHM data, providing an efficient tool for preliminary anomaly detection with scarce label information. 1 Introduction Structural health monitoring (SHM) has experienced noticeable progress due to the compulsory requirement of structural safety and the rapid development of sensor technology [ 1 , 2 , 3 ] . The primary objective of SHM is to assess the health and integrity of structures by acquiring and analyzing various types of data, such as acceleration, strain, etc. As time evolves and the number of installed sensors grows, SHM systems accumulate increasing volumes of monitoring data. These data hold essential information for evaluating structural conditions and are leveraged in a variety of SHM tasks. Typical tasks include structural damage identification [ 4 , 5 ] , structural system identification [ 6 , 7 ] , load identification [ 8 , 9 ] , and structural life cycle management [ 10 , 11 ] , etc. Data-driven SHM tasks rely on the quantity and quality of the acquired data. However, data anomalies inevitably exist and pose significant challenges to the performance and reliability of SHM approaches. For example, abnormal data may severely impact the accuracy of vibration model estimation, particularly in high-order modes [ 12 ] . Abnormal data can also distort signal processing, resulting in erroneous power spectral density calculations and false alarms in structural damage identification [ 13 , 14 ] . In addition, SHM data anomalies exhibit diverse patterns and may arise from various sources, including sensor malfunctions, environmental changes, or structural damages. Therefore, detecting and classifying these data anomalies is critical for ensuring the effective functioning of data-driven SHM approaches. Data anomaly detection is widely applied across diverse research and application domains [ 15 ] . In the field of SHM, Deng et al. [ 12 ] present a comprehensive and up-to-date review of approaches for SHM data anomaly detection. These methods are broadly classified into categories such as statistical probability methods, predictive models, computer vision methods, etc. Many statistical probability and predictive methods require prior information on data distribution, statistical model parameters, manually set thresholds, or expertise inspection. However, applying these approaches to SHM data can be challenging due to the tremendous volume and intricate patterns. To address these challenges, researchers have developed reliable and automatic approaches for SHM data anomaly detection. Deep learning techniques have been recently extensively employed, demonstrating significant effectiveness in classifying various abnormal patterns in SHM data [ 16 , 17 , 18 , 19 , 20 ] . A common workflow involves transforming time series data into images and then training deep learning models. For instance, Bao et al. [ 16 ] employ a convolutional neural network (CNN) to detect bridge abnormal data. Lei et al. [ 19 ] utilize the attention neural network, showing improved classification accuracy and computational efficiency. Despite the success of deep learning methods, they often rely heavily on large labeled datasets for supervised learning. However, creating large labeled datasets requires expert knowledge and considerable labor, presenting an obstacle to performing data anomaly detection more efficiently. To reduce the reliance on labeled data, researchers have developed approaches that require less to no labeled data, categorized as unsupervised or semi-supervised methods. Unsupervised methods [ 21 , 22 , 23 ] , which do not need labeled data, typically train neural networks to reconstruct the input data. After training, reconstruction errors are utilized as indicators to detect anomalies. While unsupervised methods perform well in distinguishing between normal and abnormal data, they generally cannot classify multiple abnormal patterns. In contrast, semi-supervised methods [ 24 , 25 , 26 ] effectively classify multiple abnormal patterns by leveraging a small amount of labeled data. These approaches come with specific prerequisites . For instance, some methods require training data that contains solely normal data [ 21 ] , others rely on data augmentation for specific types of anomalies [ 26 ] , and some utilize pre-trained models from other labeled datasets [ 24 ] . These requirements can be challenging in practical SHM applications. Therefore, developing more flexible data anomaly methods with minimal prerequisites remains a challenging and open problem. To develop the approach with less labeled data and unknown data distribution, we introduce self-supervised learning (SSL) for SHM data anomaly detection. SSL [ 27 , 28 , 29 , 30 , 31 ] have recently emerged as a powerful approach for learning data representations without the need for manually annotated labels. So far, SSL has become predominant in various domains, from large language models such as GPTs [ 32 ] , BERT [ 33 ] , to advanced image models like SEER [ 34 ] , their pre-training is employed in a self-supervised manner. Unlike supervised learning, SSL requires no manually annotated labels during pre-training, enabling it to learn from vast amounts of unlabeled data. The key idea of SSL is to design pretext tasks that leverage data itself or its augmentation as label information. Typical pretext tasks include reconstruction and comparison, which allow models to learn useful representations for downstream tasks [ 35 , 36 ] . A typical SSL workflow is to leverage vast unlabeled data for pre-training , followed by supervised fine-tuning [ 37 ] . Despite its success in many domains, the integration of SSL pre-training and fine-tuning for SHM data anomaly detection remains underexplored. Given the large scale of unlabeled SHM data, employing SSL on SHM data becomes a promising solution. Our work is geared toward learning from a few labeled SHM data while making the best use of a vast amount of unlabeled SHM data for anomaly detection. The key contributions of this study are as follows: 1. We introduce emerging self-supervised learning techniques in the context of SHM data anomaly detection. The SSL-based framework performs pre-training on SHM data without relying on prior knowledge of data distributions. Using the data itself as supervision, SSL eliminates the need for manually annotated labels during the pre-training stage. 2. Considering