FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series Classification

Tian Tian, Chunyan Miao, Hangwei Qian · 2025

Read FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series Classification by Tian Tian, Chunyan Miao, Hangwei Qian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23181.txt.

Introduction

Tian Tian, Chunyan Miao, and Hangwei Qian improve contrastive learning for time series in this 2025 paper. Contrastive methods learn by comparing altered copies of data, so the alteration strategy matters. Yet time series work mostly borrows image tricks from the time domain, which can distort the very patterns that carry meaning.

Their method, FreRA, works in the frequency domain instead, arguing frequencies offer global, independent, and compact views of a series. It splits key frequencies from minor ones automatically, protects the meaning in the key band, and adds variety to the rest. The design is light and plugs into existing frameworks, aiming at better classification features.

Catalog record

CREATORTian Tian, Chunyan Miao, Hangwei Qian
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23181

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series Classification Tian Tian, Chunyan Miao, Hangwei Qian Abstract . Contrastive learning has emerged as a competent approach for unsupervised representation learning. However, the design of an optimal augmentation strategy, although crucial for contrastive learning, is less explored for time series classification tasks. Existing predefined time-domain augmentation methods are primarily adopted from vision and are not specific to time series data. Consequently, this cross-modality incompatibility may distort the semantically relevant information of time series by introducing mismatched patterns into the data. To address this limitation, we present a novel perspective from the frequency domain and identify three advantages for downstream classification: 1) the frequency component naturally encodes global features, 2) the orthogonal nature of the Fourier basis allows easier isolation and independent modifications of critical and unimportant information, and 3) a compact set of frequency components can preserve semantic integrity. To fully utilize the three properties, we propose the lightweight yet effective Fre quency- R efined A ugmentation ( FreRA ) tailored for time series contrastive learning on classification tasks, which can be seamlessly integrated with contrastive learning frameworks in a plug-and-play manner. Specifically, FreRA automatically separates critical and unimportant frequency components. Accordingly, we propose semantic-aware Identity Modification and semantic-agnostic Self-adaptive Modification to protect semantically relevant information in the critical frequency components and infuse variance into the unimportant ones respectively. Theoretically, we prove that FreRA generates semantic-preserving views. Empirically, we conduct extensive experiments on two benchmark datasets, including UCR and UEA archives, as well as five large-scale datasets on diverse applications. FreRA consistently outperforms ten leading baselines on time series classification, anomaly detection, and transfer learning tasks, demonstrating superior capabilities in contrastive representation learning and generalization in transfer learning scenarios across diverse datasets. The code is available at https://github.com/Tian0426/FreRA. Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’25), August 3–7, 2025, Toronto, ON, Canada DOI: 10.1145/3711896.3736969 ISBN: 979-8-4007-1454-2/2025/08 CCS: Computing methodologies Temporal reasoning CCS: Computing methodologies Unsupervised learning CCS: Computing methodologies Learning settings CCS: Computing methodologies Neural networks † † cc-license: by Figure 1 . Our method (blue curve) achieves the highest MI between the views generated and the label, enabling better semantic preservation compared with SOTA. The semantically relevant information is well preserved to facilitate contrastive representation learning. 1. Introduction Time series classification has been an essential problem in a wide range of applications, such as activity recognition ( Qian, 2019 ) , speech recognition ( Huijben et al., 2023 ) , and industrial monitoring ( Eldele et al., 2023 ) . Despite the promising performance achieved by supervised methods ( Qian, 2019 ) , a large number of accurate labels are required to deliver good performance. However, label annotation for time series without human error is costly and time-consuming. This is because time series data are not intuitively recognizable or meaningful for humans, unlike images or language. Given the circumstance, contrastive learning has been attested as a compelling framework for representation learning in the absence of labels ( Meng et al., 2023b ; Qian et al., 2022 ) . Specifically, it learns to solve an instance discrimination pretext task ( Wu et al., 2018 ) that aims to distinguish different samples (negative pairs) while keeping different views of the same sample (positive pairs) close, wherein different views are usually generated by a set of augmentation functions. Despite the prevalence of contrastive learning ( Chen and He, 2021 ; Huang et al., 2023 ) , its efficacy heavily relies on the proper selection of data augmentation ( Luo et al., 2023 ; Tian et al., 2020 ) . Existing works in time series contrastive learning often apply carefully hand-picked time-domain transformations such as jitter-and-scale and permutation-and-jitter ( Eldele et al., 2023 ) . However, these augmentations are mostly adopted from the vision domain and do not take the intrinsic characteristics of time series into consideration. Due to the unintuitive nature of time series, it becomes impractical to painlessly figure out semantically compromised augmented samples, unlike in vision. Additionally, predefined stochastic frequency-domain augmentations, such as phase-shift and augmentation in TF-C ( Zhang et al., 2022 ) , introduce semantically irrelevant noise that disrupts the critical information. Moreover, frequency-based predefined augmentations, such as high-pass and low-pass filters, require prior knowledge, such as the effective bandwidth of a dataset, to determine the selection of appropriate augmentation functions. As prior knowledge is not always accessible in the contrastive learning paradigm, and the compromised semantics caused by the frequency-domain augmentation, predefined frequency-domain augmentations remain suboptimal for contrastive learning. Consequently, when applying predefined augmentation, the type and degree of transformation need to be carefully selected to reduce the loss of semantic information. However, the reliance on trial-and-error selection of hand-picked augmentations makes the process computationally expensive and impractical. What’s worse is that there is no single augmentation function that consistently performs well on all diverse datasets ( Qian et al., 2022 ) . Given these challenges, recent works have started to explore the generalized principle and design of transformation that yield universally optimal augmentation \textsf{v}^{\ast} for time series contrastive learning. For instance, the latest InfoTS ( Luo et al., 2023 ) and AutoTCL ( Zheng et al., 2024 ) share a common principle that optimal augmentation should remain semantically consistent with their anchor samples \text{MI}(\textsf{v}^{\ast};\textsf{y})=\text{MI}(\textsf{x};\textsf{y}) , where x and y are the random variable denoting time series sample and global label applied to the entire sequence , and \text{MI}(\cdot;\cdot) represents the mutual information (MI) quantifying the mutual dependence between two variables. MI is formally defined as \text{MI}(\textsf{x};\textsf{y})=\text{H}(\textsf{y})-\text{H}(\textsf{y}|\textsf{x}) , where \text{H}(\textsf{y}) and \text{H}(\textsf{y}|\textsf{x}) denote the Shannon entropy of y and the entropy of y conditioned on x , respectively. However, our empirical observations reveal that these proposed augmentation strategies still fail to preserve semantic integrity. To be more specific, they more or less undermine or disrupt the meaningful patterns associated with semantically relevant information , i.e., \text{MI}(\textsf{v}^{\ast};\textsf{y}) , of the time series, which will be discussed in detail in the later sections. In our analysis, the global semantics, whose amount is quantified as \text{MI}(\textsf{x};\textsf{y}) , refer to the information that spans the entire time series and contributes significantly to distinguishing between different classes . Therefore, ensuring the preservation of global semantics is essential for effective view generation in contrastive learning for time series classification tasks. For a clearer illustration, we plot 6 different \text{MI}(\textsf{v};\textsf{y}) curves in Figure 1 , where \textsf{v}\in\{\mathcal{A}_{\mathbf{s}}(\textsf{x}),\textsf{x},\mathcal{A}_{\text{AutoTCL}}(\textsf{x}),\mathcal{A}_{\text{InfoTS}}(\textsf{x}),\mathcal{T}_{T}(\textsf{x}),\mathcal{T}_{F}(\textsf{x})\} , denoting the augmented view generated by our proposed FreRA, identity transformation, AutoTCL, InfoTS and jitter-and-scale and amplitude-and-phase-perturbation , respectively, and y is the label in the downstream classification task. The x -axis presents the timestamp of the time series, and the y -axis denotes the value of MI. We provide more details regarding Figure 1 in Appendix A.1 . Intuitively, a higher MI curve is preferable because it indicates more global semantics information is preserved. We first observe the proposed FreRA (blue curve) achieves the highest value among all the curves, and it almost overlaps with \text{MI}(\textsf{x};\textsf{y}) (orange curve), indicating FreRA preserves all the semantically relevant information

Read the complete text