Time Series Embedding Methods for Classification Tasks: A Review
Habib Irani, Yasamin Ghahremani, Arshia Kermani, Vangelis Metsis · 2025
Read Time Series Embedding Methods for Classification Tasks: A Review by Habib Irani, Yasamin Ghahremani, Arshia Kermani, Vangelis Metsis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13392.txt.
Introduction
Data that unfold over time, from stock prices to heart traces, must be squeezed into fixed-size feature lists before most learning algorithms can use them. Habib Irani, Yasamin Ghahremani, Arshia Kermani, and Vangelis Metsis review the squeezing methods in a 2025 paper. Their focus is classification: sorting a series into the right class.
The review sorts embedding methods into families by their theory and by where they are used. It then runs leading examples from each family on many real datasets and scores how well the frozen features do at classification. No family won everywhere: the best choice swung with the dataset and the classifier paired with it. The authors share open code for all the methods, and they urge careful selection and broad testing for each new task.
Catalog record
| CREATOR | Habib Irani, Yasamin Ghahremani, Arshia Kermani, Vangelis Metsis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13392
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Time Series Embedding Methods for Classification Tasks: A Review Habib Irani, Yasamin Ghahremani, Arshia Kermani, Vangelis Metsis Abstract Time series analysis has become crucial in various fields, from engineering and finance to healthcare and social sciences. Due to their multidimensional nature, time series often need to be embedded into a fixed-dimensional feature space to enable processing with various machine learning algorithms. In this paper, we present a comprehensive review and quantitative evaluation of time series embedding methods for effective representations in machine learning and deep learning models. We introduce a taxonomy of embedding techniques, categorizing them based on their theoretical foundations and application contexts. Our work provides a quantitative evaluation of representative methods from each category by assessing their performance on downstream classification tasks across diverse real-world datasets. Our experimental results demonstrate that the performance of embedding methods varies significantly depending on the dataset and classification algorithm used, highlighting the importance of careful model selection and extensive experimentation for specific applications. To facilitate further research and practical applications, we provide an open-source code repository 1 1 1 Source code: https://github.com/imics-lab/time-series-embedding implementing these embedding methods. This study contributes to the field by offering a systematic comparison of time series embedding techniques, guiding practitioners in selecting appropriate methods for their specific applications, and providing a foundation for future advancements in time series analysis. Keywords time series embedding \cdot dimensionality reduction \cdot feature extraction \cdot classification \cdot machine learning \cdot deep learning \cdot signal processing 1 Introduction Time series embedding is a technique used to represent time series data in the form of vector embeddings. Today, time series analysis methods have emerged as a fundamental element across a vast amount of applications ranging from finance, as in the work of Zhu and Huang 2022 , to healthcare, as demonstrated in Nejedly et al. 2022 ; Morid et al. 2023 ; Chen et al. 2021 ; Lee and Hauskrecht 2021 ; Soenksen et al. 2022 , engineering applications such as machine health monitoring, predictive maintenance, and fault detection Zhao et al. 2019 ; Li et al. 2020 , and social sciences, explored by Santosh et al. 2018 . As machine learning and deep learning techniques continue to advance, there is a growing need for effective methods to represent and analyze time series data in these models. Tasks such as anomaly detection, classification, pattern recognition, prediction, and decision-making now heavily rely on robust methods that could accurately embed these often high-dimensional data into scalable yet informative representations. The importance of studying and evaluating different time series embedding methods stems from several key factors: • Dimensionality reduction : Time series data often has high dimensionality, which can lead to computational challenges and the curse of dimensionality. Effective embedding methods can reduce the dimensionality while preserving essential temporal patterns and relationships. • Feature extraction : Embeddings can automatically extract relevant features from raw time series data, potentially capturing complex temporal dependencies that may not be apparent in the original representation. • Improved model performance : Well-designed embeddings can lead to significant improvements in the performance of downstream machine learning tasks, such as classification, clustering, and forecasting. • Transfer learning : Embeddings learned from large datasets can be transferred to smaller, related datasets, enabling more effective learning in scenarios with limited data. • Interpretability : Some embedding methods can provide insights into the underlying structure and patterns of time series data, aiding in data exploration and understanding. • Handling irregularities : Many real-world time series datasets are characterized by irregular sampling, missing values, or varying lengths. Certain embedding methods can address these challenges more effectively than others. As the field of time series analysis continues to evolve, a wide array of embedding methods has been proposed, each with its own strengths and limitations. These methods range from classical approaches like delay embeddings and Fourier transforms to more recent techniques leveraging deep learning architectures such as recurrent neural networks and transformer models. Given the diversity of available methods and their potential impact on downstream applications, a comprehensive evaluation and comparison of time series embedding techniques is crucial. This survey aims to provide an overview of the current landscape of time series embedding methods, assess their representation strength when combined with various classification algorithms, and offer insights into selecting appropriate embedding techniques for specific applications. Creating a taxonomy for time series embedding methods can be approached in several different ways, depending on the criteria or perspectives one chooses to emphasize. Those can be based on the theoretical foundations or mathematical principles used, domain of information captured, model complexity and computational requirements, scalability and data requirements, nature of time series data (uni-/muti-variate), application context, etc. In this work, we choose to categorize embeddings mainly based on their theoretical foundations and application context, creating a taxonomy of different categories as depicted in Figure 1 and in more detail in Table 1 . Figure 1: Taxonomy of Time Series Embedding Methods Table 1: Detailed Categories of Time Series Embedding Methods Category Representative Examples Statistical PCA: Reduces dimensionality by identifying orthogonal axes with maximum variance. ICA: Decomposes the series into statistically independent components. CCA: Identifies linear relationships between two sets of variables, revealing common patterns. Transformation-Based DFT: Transforms the series into frequency components, using dominant frequencies as embeddings. DWT: Captures time and frequency characteristics using wavelet coefficients. Feature-Based Hand-Crafted: Statistical: Extracts mean, variance, skewness, etc. Time-Domain: Identifies peaks, troughs, zero-crossings. Frequency-Domain: Captures spectral power, dominant freqs. Automated: TSFRESH: Extracts a wide range of features automatically. catch22: Provides 22 efficient time series characteristics. Model-Based AR/ARMA/ARIMA: Uses past values and moving averages to model the series. HMM: Represents the series as a sequence of hidden states with probabilistic transitions. Kernel-Based KPCA: Extends PCA with kernel methods for non-linear relationships. DTW Kernel: Measures similarity between series, accounting for temporal distortions. Graph-Based Visibility Graphs: Converts data into a graph, with embeddings from graph properties. Recurrence Networks: Uses recurrence plots to construct networks for embedding. Manifold Learning and Nonlinear Dimensionality Reduction t-SNE: Preserves local structure in lower-dimensional embeddings. UMAP: Provides non-linear embeddings while preserving structure. Isomap: Captures intrinsic geometry by preserving geodesic distances. LLE: Maps the series onto a lower-dimensional manifold, preserving local structure. Topological Persistence Homology: Captures topological features across scales using persistence diagrams. Sliding Window with TDA: Applies TDA on time-delay embeddings to capture dynamics. Mapper Algorithm: Constructs a topological network representing the data’s shape. Takens’ Embedding with TDA: Reconstructs the phase space and applies TDA. Deep Learning-Based Autoencoders: Compress and reconstruct series, with embeddings from the bottleneck layer. RNNs: Capture temporal dependencies using hidden state embeddings. CNNs: Extract local patterns through convolution, creating feature embeddings. Attention-Based Models: Focus on relevant parts of the series for embedding. Hybrid Classical + Deep Learning: Combines traditional methods with deep learning for robust embeddings. Multi-View Embeddings: Integrates multiple perspectives, transformations, or models. Previous surveys on time series embeddings, such as the one published by Tjøstheim et al. 2023 , have provided a qualitative categorization of the various methods but have not quantitatively evaluated the representation capability of each method on real-world data. In this work, we evaluate popular time series embedding methods by using the formed embeddings on downstream classification tasks, which provides a crucial perspective on their effectiveness and