LMS-AutoTSF: Learnable Multi-Scale Decomposition and Integrated Autocorrelation for Time Series Forecasting
Ibrahim Delibasoglu, Sanjay Chakraborty, Fredrik Heintz · 2024
Read LMS-AutoTSF: Learnable Multi-Scale Decomposition and Integrated Autocorrelation for Time Series Forecasting by Ibrahim Delibasoglu, Sanjay Chakraborty, Fredrik Heintz (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-06866.txt.
Introduction
Ibrahim Delibasoglu, Sanjay Chakraborty, and Fredrik Heintz present a new computer model for forecasting time series data in 2024. Time series are sets of values measured over time, like daily weather or stock prices. Their model, called LMS-AutoTSF, tries to guess future values more exactly while running faster than rival models.
The design splits each series into a slow trend part and a repeating seasonal part. Rather than fixing those parts in advance, the model learns two kinds of filters that pull the parts apart. It also compares values at set time lags, which helps it track links across long spans. The authors say the light design keeps speed high while holding accuracy across many forecast lengths, and they share the code in public.
Catalog record
| CREATOR | Ibrahim Delibasoglu, Sanjay Chakraborty, Fredrik Heintz |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-06866
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LMS-AutoTSF: Learnable Multi-Scale Decomposition and Integrated Autocorrelation for Time Series Forecasting Ibrahim Delibasoglu, Sanjay Chakraborty, Fredrik Heintz Abstract Time series forecasting is an important challenge with significant applications in areas such as weather prediction, stock market analysis, and scientific simulations. In this work, we introduce LMS-AutoTSF, a novel time series forecasting architecture that incorporates autocorrelation while leveraging dual encoders operating at multiple scales. Unlike traditional models that rely on predefined trend and seasonal components, LMS-AutoTSF employs two separate encoders per scale: one focusing on low-pass filtering to capture trends and the other utilizing high-pass filtering to model seasonal variations. These filters are learnable, allowing the model to dynamically adapt and isolate trend and seasonal components directly in the frequency domain. A key innovation in our approach is the integration of autocorrelation, achieved by computing lagged differences in time steps, which enables the model to capture dependencies across time more effectively. Each encoder processes the input through fully connected layers to handle temporal and channel interactions. By combining frequency-domain filtering, autocorrelation-based temporal modeling, and channel-wise transformations, LMS-AutoTSF not only accurately captures long-term dependencies and fine-grained patterns but also operates more efficiently compared to other state-of-the-art methods. Its lightweight design ensures faster processing while maintaining high precision in forecasting across diverse time horizons. The source code is publicly available at http://github.com/mribrahim/LMS-TSF August 24, 2026 1 Introduction Time series data typically comprises an ordered sequence of observed or measured outcomes from a process at fixed time intervals. These datasets are designed to capture relevant information and activities within a specific subject matter. The primary goal of time series applications is to estimate future values by the identification of underlying patterns in historical data. Time series forecasting (TSF) is a frequently used technique in fields like traffic congestion anticipation, weather forecasting, and stock market prediction. Making more informed and efficient decisions is made possible by accurate forecasting, which gives decision-makers the ability to recognise and reduce risks [ 1 ] . Due to the complex and ever-changing nature of real-world systems, observed time series often exhibit intricate temporal patterns. These patterns can involve a mix of increasing, decreasing, and fluctuating trends, making forecasting highly challenging. Multivariate time series forecasting involves predicting future values of multiple interrelated time-dependent variables based on their historical data. Unlike univariate forecasting, which deals with a single variable, multivariate forecasting considers the interactions and dependencies between multiple variables, allowing for more complex and potentially more accurate predictions across several dimensions [ 2 ] . In time series data, the trend component represents the long-term directional movement, showing consistent upward or downward patterns, while the seasonal component captures regular, repeating fluctuations over fixed intervals, such as daily, monthly, or yearly cycles. Variations in trends can be linear or nonlinear and may shift or reverse over time, whereas seasonal variations are typically periodic but can vary in amplitude or timing due to external factors. Both components often overlap, making the task of isolating and forecasting them more complex [ 3 ] . In time series analysis, frequency domain filtering has two types. A low-pass filtering is commonly used to capture seasonal variations by allowing low-frequency components of the data to pass through while attenuating high-frequency noise. This process helps isolate recurring seasonal patterns, such as annual or monthly cycles, which are important in fields like finance and climatology [ 4 ] . Conversely, high-pass filtering is employed to model trends by passing high-frequency components and filtering out lower-frequency signals, which represent long-term, smooth variations. This technique is particularly useful for identifying short-term fluctuations and trends, removing the impact of long-term cyclical patterns [ 5 ] . Both methods provide a clearer decomposition of time series data, enabling analysts to focus on specific components of interest. Transformer is emerging in time series forecasting, driven by the tremendous success in the natural language processing field. Transformer has the ability to extract multi-level representations from sequences and illustrate pairwise connections [ 6 ] . In time series data analysis, Transformers that combine frequency-domain filtering with temporal and channel-wise transformations offer a powerful approach to capturing complex dependencies and patterns. By leveraging frequency-domain filtering, these models can efficiently separate and analyze the signal’s various frequency components, isolating key seasonal or trend-related elements [ 2 ] . Additionally, temporal and channel-wise transformations allow the model to process both the sequential nature of time series data and the relationships across multiple channels, making it particularly adept at handling multivariate time series and discovering intricate dependencies between variables [ 7 ] . This dual capability enables the model to address both local and global patterns, improving performance in tasks such as forecasting, anomaly detection, and classification. Our main contributions are as follows: • The dynamic decomposition enhances the model’s ability to capture intricate patterns and the model can learn the trend and seasonality features of each dataset without depending on fixed assumptions. • By leveraging the concept of autocorrelation in the time domain, the architecture effectively incorporates temporal dependencies into the forecasting process. This integration allows the model to recognize and utilize historical relationships within the data, improving forecasting accuracy. • LMS-AutoTSF achieves state-of-the-art performance in time series forecasting tasks by integrating learnable decomposition, autocorrelation, and multi-scale processing across a wide range of benchmarks. • LMS-AutoTSF is a lightweight and computationally efficient architecture, that significantly reduces processing time compared to existing state-of-the-art methods, while maintaining or even improving forecasting accuracy. We do comprehensive tests on different time-series forecasting benchmarks to support our motivation and hypothesis. When compared to various forecasting techniques, the performance of our proposed model is at the cutting edge. Extensive ablation investigations and analysis trials support the viability of suggested designs and their consequent benefit over earlier methods. This paper is organized as follows. Section 2 explains a set of typical times series forecasting works from the literature which sets the notion and motivation of this paper. Section 3 briefly explains the problem statement of this paper. In Section 4 , we provide a detailed discussion of our proposed architecture called LMS-AutoTSF which is suitable for multivariate time series forecasting. In section 5 , we discuss the result analysis of the proposed methodology and describe a detailed comparison with the state-of-the-art time series forecasting models. A conclusion of the work’s findings is provided in Section 6 . 2 Literature Review In long-term and short-term time series forecasting, transformers have demonstrated exceptional performance and significant potential [ 2 , 8 , 9 , 10 ] . Informer [ 11 ] , the first renowned transformer for time-series forecasting, uses a generative style decoder and ProbSparse self-attention to solve problems like quadratic time complexity. A number of models were introduced after Informer [ 11 ] , including Autoformer [ 12 ] , Pyraformer [ 13 ] , iTransformer [ 6 ] , Reformer [ 14 ] and FEDFormer [ 15 ] . While Pyraformer [ 13 ] concentrates on multiresolution attention for signal processing efficiency. Autoformer [ 12 ] employs auto-correlation and decomposition for performance, while FEDFormer [ 15 ] combines frequency analysis with Transformers for improved time series representation. By emphasising the value of patches, the PatchTST [ 9 ] improves the model’s capacity to identify both