HAELT: A Hybrid Attentive Ensemble Learning Transformer Framework for High-Frequency Stock Price Forecasting

2025

Read HAELT: A Hybrid Attentive Ensemble Learning Transformer Framework for High-Frequency Stock Price Forecasting (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13981.txt.

Introduction

Thanh Dan Bui forecasts hourly stock moves with a hybrid transformer built for noisy, jumpy prices, in this 2025 paper. High-frequency series are restless and volatile, which defeats plain models. HAELT stacks three parts: a residual network that damps noise, self-attention that picks which past hours matter, and a mixed memory-transformer core for short and long patterns, all blended by recent form.

On hourly Apple data from early 2024 to mid 2025, the ensemble posted the best test score at calling rises and falls. The author presents it as a practical tool for trading systems.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13981

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HAELT: A Hybrid Attentive Ensemble Learning Transformer Framework for High-Frequency Stock Price Forecasting Abstract High-frequency stock price prediction presents substantial challenges stemming from the inherent non-stationarity, significant noise, and high volatility of financial time series. To address these complexities, we introduce the Hybrid Attentive Ensemble Learning Transformer (HAELT), a novel deep learning framework meticulously engineered to capture multifaceted temporal dynamics. The HAELT architecture synergistically integrates several advanced components: it begins with a ResNet-based module that extracts salient local patterns while mitigating noise through residual connections ; a subsequent temporal self-attention mechanism then dynamically weighs the significance of different time steps, enabling the model to focus on the most pertinent historical information for the current prediction. The core of the framework is a hybrid LSTM-Transformer module that operates in parallel, leveraging the LSTM’s proficiency in modeling local sequential dependencies alongside the Transformer’s strength in capturing critical long-range interactions. These distinct predictive pathways are unified within a dynamic ensemble structure that adapts to changing market conditions by weighting predictions based on the recent performance of each component. Rigorously evaluated on an extensive dataset of hourly Apple Inc. (AAPL) trading data from January 2024 to May 2025, the HAELT framework demonstrates a superior and balanced predictive capability, achieving the highest F1-Score on the hold-out test set. This result is particularly significant as it indicates an enhanced capacity to correctly identify both positive and negative price movements, which is crucial for developing reliable trading signals. Ultimately, this research contributes a sophisticated hybrid architecture to financial forecasting, presenting a robust model for practical applications like algorithmic trading while also offering critical, data-driven insights into the trade-offs between architectural complexity and performance gain. 1 Introduction High-frequency stock price prediction is a pivotal task in computational finance and algorithmic trading, where accurate short-term forecasts can enable market participants to capitalize on transient inefficiencies, optimize risk management strategies, and enhance portfolio performance [ 1 , 2 ] . Nevertheless, forecasting high-frequency stock prices presents substantial challenges stemming from the inherent characteristics of financial time series, such as non-stationarity, significant noise levels, and high volatility [ 3 , 4 ] . These difficulties are compounded by the complex interplay of market microstructure dynamics, the rapid incorporation of new information at granular time scales, and the influence of automated trading systems, necessitating advanced modeling approaches. To address these challenges, this study utilizes a comprehensive dataset crucial for capturing the nuanced patterns of high-frequency stock price movements. The dataset consists of hourly trading data for Apple Inc. (AAPL) from early January 2024 to late May 2025. This period covers diverse market scenarios, including phases of heightened volatility and periods of relative stability. Each record includes opening, highest, lowest, and closing prices, along with trading volume, offering a detailed view of market activity. Such a dataset provides a solid foundation for the development and rigorous evaluation of predictive models designed for the complexities of short-term price forecasting in dynamic financial markets. The capacity for precise high-frequency stock price prediction carries significant implications for financial market operations. High-frequency trading (HFT) strategies, reliant on rapid and accurate forecasts, constitute a substantial volume of market transactions [ 2 , 7 ] . The development of more potent predictive models can foster enhanced market efficiency via accelerated price discovery and diminished informational asymmetry. Moreover, superior forecasts can contribute to reduced transaction costs, facilitating more effective trade execution and offering a competitive edge to traders [ 6 , 8 ] . Accurate high-frequency stock price prediction is impeded by several key challenges. Financial time series are inherently non-stationary, characterized by regime shifts and evolving statistical properties, which complicates the maintenance of model predictive accuracy over time [ 3 , 9 ] . Significant levels of noise and volatility, arising from market microstructure effects and the assimilation of news, introduce substantial unpredictability [ 5 , 10 ] . Furthermore, the relationships between predictive features and future price movements are often complex, non-linear, and dynamic [ 11 , 12 ] . The high dimensionality and intricate interactions among numerous technical indicators, price patterns, and volume data also present a considerable challenge in identifying salient predictive signals [ 13 , 14 ] . To address these challenges, this paper introduces HAELT (Hybrid Attentive Ensemble Learning Transformer), a novel framework for high-frequency stock price prediction. This work makes three primary contributions. First, we develop a new hybrid architecture that strategically combines ResNet-based feature extraction for capturing hierarchical patterns, a temporal attention mechanism for adaptively weighing the significance of different time steps, and an integrated LSTM-Transformer module designed to model both local sequential dependencies and global long-range interactions. Second, we incorporate a dynamic ensemble mechanism that adaptively combines predictions from the model’s constituent components, with the combination weights modulated based on recent predictive performance. Third, we conduct a comprehensive empirical evaluation of the HAELT framework on high-frequency AAPL stock data, including rigorous comparisons with a diverse suite of established baseline models. This evaluation also involves an analysis of feature importance, interpretability aspects, and robustness across varying market conditions. 2 Related Work 2.1 Traditional Time Series Models Classical statistical models, notably ARIMA (Autoregressive Integrated Moving Average) and GARCH (Generalized Autoregressive Conditional Heteroskedasticity), have historically served as foundational tools for financial time series forecasting [ 1 , 3 ] . ARIMA models are adept at capturing linear dependencies and short-term autocorrelations within stationary or difference-stationary series [ 6 ] . GARCH models and their extensions are specifically formulated to model time-varying volatility, a pervasive characteristic of financial returns [ 5 , 10 ] . Nonetheless, the utility of these models is constrained by their underlying assumptions of linearity and their limited capacity to capture complex non-linear dynamics and structural breaks or regime shifts often present in financial data [ 3 ] . 2.2 Machine Learning Approaches Machine learning (ML) methods have gained widespread adoption in financial prediction, primarily due to their flexibility in modeling non-linear relationships. Support Vector Machines (SVMs) have demonstrated utility in forecasting market direction and managing high-dimensional feature spaces [ 15 ] . Ensemble techniques, including Random Forest and XGBoost, have shown robust performance by aggregating predictions from multiple decision trees, thereby mitigating overfitting and improving generalization [ 16 , 17 , 27 ] . Advanced gradient boosting frameworks such as LightGBM offer further enhancements in computational efficiency and scalability for large datasets [ 18 ] . 2.3 Deep Learning Models Deep learning (DL) techniques have markedly advanced time series prediction capabilities. Recurrent Neural Networks (RNNs) and their more sophisticated variant, Long Short-Term Memory (LSTM) networks, have been instrumental in this progress [ 19 , 20 ] . LSTMs are particularly adept at modeling long-range temporal dependencies in sequential data, which has led to their successful application in financial forecasting [ 21 ] . However, LSTMs can be sensitive to noise and prone to overfitting, especially with volatile financial market data [ 12 ] . Transformer architectures, employing self-attention mechanisms to assign differential importance to various segments of an input sequence, have recently achieved state-of-the-art results in diverse sequence modeling tasks [ 22 , 23 ] . Transformers are proficient at capturing complex long-range dependencies and benefit from parallelizable computations, potentially accelerating training. Nevertheless, they often necessitate large training datasets for

Read the complete text