BiTA: Bidirectional Gated Recurrent Unit-Transformer Aggregator in a Temporal Graph Network Framework for Alert Prediction in Computer Networks Journal: Expert Systems with Applications
Zahra Makki Nayeri, Mohsen Rezvani · 2026
Read BiTA: Bidirectional Gated Recurrent Unit-Transformer Aggregator in a Temporal Graph Network Framework for Alert Prediction in Computer Networks Journal: Expert Systems with Applications by Zahra Makki Nayeri, Mohsen Rezvani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22781.txt.
Introduction
Nayeri and Rezvani redesign how a temporal graph network gathers a node's past activity. It reads sequences both forward and backward and weighs distant context, to predict computer-network alerts sooner. Their aggregator, BiTA, keeps the host model's memory and message passing intact while adding multi-scale timing patterns that single-direction methods miss. Tested on real alert data, it beats current temporal graph models on ranking and accuracy in both familiar and unseen network settings.
Catalog record
| CREATOR | Zahra Makki Nayeri, Mohsen Rezvani |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94309 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22781
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BiTA: Bidirectional Gated Recurrent Unit-Transformer Aggregator in a Temporal Graph Network Framework for Alert Prediction in Computer Networks Journal: Expert Systems with Applications Zahra Makki Nayeri, Mohsen Rezvani Abstract Proactive alert prediction in computer networks is critical for mitigating evolving cyber threats and enabling timely defensive actions. Temporal Graph Neural Networks (TGNs) provide a principled framework for modeling time-evolving interactions; however, existing TGN-based methods predominantly rely on unidirectional or single-mechanism temporal aggregation, which limits their ability to capture recursive, multi-scale temporal patterns commonly observed in real-world attack behaviors. In this paper, we propose BiTA, a Bidirectional Gated Recurrent Unit–Transformer Aggregator for temporal graph learning. Rather than introducing a deeper or higher-capacity model, BiTA redesigns the temporal aggregation function within the TGN framework by jointly encoding bidirectional sequential dependencies and long-range contextual relations over each node’s temporal neighborhood. This aggregation strategy enables complementary temporal reasoning at different scales while preserving the original TGN memory and message-passing structure. We evaluate BiTA on real-world alert datasets, demonstrating significant improvements in key performance metrics such as area under the curve, average precision, mean reciprocal rank, and per-category prediction accuracy when compared to state-of-the-art temporal graph models. BiTA outperforms baseline methods under both transductive and inductive settings, highlighting its robustness and generalization capabilities in dynamic network environments. BiTA is a scalable and interpretable framework for real-time cyber threat anticipation, paving the way toward more intelligent and adaptive intrusion detection systems. 1 Introduction In modern computer networks, timely and accurate prediction of alert events is a fundamental requirement for mitigating the impact of increasingly sophisticated cyber threats. As attack campaigns become multi-stage, adaptive, and temporally correlated, traditional rule-based defense systems struggle to provide proactive and context-aware protection. This challenge has motivated the adoption of data-driven approaches, particularly Temporal Graph Neural Networks (TGNs), which offer a principled way to model the evolving interactions among network entities over time. Temporal GNNs are well suited for capturing both structural and temporal dependencies in dynamic graphs. However, despite their success, a critical limitation lies in how historical interactions are aggregated over time. In the original TGN framework, incoming messages for each node are aggregated using simple heuristic operators such as mean or last. While computationally efficient, these aggregation schemes are non-learnable and temporally myopic: they discard the internal temporal structure of interaction sequences, treat all historical messages as equally informative, and fail to model recursive or long-range temporal dependencies. As a result, the expressive power of TGN is fundamentally constrained by a static aggregation mechanism, even though its memory update module is recurrent. This limitation is particularly severe in cybersecurity scenarios. Network attacks often exhibit delayed, recurrent, and bidirectional temporal patterns, where early benign-looking events can only be correctly interpreted after subsequent alerts occur. Unidirectional temporal encoders, such as GRU or LSTM-based models commonly used in existing temporal aggregation schemes, are inherently unable to retrospectively refine historical representations using future context. Prior studies have shown that such models struggle to capture complex temporal dependencies in dynamic graphs 20 , 16 , motivating alternative designs such as non-local recurrent mechanisms 5 , temporal convolutions 3 , and attention-based temporal models 21 . Nevertheless, how to endow TGN with a learnable, expressive, and temporally aware aggregation mechanism remains an open problem. To address this challenge, we propose BiTA, a Bidirectional GRU–Transformer Aggregator, which fundamentally redesigns the message aggregation component of TGN. Instead of relying on static operators, BiTA transforms aggregation into a learnable temporal modeling process. For each node, incoming messages are first temporally ordered and encoded using a Bidirectional GRU, enabling the model to capture fine-grained sequential dependencies in both forward and backward temporal directions. The resulting hidden representations are then processed by a Transformer encoder, which applies multi-head self-attention to selectively emphasize the most informative historical interactions and model long-range temporal dependencies. The final aggregated representation is subsequently used for memory updating within the original TGN framework. Importantly, BiTA preserves the core architecture of TGN while addressing its most restrictive component. By replacing heuristic aggregation with a bidirectional and attention-aware temporal aggregator, the proposed framework significantly enhances the expressive capacity of TGN without sacrificing its inductive capabilities. This design allows historical node representations to be dynamically refined based on both past and future interaction context, a property that is crucial for accurate alert prediction in evolving network environments. In practical settings such as Security Operation Centers (SOCs) and Computer Emergency Response Teams (CERTs), analysts are overwhelmed by massive volumes of heterogeneous alerts, where timely prioritization and accurate categorization are essential to prevent alert fatigue and missed threats 12 , 17 , 9 , 15 . Beyond predicting whether an alert will occur, understanding its category and potential propagation path is equally critical. The proposed framework supports both alert existence prediction and fine-grained category prediction, enabling security operators to anticipate attack escalation and take informed mitigation actions. The main contributions of this work are summarized as follows: • We identify the static message aggregation mechanism of TGN as a key bottleneck and propose BiTA, a novel learnable temporal aggregation module that replaces heuristic operators such as mean and last . • We design a bidirectional and attention-aware aggregation pipeline based on BiGRU and Transformer encoders, enabling the modeling of recursive, delayed, and long-range temporal dependencies in dynamic alert streams. • We integrate BiTA into the TGN framework without modifying its memory update mechanism, preserving inductive generalization while significantly enhancing temporal expressiveness. • Extensive experiments on real-world network alert datasets demonstrate consistent and substantial improvements over state-of-the-art temporal graph models under both transductive and inductive settings. The remainder of this paper is organized as follows. Section 2 reviews the research problem and relevant prior work. Section 3 presents the proposed model and its architecture. Section 4 describes the adaptation of the BiTA framework to the alert prediction task in computer networks. Section 5 details the experimental setup and reports the evaluation results. Section 6 discusses the findings, limitations, and future works of the proposed approach. Finally, Section 7 concludes the paper and outlines future research directions. 2 Related Works Prior work on network alert prediction has explored sequential neural models 1 , 2 and graph-based representations 10 , 11 . This section focuses on temporal graph models, with particular emphasis on attention-based and transformer-inspired architectures for modeling dynamic interactions. Temporal Graph Models Perspective More recently, temporal graph neural networks (TGNs) have been proposed to model time-evolving interactions by explicitly incorporating temporal dynamics into graph representations. DyRep 18 introduces a dynamic representation learning framework that jointly models node embeddings and event intensities through temporal point processes, enabling the prediction of future interactions in dynamic networks. Similarly, memory-based models such as EdgeBank 14 store historical interactions to provide strong and efficient baselines for temporal link prediction, demonstrating that recency and interaction frequency play a critical role in forecasting future edges. Attention-based and Transformer-inspired Temporal Graph Models Perspective Recent studies have explored the integration of Transformer mechanisms into temporal graph learning to enhance long-range dependency modeling and scalability. TIDFormer 13 introduces a Transformer-based architecture for temporal interaction modeling with improved efficiency, while TF-TGN 6 incorporates attention mechanisms into the TGN framework to strengthen temporal representation learning. EasyDGL 4 focuses on scalable and modular temporal graph