Beyond Isolated Clients: Integrating Graph-Based Embeddings into Event Sequence Models Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3792886 ISBN: 979-8-4007-2307-0/2026/04 CCS: Computing methodologies Machine learning algorithms CCS: Computing methodologies Neural networks CCS: Applied computing Online banking

Harry Proshian, Nikita Severin, Sergey Nikolenko, Ivan Kireev, Andrey Savchenko, Ivan Sergeev, Maria Postnova, Ilya Makarov · 2026

Read Beyond Isolated Clients: Integrating Graph-Based Embeddings into Event Sequence Models Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3792886 ISBN: 979-8-4007-2307-0/2026/04 CCS: Computing methodologies Machine learning algorithms CCS: Computing methodologies Neural networks CCS: Applied computing Online banking by Harry Proshian, Nikita Severin, Sergey Nikolenko, Ivan Kireev, Andrey Savchenko, Ivan Sergeev, Maria Postnova, Ilya Makarov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09085.txt.

Introduction

Proshian and seven colleagues add graph structure to event sequence models. There, billions of timestamped interactions help predict traits for fraud prevention and recommendations. Self-supervised learning captures event order well but misses the global structure of the user-item graph. Their three model-agnostic strategies enrich event embeddings, align client and graph embeddings, and add a structural pretext task. Tests on four finance and shopping datasets show accuracy gains of up to 2.3 percent in AUC. Graph density emerges as the key factor in picking the best strategy.

Catalog record

CREATORHarry Proshian, Nikita Severin, Sergey Nikolenko, Ivan Kireev, Andrey Savchenko, Ivan Sergeev, Maria Postnova, Ilya Makarov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19165
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.09085

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Isolated Clients: Integrating Graph-Based Embeddings into Event Sequence Models Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3792886 ISBN: 979-8-4007-2307-0/2026/04 CCS: Computing methodologies Machine learning algorithms CCS: Computing methodologies Neural networks CCS: Applied computing Online banking Harry Proshian, Nikita Severin, Sergey Nikolenko, Ivan Kireev, Andrey Savchenko, Ivan Sergeev, Maria Postnova, Ilya Makarov Abstract . Large-scale digital platforms generate billions of timestamped user-item interactions (events) that are crucial for predicting user attributes in, e.g., fraud prevention and recommendations. While self-supervised learning (SSL) effectively models the temporal order of events, it typically overlooks the global structure of the user-item interaction graph. To bridge this gap, we propose three model-agnostic strategies for integrating this structural information into contrastive SSL: enriching event embeddings, aligning client representations with graph embeddings, and adding a structural pretext task. Experiments on four financial and e-commerce datasets demonstrate that our approach consistently improves the accuracy (up to a 2.3% AUC) and reveals that graph density is a key factor in selecting the optimal integration strategy. † † cc-license: by 1. Introduction Digital platforms generate billions of timestamped interaction events daily, including purchases, clicks, and transactions, forming temporal sequences that encode user behavior. Converting these raw streams into accurate predictions of entity attributes (i.e., who a customer is) drives product recommendations, credit risk management, fraud prevention, and personalized marketing. Even a modest 1% improvement in fraud prediction AUC can translate into millions of dollars in revenue for a large institution. Supervised learning (SL) was initially applied to event sequences ( 3 ; 1 ) , but obtaining labels for many properties (e.g., creditworthiness or fraud likelihood) requires months of observation and validation, limiting SL applicability. Self-supervised learning (SSL) addresses this by learning rich representations from unlabeled data ( 17 ) through pretext tasks including masked element recovery ( 11 ; 15 ) , contrastive learning ( 2 ; 16 ) , or generative modeling ( 4 ; 10 ) . Figure 1. Global interaction graph from event sequences However, existing SSL methods model each client independently, considering only their attributed event sequences. In practice, interactions with non-clients (items, e.g. products or posts in social networks) define a bipartite graph (see Fig. 1 ) whose structure reflects global patterns useful for predictions but typically ignored. Our contributions. We bridge this gap by integrating this structural information into contrastive SSL methods for event sequences (Fig. 1 ). We propose three model-agnostic strategies: enriching event embeddings with graph features, aligning client representations with graph embeddings, and adding structural pretext tasks. Our key insight is that graph density determines the optimal integration strategy : pretrained GNN embeddings excel on moderately dense graphs, while auxiliary losses remain robust across density extremes. Experiments on four datasets from financial and e-commerce domains, using CoLES ( 2 ) and Barlow Twins ( 16 ) SSL methods, show consistent gains that remain stable across two orders of magnitude in scale. The source code of all our models and experiments are publicly available 1 1 1 https://github.com/sb-ai-lab/WWW26_Graph-Based-Embeddings-for-Event-Sequences . 2. Base SSL models for Event Sequences We adopt two popular contrastive SSL paradigms as the backbone for our graph-augmented framework: CoLES and Barlow Twins. Both methods share two low-level components: an event encoder (maps a single interaction to a vector) and a sequence encoder (aggregates a subsequence into an embedding), while differ in pair sampling and loss design. For clarity, we recap each paradigm in its vanilla form and then, in Section 3 , demonstrate how graph-based features can be integrated without altering the core architecture. CoLES ( 2 ) has four components: an encoder, a subsequence sampling algorithm, a hard negative selection algorithm, and a margin-based contrastive loss function. Subsequence sampling . Given a client sequence \mathcal{S} , CoLES draws k random slices (we set k=2 ) by choosing a length L and a start index s uniformly at random, preserving temporal order. This strategy yields k-1 positive counterparts for every anchor within a batch. Encoding . Each event is mapped to a dense vector; a GRU ( 5 ) then summarises the slice into a fixed-size embedding. We denote two such embeddings by \mathbf{u} and \mathbf{v} . Hard negative mining . The five closest (in Euclidean space) embeddings from different clients within a batch are selected as negative samples, focusing the model on the most confusing examples. Loss function . The final contrastive loss function for CoLES is {\mathcal{L}}_{\mathrm{CoLES}}=Y_{\mathbf{u}\mathbf{v}}d(\mathbf{u},\mathbf{v})^{2}+\left(1-Y_{\mathbf{u}\mathbf{v}}\right)\max\left\{0,\rho-d(\mathbf{u},\mathbf{v})\right\}^{2}, where \mathbf{u} and \mathbf{v} are two client (subsequence) embeddings, Y_{\mathbf{u}\mathbf{v}}=1 if \mathbf{u} and \mathbf{v} originate from the same client, d(\cdot,\cdot) is the Euclidean distance, and the margin \rho prevents representations of different clients from collapsing. Barlow Twins (BT) ( 16 ) BT avoids explicit negatives by maximizing similarity between two augmented views while decorrelating embedding dimensions (redundancy reduction). Batch cross-correlation . Let Z_{A},Z_{B}\in{\mathbb{R}}^{N\times d} be the matrices of embeddings obtained from two random slices of the same N clients. The empirical cross-correlation is C=\frac{1}{N}Z_{A}^{\top}Z_{B}. Loss function . The BT objective splits into the invariance term {\mathcal{L}}_{\mathrm{Inv}}=\sum_{i}(1-C_{ii})^{2} and the redundancy term {\mathcal{L}}_{\mathrm{Red}}=\sum_{i\neq j}C_{ij}^{2} , combined as {\mathcal{L}}_{\mathrm{BT}}={\mathcal{L}}_{\mathrm{Inv}}+\lambda{\mathcal{L}}_{\mathrm{Red}}, with \lambda controlling the trade-off between them. No explicit negatives are required, which eliminates the computational overhead of hard negative mining present in CoLES and makes BT attractive for large-batch training. 3. Proposed Method We aim to enhance sequence-based SSL methods with global relational context naturally encoded in interaction graphs. Our approach consists of three main steps. Graph Construction . Given timestamped events ( client , non-client , attributes ), we construct an undirected weighted bipartite graph G=(V_{\text{cl}}\cup V_{\text{ncl}},E) whose edges coincide with historical interactions (Fig. 1 ). The weight of an edge between client u and non-client v is proportional to their interaction count, rescaled by the inverse popularity of v to limit the dominance of hub nodes. Feature extraction . We experiment with two increasingly expressive feature extraction strategies for the graphs: (1) adjacency matrix , the raw 0 – 1 or weighted incidence vector that captures first-order connections between entities; (2) graph neural networks (GNNs) based on message passing mechanism, particularly: GCN ( 9 ) , GraphSAGE ( 6 ) and GAT ( 14 ) . To mitigate over-smoothing ( 12 ) , we incorporate residual connections ( 7 ) between layers. We evaluated all GNN variants but report main results using GraphSAGE embeddings, which consistently delivered the best performance. Its effectiveness stems from robust generalization and superior scalability on large graphs, enabled by an efficient neighbor sampling strategy. Integration into SSL . We introduce three strategies to incorporate graph-based embeddings into any sequence-level SSL objective. 1. GrEmb : replacing non-client entity embedding layers with GNN embeddings . GNN embeddings for non-client entities are used in SSL through joint or sequential training. In joint training, both are optimized simultaneously with a combined loss function {\mathcal{L}}=\gamma{\mathcal{L}}_{\mathrm{SSL}}+(1-\gamma){\mathcal{L}}_{\mathrm{GNN}} . The graph-based loss function is defined as {\mathcal{L}}_{\mathrm{GNN}}=\alpha{\mathcal{L}}_{\mathrm{LP}}+(1-\alpha){\mathcal{L}}_{\mathrm{WP}} , where {\mathcal{L}}_{\mathrm{LP}} is the binary cross-entropy (BCE) for link prediction, and {\mathcal{L}}_{\mathrm{WP}} is either BCE or mean squared error (MSE) for weight prediction. In sequential training, graph features are pretrained and used to initialize CoLES. 2. Reg : SSL regularization with

Read the complete text