Community-Aware Temporal Walks: Parameter-Free Representation Learning on Continuous-Time Dynamic Graphs
He Yu, Jing Liu · 2025
Read Community-Aware Temporal Walks: Parameter-Free Representation Learning on Continuous-Time Dynamic Graphs by He Yu, Jing Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11880.txt.
Introduction
He Yu and Jing Liu propose CTWalks in 2025, a method for learning from graphs that change over time. Such graphs model things like message networks where links appear by the minute. Older methods often lose either time detail or community structure.
CTWalks samples walks through the graph using community labels, with no tunable parameters in the sampler. It anonymizes the walks while keeping community tags, then encodes time flow with ordinary differential equations. The design captures both within-group and between-group interactions. Theory connects the method to matrix factorization and shows it avoids locality bias. On benchmark datasets it beat established methods at predicting future links.
Catalog record
| CREATOR | He Yu, Jing Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-11880
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Community-Aware Temporal Walks: Parameter-Free Representation Learning on Continuous-Time Dynamic Graphs He Yu, Jing Liu Abstract Dynamic graph representation learning plays a crucial role in understanding evolving behaviors. However, existing methods often struggle with flexibility, adaptability, and the preservation of temporal and structural dynamics. To address these issues, we propose Community-aware Temporal Walks (CTWalks), a novel framework for representation learning on continuous-time dynamic graphs. CTWalks integrates three key components: a community-based parameter-free temporal walk sampling mechanism, an anonymization strategy enriched with community labels, and an encoding process that leverages continuous temporal dynamics modeled via ordinary differential equations (ODEs). This design enables precise modeling of both intra- and inter-community interactions, offering a fine-grained representation of evolving temporal patterns in continuous-time dynamic graphs. CTWalks theoretically overcomes locality bias in walks and establishes its connection to matrix factorization. Experiments on benchmark datasets demonstrate that CTWalks outperforms established methods in temporal link prediction tasks, achieving higher accuracy while maintaining robustness. The implementation of our proposed method is publicly available at https://github.com/leonyuhe/CTWalks . 1 Introduction Continuous-Time Dynamic Graphs (CTDGs) [ 1 , 2 , 3 , 4 ] provide a comprehensive framework for modeling temporal interactions in real-world systems. By representing entities and their time-stamped interactions as nodes and edges, CTDGs capture the evolving dynamics of diverse systems, including social networks, biological processes, knowledge graphs, and recommendation platforms [ 5 , 6 , 7 , 8 , 9 ] . Among the myriad tasks supported by CTDGs, temporal link prediction [ 10 , 11 ] —predicting future interactions based on historical data—stands out as a fundamental problem. Success in this task not only enhances our understanding of dynamic systems but also drives practical applications such as personalized recommendations and anomaly detection. Despite significant advancements in dynamic graph representation learning [ 12 , 13 , 14 ] , existing methods face three critical challenges that limit their flexibility, adaptability, and expressiveness. Figure 1: Traditional anonymous encodings fail to differentiate nodes with similar local structures but distinct community roles, such as A and F . Without community context, the identical structures of A and F make it impossible to predict D ’s relationship with either node. First, current approaches rely heavily on heuristic sampling strategies to extract key graph features, including node relationships, edge interactions, and temporal patterns. However, these strategies often demand intensive hyperparameter tuning to achieve a balance between exploration and exploitation [ 15 , 16 ] . Such reliance complicates the training process and introduces sensitivity to dataset-specific characteristics, limiting their generalizability. Second, many existing methods fail to account for mesoscopic structures, such as communities [ 17 , 18 , 19 , 20 ] , which bridge local (node-level) and global (graph-level) patterns. Communities are crucial in real-world networks for distinguishing nodes with similar local structures but differing roles within their communities. Without incorporating community-aware representations, traditional anonymous encodings struggle to differentiate such nodes, resulting in ambiguity when predicting interactions, as demonstrated in Figure 1 . Finally, existing methods struggle to handle the continuous nature of temporal dynamics in real-world networks. Conventional approaches often discretize time into fixed intervals or aggregate observations, which obscures important temporal information, particularly in irregularly-sampled data. Recent advances in continuous-time models, such as Neural Ordinary Differential Equations (Neural ODEs) [ 21 ] , demonstrate the potential to preserve temporal continuity by defining hidden states at all time points through differential equations. However, integrating such continuous-time methodologies with dynamic graph structures remains an active area of research [ 22 , 23 , 24 , 25 ] , particularly in scenarios that require capturing both intra-community and inter-community temporal dependencies. To tackle these challenges, we propose Community-Aware Temporal Walks (CTWalks) , a novel, parameter-free, and community-aware framework for representation learning on CTDGs. By leveraging the interplay between intra-community and inter-community dynamics, CTWalks achieves robust scalability, expressiveness, and generalizability. Contributions of this work include: 1. Community Detection on CTDGs: CTWalks introduces an innovative method to perform community detection on CTDGs by transforming them into a weighted temporal graph . This transformation aggregates interactions into a static graph, where edge weights reflect interaction frequencies, thereby enabling the identification of node community labels reflecting temporal information. 2. Parameter-Free Temporal Sampling: CTWalks eliminates the need for handcrafted hyperparameters in sampling by adopting a community-driven mechanism. Temporal walks are adaptively performed within or across communities, encoding both structural dependencies and temporal dynamics. In the anonymization process, we embed community labels to restore contextual distinctions between nodes, reducing ambiguity and enhancing inductive capabilities. 3. Continuous-Time Dynamics via ODEs: To explicitly model temporal dependencies and capture essential dynamic laws, CTWalks employs a Neural ODE-based process. This approach learns spatiotemporal dynamics continuously, aligning modeled dynamics with irregularly sampled observations and providing a robust basis for downstream tasks. 4. Empirical Validation: Extensive experiments on benchmark datasets demonstrate CTWalks’ superior performance in the temporal link prediction task. Compared to several well-known methods, CTWalks achieves higher accuracy while maintaining competitive computational efficiency. 2 Related Work Dynamic graphs [ 12 , 13 , 14 , 26 ] provide a powerful framework for modeling systems that evolve over time, effectively capturing temporal interactions among nodes, edges, and their attributes. Depending on the representation of temporal information, dynamic graphs are broadly classified into Discrete-Time Dynamic Graphs (DTDGs) [ 27 , 28 , 29 , 30 , 31 ] and Continuous-Time Dynamic Graphs (CTDGs) [ 1 , 2 , 3 , 4 ] . DTDGs approximate temporal evolution using discrete graph snapshots, which provide a coarse-grained view of dynamic systems. In contrast, CTDGs represent interactions as a sequence of time-stamped events, which allows for high temporal fidelity, enabling the representation of systems with irregular or rapid interactions. Existing representation learning methods on dynamic graphs can be categorized into two primary paradigms: message-passing-based methods and sequence-model-based methods . Additionally, methods based on Continuous-Time Differential Equations (CTDEs) are discussed as a separate modeling approach [ 21 , 32 , 33 ] . Message-Passing-Based Methods extend graph neural networks (GNNs) [ 34 , 35 ] to incorporate temporal information by propagating and aggregating features from neighboring nodes. For example, TGN [ 1 ] integrates a memory module to store historical interactions, dynamically updating it through attention-based message passing. While effective in capturing temporal dependencies, TGN suffers from high computational overhead due to frequent memory updates and neighbor aggregation, limiting its scalability for large graphs. Other approaches, such as MTSN [ 15 ] , aim to preserve structural motifs during message passing to enhance the capture of local patterns. However, the computational cost of motif construction and repeated matrix operations makes these methods impractical for large-scale applications. Sequence-Model-Based Methods rely on recurrent neural networks (RNNs) [ 36 ] or related architectures to capture temporal dependencies by sequentially updating node embeddings. For instance, JODIE [ 37 ] employs coupled RNNs to jointly model static and dynamic embeddings, enabling tasks such as temporal link prediction. However, JODIE’s reliance on hyperparameter tuning, such as decay functions for time intervals, reduces its generalizability across datasets. Similarly, CAWs [ 3 ] leverage causal anonymous walks to encode temporal sequences while preserving the temporal order of interactions. Continuous-Time Differential Equation (CTDE)-based Methods [ 21 ] provide a robust framework for modeling temporal dynamics in graphs by treating