Multivariate de Bruijn Graphs: A Symbolic Graph Framework for Time Series Forecasting
Mert Onur Cakiroglu 1 , Idil Bilge Altun 1 , Hasan Kurban 2 , Elham Buxton 3 and Mehmet Dalkilic 1 · 2025
Read Multivariate de Bruijn Graphs: A Symbolic Graph Framework for Time Series Forecasting by Mert Onur Cakiroglu 1 , Idil Bilge Altun 1 , Hasan Kurban 2 , Elham Buxton 3 and Mehmet Dalkilic 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22768.txt.
Introduction
Forecasting a stream of numbers is hard when several streams interact and no symbols mark the events. Cakiroglu and co-authors turn the streams into symbols first. Their encoder, DRAGON, chops continuous sequences into discrete tokens and lays them on a fixed graph structure called a multivariate de Bruijn graph, where edges record which token strings follow which.
An attention mechanism over that graph recovers context dynamically, giving the neural model a structured view of the past. DRAGON runs as a helper branch beside a conventional convolutional encoder, adding its symbolic, structure-aware picture to the raw signal features. The authors release their full code library with the paper. They present the graph encoding as a bridge between old symbolic time-series methods and modern neural forecasting.
Catalog record
| CREATOR | Mert Onur Cakiroglu 1 , Idil Bilge Altun 1 , Hasan Kurban 2 , Elham Buxton 3 and Mehmet Dalkilic 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-22768
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multivariate de Bruijn Graphs: A Symbolic Graph Framework for Time Series Forecasting Mert Onur Cakiroglu 1 , Idil Bilge Altun 1 , Hasan Kurban 2 , Elham Buxton 3 and Mehmet Dalkilic 1 Abstract Time series forecasting remains a challenging task for foundation models due to temporal heterogeneity, high dimensionality, and the lack of inherent symbolic structure. In this work, we propose DRAGON ( D iscrete R epresentation and A ugmented G raph encoding O ver de Bruij N Graphs), a novel encoder that introduces Multivariate de Bruijn Graphs (MdBGs) to bridge the gap between symbolic representations and neural modeling. DRAGON discretizes continuous input sequences and maps them onto a fixed graph structure, enabling dynamic context recovery via graph-based attention. Integrated as an auxiliary module within a dual-branch architecture, DRAGON augments conventional CNN-based encoders with symbolic, structure-aware representations. All code developed for this study is available at: https://github.com/KurbanIntelligenceLab/MultdBG-Time-Series-Library 1 Introduction Foundation models have made great strides in NLP [ 15 ] and computer vision [ 1 ] by utilizing non-numeric, large-scale data; however, the same level of generalization has not emerged in the domain of time series where challenges exist e.g. , temporal heterogeneity, multivariate dependencies, and distant relationships. Figure 1: Illustration of de Bruijn Graphs for univariate and multivariate dimensions. ( Left ) The univariate dBG encodes k -tuples with directed and weighted edges in a single dimension. ( Right ) The multivariate dBG extends this structure by incorporating edges (hyper-tuples) that connect k -tuples across multiple dimensions at the same time step, capturing inter-variable dependencies. Existing time series forecasting models rely heavily on the inputs being numeric, especially continuous [ 4 ] [ 10 ] while missing out on recurring motifs that are central to many real-world temporal processes. Moreover, the common practice of creating fixed-size sliding window fragments from long sequences to facilitate supervised training limits the model’s access to the global context outside the current fragment. To address these gaps, we introduce a new architecture that incorporates a symbolic graph-based structure into time series modeling through de Bruijn Graphs (dBG) [ 3 ] . dBGs are widely used in computational biology in applications such as genome assembly and k-mer–based (also known as k-tuple) sequence modeling to efficiently and compactly represent long sequences from overlapping fragments [ 2 ] . Modeling time series data as dBG allows transforming continuous temporal data into a compact symbolic representation that captures recurring motifs and long-range dependencies across sequence fragments. We introduce a novel method for encoding multivariate time series as Multivariate de Bruijn Graphs (MdBGs) to capture patterns both within and across dimensions, allowing models to access cross sequence global context while processing each sliding window locally. Our contributions are threefold: (i) MdBG, a multivariate extension of de Bruijn graphs, captures intra-, inter-dimensional, and long-range dependencies; (ii) DRAGON, an encoder built on MdBGs, generates task-specific time series embeddings and integrates into any model; and (iii) DRAGON outperforms state-of-the-art methods on forecasting benchmarks, including TimesNet [ 13 ] . Figure 2: The DRAGON architecture employs a MdBG as a fixed graph database built from the entire training set. MdBG structure remains constant across batches and is encoded through L layers of Graph Attention Convolution (GATConv) with ELU activation. A node-level hard mask determines active nodes and is used to select encodings for the subgraph corresponding to the (k{-}1) -tuples in the input sequence. Only the node features are updated through masking. To obtain the final output, an attention pooling mechanism is applied that aggregates the graph-level features and reshapes them to match the input sequence length. B denotes the Batch size, D is the number of input dimensions, N is the number of MdBG nodes and E is the edge feature dimension. 2 Methods 2.1 Multivariate de Bruijn Graphs (MdBGs) 2.1.1 Data Processing Figure 3: Overview of the proposed DRAGON architecture for multivariate time series modeling. The input sequence of shape \mathbb{R}^{B\times D\times S} where B is the batch size, is processed through two parallel branches. In the top branch, the sequence is discretized and passed into the DRAGON encoder, which constructs MdBGs and generates graph-based embeddings of shape \mathbb{R}^{B\times J\times S\times G} where J is the number of the DRAGON encoders. These embeddings are then aggregated via an attention pooling mechanism to produce the output of the shape \mathbb{R}^{B\times S\times G} . In the bottom branch, the original continuous sequence is fed into a 1D CNN encoder, yielding features of shape \mathbb{R}^{B\times S\times C} . The outputs from both branches are concatenated to form a joined representation of shape \mathbb{R}^{B\times S\times(C+G)} , which is then sent to a downstream model for prediction. Let \mathcal{D}^{\text{raw}}=\{\mathbf{X}_{1}^{\text{raw}},\mathbf{X}_{2}^{\text{raw}},\dots,\mathbf{X}_{D}^{\text{raw}}\} be a time series data with D dimensions. Each raw sequence is defined as: \mathbf{X}_{i}^{\text{raw}}=[x_{1}^{i},x_{2}^{i},\dots,x_{S}^{i}],\quad where x_{t}^{i}\in\mathbb{R} and S is the sequence length. Since dBGs operate on categorical data, the raw input \mathbf{X}_{i}^{\text{raw}} is first discretized using a discretization function \textsc{DISC}_{i}(\mathbf{X}_{i}^{\text{raw}},\alpha_{i})\rightarrow\mathbf{X}_{i}^{\text{disc}} . The set of bin sizes for all dimensions is denoted by A=\{\alpha_{1},\alpha_{2},\dots,\alpha_{n}\} , where \alpha_{i} represents the bin size for dimension i . Similarly, the set of discretization functions is denoted by \mathbf{F}=\{\textsc{DISC}_{1},\textsc{DISC}_{2},\dots,\textsc{DISC}_{D}\} . This formulation allows discretization to be customized independently for each dimension. The resulting discretized dataset, denoted as \mathcal{D} , consists of sequences defined as follows: \mathcal{D}^{\text{disc}}=\{\mathbf{X}_{1}^{\text{disc}},\mathbf{X}_{2}^{\text{disc}},\dots,\mathbf{X}_{D}^{\text{disc}}\},\quad\text{where} \mathbf{X}_{i}^{\text{disc}}=[c_{1}^{i},c_{2}^{i},\dots,c_{S}^{i}],\quad c_{t}^{i}\in\{1,2,\dots,\alpha_{i}\}. Each discretized element c_{t}^{i} represents a categorical value bounded by the discretization level \alpha_{i} . 2.1.2 Graph Construction A single MdBG is constructed from all sequences in the training set prior to model training. This allows the entire training set to be compactly represented as a graph and provides global context during model training. MdBG is a structured graph representation of both intra- and inter-dimensional dependencies of multivariate sequence data. It is formally defined as G(V,E) where V is the set of nodes (fixed-length strings over some alphabet) and E is the set of directed edges (fixed-length strings over the same alphabet) where some overlapping substring of fixed size between two nodes. E is labeled with a non-negative number. More formally, a dBG of order k is a directed graph where each node represents a unique univariate (k{-}1) -tuple (a subsequence of length k{-}1 ), and each edge corresponds to a k -tuple (length- k subsequence) observed in the input sequence. Specifically, the set of k -tuples. \mathbf{e}_{t}^{i}=\left(x_{t}^{i},x_{t+1}^{i},\dots,x_{t+k-1}^{i}\right) induces a directed edge from the prefix node to the suffix node, \mathbf{v}_{\text{prefix}}=\left(x_{t}^{i},\dots,x_{t+k-2}^{i}\right)\longrightarrow\mathbf{v}_{\text{suffix}}=\left(x_{t+1}^{i},\dots,x_{t+k-1}^{i}\right) for t=1,2,\dots,\left(S-k+1\right) . Each \mathbf{e}_{t}^{i} defines a directed edge between two (k{-}1) -tuple nodes, capturing temporal transitions in the sequence. Repeated transitions increment the edge weights, encoding frequency. The construction of a dBG from univariate data is illustrated in Figure 1 ( Left ). Each node \mathbf{v}\in V can correspond to a set of continuous k -tuples extracted from the original raw dataset \mathcal{D}^{\text{raw}} . This set is denoted as the feature space of node \mathbf{v} : \mathcal{F}_{\mathbf{v}}=\{x^{k}_{1},x^{k}_{2},\dots,x^{k}_{m}\}, where each x^{k}_{i}\in\mathbb{R}^{k} and 1\leq m\leq S-k+2 . This feature set \mathcal{F}_{\mathbf{v}} captures the continuous embeddings associated with the discrete representation \mathbf{v} . After constructing individual dBGs for each dimension, a set of D disconnected subgraphs \textbf{MdBG}=\{G_{1},G_{2},\dots,G_{D}\} is obtained, where each graph layer G_{i}=(V_{i},E_{i}) contains a set of nodes V_{i} representing all observed univariate (k{-}1) -tuples from dimension i , and directed edges