Bridging Discrete Marks and Continuous Dynamics: Dual-Path Cross-Interaction for Marked Temporal Point Processes

Yuxiang Liu, Qiao Liu, Tong Luo, Yanglei Gan, Peng He, and Yao Liu🖂 · 2026

Read Bridging Discrete Marks and Continuous Dynamics: Dual-Path Cross-Interaction for Marked Temporal Point Processes by Yuxiang Liu, Qiao Liu, Tong Luo, Yanglei Gan, Peng He, and Yao Liu🖂 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11462.txt.

Introduction

Liu and co-authors present NEXTPP, a dual-path model for marked temporal point processes. Such data pair event times with discrete marks, and the links between them are tangled. Older sequence models track event tokens yet skip the drift between events, while Neural ODE models miss how event types shape timing. NEXTPP runs self-attention on the marks beside a Neural ODE state, then fuses both streams by cross-attention. The fused state drives a neural Hawkes intensity, and tests on five data sets beat best models to date.

Catalog record

CREATORYuxiang Liu, Qiao Liu, Tong Luo, Yanglei Gan, Peng He, and Yao Liu🖂
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35641
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11462

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging Discrete Marks and Continuous Dynamics: Dual-Path Cross-Interaction for Marked Temporal Point Processes Yuxiang Liu, Qiao Liu, Tong Luo, Yanglei Gan, Peng He, and Yao Liu🖂 Abstract Predicting irregularly spaced event sequences with discrete marks poses significant challenges due to the complex, asynchronous dependencies embedded within continuous-time data streams. Existing sequential approaches capture dependencies among event tokens but ignore the continuous evolution between events, while Neural Ordinary Differential Equation (Neural ODE) methods model smooth dynamics yet fail to account for how event types influence future timing. To overcome these limitations, we propose NEXTPP, a dual-channel framework that unifies discrete and continuous representations via Event-granular Neural Evolution with Cross-Interaction for Marked Temporal Point Processes. Specifically, NEXTPP encodes discrete event marks via a self-attention mechanism, simultaneously evolving a latent continuous-time state using a Neural ODE. These parallel streams are then fused through a cross-attention module to enable explicit bidirectional interaction between continuous and discrete representations. The fused representations drive the conditional intensity function of the neural Hawkes process, while an iterative thinning sampler is employed to generate future events. Extensive evaluations on five real-world datasets demonstrate that NEXTPP consistently outperforms state-of-the-art models. The source code can be found at https://github.com/AONE-NLP/NEXTPP . 1 Introduction Event sequences consist of discretely distributed, irregularly timed occurrences whose intervals encode rich temporal dependencies absent in uniformly sampled time series [ 5 , 23 ] . Such asynchronous data arise in diverse applications, from information diffusion in social networks [ 21 ] and patient monitoring in healthcare [ 25 ] to user behavior in e-commerce and seismic activity forecasting [ 7 ] . Modeling these sequences requires frameworks capable of jointly handling strictly positive inter-event times and categorical “marks” (e.g., event type or location). Temporal point processes (TPPs) [ 4 ] provide a unified mathematical foundation by defining a non-negative intensity function that governs the instantaneous event occurrence intensity given past observations. Classical TPPs, such as Poisson process [ 14 ] and self-exciting Hawkes processes [ 8 ] leverage fixed, parametric intensity functions and enjoy well-established statistical properties, but their restrictive assumptions often fail to capture the nonlinear dynamics exhibited by real-world event streams. Figure 1: Seismic timeline for the August 30, 2009 sequence, showing 18 events within 12.3 s. A magnitude 5.2 mainshock at 11.56s marks the transition from foreshocks to aftershocks, illustrating the classic three-phase seismic cycle. Marked TPPs (MTPPs) extend the framework by associating each event with a mark, thereby moving from univariate to multivariate modeling. Contemporary MTPP methods fall into two distinct categories: Discrete-time models , typically based on Recurrent Neural Networks (RNNs) or Transformer [ 5 , 34 ] , excel in learning dependencies among event tokens yet disregard the continuous nature of time. Continuous-time models , including Neural Ordinary Differential Equations and latent Stochastic Differential Equations formulations [ 3 , 20 ] , evolve hidden representations smoothly over real time but typically do not integrate observed event marks, thereby missing explicit dependencies between marks and their temporal evolution. Consequently, neither strand fully captures the bidirectional information flow between discrete event marks and their latent continuous-time dynamics, leaving critical gaps in the current schemes. To illustrate, consider the 18 consecutive seismic event sequence occurred in California, USA on August 30, 2009 in Figure 1 . Over just 12.3 s, small foreshocks (magnitude 2.5-4.0) occur at irregular intervals that evolve into an \mathbf{M} 5.2 mainshock at 11.56s, immediately followed by densely clustered aftershocks of varying magnitudes. A discrete-time approach could learn the magnitude progression but would lacks modeling of temporal dependencies, whereas a continuous - time ODE can accurately fit event timestamps but lacks modeling of correlations between different earthquakes. Thus, temporal dependencies between events in the continuous-time dimension are fundamentally coupled with mutual influences among events in the discrete-event dimension—where continuous-time dependencies provide dynamic context for discrete event interactions, while discrete event influences in turn guide the evolutionary trajectory of continuous-time dependencies. We require a unified framework to model the interplay between continuous and discrete dynamics. To bridge this gap, we introduce NEXTPP, a dual-channel architecture that integrates Neural Evolution with Cross-Interaction for Marked Temporal Point Process. Specifically, the discrete stream encodes event representation via self-attention, while the continuous stream evolves each latent state via a Neural ODE to capture fine-grained temporal evolution between events. A cross-attention block then fuses the two streams, allowing event marks to influence future timings and temporal context to inform mark generation. This cross-interaction mechanism allows event magnitudes to adjust future timing predictions, while temporal context refines mark forecasts. The fused representations drive the conditional intensity function of the neural Hawkes process, while an iterative thinning sampler is employed to generate future events. Our main contributions are as follows: 1) We propose an event-granularity-based sequential evolution strategy, which achieves the modeling of complex temporal dependencies in temporal point processes while strictly preserving the global structural consistency of the Hawkes process. 2) We establish the influence of historical events on the current event, enhancing the model’s representational capacity for event evolution via bidirectional semantic alignment between continuous state trajectories and discrete event representations. 3) Extensive experiments on five real-world datasets show that our proposed model attains more precise predictions and superior interpretability compared with state-of-the-art methods. 2 Preliminaries and Related Works 2.1 Marked Temporal Point Processes MTPPs are stochastic models that characterize the joint distribution of event times and their associated categorical types (marks). Formally, an event sequence of length L is denoted by \mathcal{S}=\{(t_{i},m_{i})\}_{i=1}^{L} , where the t_{i}\in(0,T) is the arrival time of i -th event, and m_{i}\in\{1,2,...M\} is its corresponding type. Assuming that the event times are strictly increase monotonically, so the inter-event interval satisfies {\bigtriangleup}t_{i}=t_{i}-t_{i-1}\in{\mathbb{R}}^{+} , with the convention \bigtriangleup t_{1}=t_{1} . Let \mathcal{H}_{t}=\{e_{j}=(t_{j},m_{j})|t_{j}<t\} denote the historical event sequence until time t , the event distribution of the MTPPs is then denoted as the following conditional intensity function: {\lambda}^{i}(t,m)\triangleq\lambda(t,m|\mathcal{H}_{t_{i}})\\ =\lim_{\bigtriangleup t\to 0}\frac{\mathbb{P}(t_{i}\in[t,t+\bigtriangleup t],m_{i}=m|\mathcal{H}_{t_{i}})}{\bigtriangleup t}. (1) For notational brevity, the explicit dependence on \mathcal{H}_{t_{i}} is absorbed into the superscript i in Eq ( 1 ). The conditional intensity function characterizes the instantaneous rate that the event with a mark m will occur during the time interval [t,t+\bigtriangleup t] under the given historical event sequence H_{t_{i}} . The generalized conditional probability is then expressed as: p^{i}(t,m)=\lambda^{i}(t,m)e^{-\int^{t}_{t_{i-1}}\sum^{M}_{l=1}\lambda^{i}(s,l)ds}. (2) Classical statistical point process models typically rely on parametric intensity functions. The Poisson process [ 14 ] is the most fundamental independent increment process. Hawkes processes [ 8 ] introduce self - excitation: each event transiently boosts future intensity via a decaying kernel, capturing clustering. Self - correcting processes [ 11 ] instead impose self - inhibition, with each event suppressing subsequent intensity to maintain balance. These conventional approaches merely model purely excitatory or inhibitory effects, but are incapable of capturing the intricate dependency structures embedded within real-world event streams. Deep learning–based TPP models replace handcrafted intensities with learned representations. Early approaches used RNNs to encode event histories via the iterative hidden-state updates [ 5 , 17 ] , but encountered bottlenecks in capturing long-range dependencies and computational efficiency. Attention-based paradigms for MTPPs were further established to capturing global dependencies in event sequences. The Self-attentive and Transformer Hawkes processes were individually proposed in [ 29 ] and [ 34 ] .

Read the complete text