Neural Continuous-Time Markov Chain: Discrete Diffusion via Decoupled Jump Timing and Direction
Jingyuan Li, Xiaoyi Jiang, Fukang Wen, Wei LiuRenqian Luo, Yi Zhu, Zuoqiang Shi, Pipi Hu, [0.5ex] Tsinghua University · 2026
Read Neural Continuous-Time Markov Chain: Discrete Diffusion via Decoupled Jump Timing and Direction by Jingyuan Li, Xiaoyi Jiang, Fukang Wen, Wei LiuRenqian Luo, Yi Zhu, Zuoqiang Shi, Pipi Hu, [0.5ex] Tsinghua University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15694.txt.
Introduction
Li and seven colleagues split discrete diffusion into jump when and jump where, with one head for exit rate and one for jump spread. The bound splits too, into a Poisson gap for timing and a class gap for aim, with a plain, steady loss to train on. Their pure-uniform Neural CTMC scores 16.36 on TinyStories, far past GIDD at 37.60 and MDLM at 42.66. It also tops OpenWebText perplexity at the same token spend, with 183.6 at 128 steps against MDLM at 210.5 and GIDD at 249.8.
Catalog record
| CREATOR | Jingyuan Li, Xiaoyi Jiang, Fukang Wen, Wei LiuRenqian Luo, Yi Zhu, Zuoqiang Shi, Pipi Hu, [0.5ex] Tsinghua University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99688 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15694
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Continuous-Time Markov Chain: Discrete Diffusion via Decoupled Jump Timing and Direction Jingyuan Li, Xiaoyi Jiang, Fukang Wen, Wei LiuRenqian Luo, Yi Zhu, Zuoqiang Shi, Pipi Hu, [0.5ex] Tsinghua University Abstract Discrete diffusion models based on continuous-time Markov chains (CTMCs) have shown strong performance on language and discrete data generation, yet existing approaches typically parameterize the reverse rate matrix as a single object—via concrete scores, clean-data predictions ( x 0 x_{0} -parameterization), or denoising distributions—rather than aligning the parameterization with the intrinsic CTMC decomposition into jump timing and jump direction. Since a CTMC is fundamentally a Poisson process fully determined by these two quantities, decomposing along this structure is closer to first principles and naturally leads to our formulation. We propose Neural CTMC , which separately parameterizes the reverse process through an exit rate (when to jump) and a jump distribution (where to jump) using two dedicated network heads. We show that the evidence lower bound (ELBO) differs from a path-space KL divergence between the true and learned reverse processes by a θ \theta -independent constant, so that the training objective is fully governed by the exit rate and jump distribution we parameterize. Moreover, this KL factorizes into a Poisson KL for timing and a categorical KL for direction. We further show that the tractable conditional surrogate preserves the gradients and minimizers of the corresponding marginal reverse-process objective under standard regularity assumptions. Our theoretical framework also covers masked and GIDD-style noise schedules. Empirically, while the uniform forward process has been explored in prior work, our model, to our best of the knowledge, is the first pure-uniform method to outperform mask-based methods on the OpenWebText dataset.To facilitate reproducibility, we release our pretrained weights at https://huggingface.co/Jiangxy1117/Neural-CTMC . 1 Introduction Diffusion models have achieved remarkable success in continuous domains such as images ( 26 ; 11 ; 28 ) and audio, establishing score-based generative modeling as a dominant paradigm. Extending this success to discrete data—language ( 16 ; 10 ) , proteins ( 1 ; 4 ) , and molecular graphs ( 30 ) —is an active and challenging research direction, since the continuous score function and Langevin dynamics that underpin continuous diffusion have no direct discrete counterpart. Discrete diffusion models formulate the forward corruption and reverse generation as continuous-time Markov chains (CTMCs) on a finite state space \mathcal{S}=\{1,\ldots,S\} . D3PM ( 3 ) and Multinomial Diffusion ( 12 ) initiated this line by introducing discrete transition matrices in discrete time. 5 extended the framework to continuous time, deriving a variational bound from CTMC path measures. Subsequent work has explored different parameterizations of the reverse rate matrix R^{\theta}_{t}(i,j) : SEDD ( 17 ) learns a concrete score ratio q_{t}(j)/q_{t}(i) analogous to continuous score matching ( 13 ; 18 ) ; MDLM ( 24 ) simplifies training via clean-data prediction ( x_{0} -parameterization) under a masked (absorbing) forward process; GIDD ( 31 ) extends the x_{0} -parameterization to unify absorbing, uniform, and interpolating forward processes under a general framework; and concurrent efforts have explored discrete flow matching ( 6 ; 8 ) and simplified masked diffusion ( 25 ; 21 ) . These methods have achieved increasingly strong results on language modeling benchmarks. Despite this progress, a fundamental structural property of CTMCs has not been directly reflected in the reverse-process parameterization. Any rate matrix admits a unique factorization R_{t}(i,j)\;=\;\lambda_{t}(i)\cdot r_{t}(j\mid i),\qquad\lambda_{t}(i)=\textstyle\sum\limits_{j\neq i}R_{t}(i,j),\quad r_{t}(j\mid i)=R_{t}(i,j)/\lambda_{t}(i), where \lambda_{t}(i) is the exit rate governing when to jump and r_{t}(\cdot\mid i) is the jump distribution governing where to jump. This exit-rate/jump-distribution decomposition is precisely the basis of Gillespie’s algorithm ( 9 ; 2 ) for exact CTMC simulation: first draw a holding time from the exit rate, then choose the next state from the jump distribution. Despite being classical, this structure has not been reflected in the reverse-process parameterization of discrete diffusion models—existing methods still learn the reverse process through proxy quantities such as score ratios, clean-data predictions, or denoising distributions, which implicitly determine R^{\theta}_{t} as a monolithic object. Inspired by the algorithmic decomposition in Gillespie’s algorithm, our starting point is that the training objective itself also decomposes along this timing/direction structure, suggesting a parameterization and training rule that make this separation explicit. Moreover, the two mainstream forward processes in discrete diffusion are masked (absorbing) and uniform. The masked forward process is dominant in current state-of-the-art methods ( 24 ; 31 ) , but once a token is absorbed into the mask state it cannot be revisited, preventing the model from correcting earlier decisions during generation ( 31 ) . The uniform forward process avoids this limitation by allowing transitions among all S states, yet it has received comparatively little attention and generally yields weaker results ( 17 ; 3 ; 31 , e.g.,) , among others. We propose Neural CTMC , which addresses both gaps. First, we separately parameterize the exit rate \lambda^{\theta}_{t} and the jump distribution r^{\theta}_{t} for the reverse process via two network heads. We show that the \theta -dependent part of the ELBO is equivalent to a reverse-process KL divergence up to a \theta -independent constant, and that this KL naturally decomposes as \mathrm{KL}^{\text{Poi}}(\hat{\lambda}\|\lambda^{\theta})\;+\;\hat{\lambda}\cdot\mathrm{KL}^{\text{Cat}}(\hat{r}\|r^{\theta}), a Poisson KL for jump timing and a categorical KL for jump direction. This decomposition is not introduced ad hoc at the architecture level; rather, it is induced by the CTMC path-space objective itself, which suggests learning timing and direction with separate heads. Notably, when specialized to the masked (absorbing) forward process, our objective recovers the MDLM loss exactly, showing that the decomposed formulation strictly generalizes existing approaches. Second, equipped with this decomposed parameterization, Neural CTMC with a pure uniform forward process surpasses several state-of-the-art masked-based methods on the benchmarks we study. Contributions. 1. A reverse-process parameterization aligned with CTMC structure. We parameterize the reverse CTMC through separate exit-rate and jump-distribution heads, motivated by the intrinsic timing/direction factorization of CTMC dynamics (Sections 2 and 4.1 ). 2. A decomposition of the reverse-process objective. We derive the ELBO from CTMC path measures and show that its \theta -dependent part differs from a reverse-process KL only by a constant. This KL decomposes into a Poisson KL for exit rates and a categorical KL for jump distributions, yielding separate timing and direction learning signals. We also show that the tractable conditional surrogate preserves the gradients and minimizers of the corresponding marginal reverse-process objective under standard regularity assumptions (Section 4.1 ). 3. Strong empirical performance with a pure uniform forward process. On TinyStories, Neural CTMC achieves generative perplexity \leq 16.36 , compared with \leq 37.60 for GIDD and \leq 42.66 for MDLM under our evaluation protocol. On OpenWebText, it achieves the best equal-budget generative perplexity among the methods we evaluate across 16 to 128 sampling steps and is, to the best of our knowledge, the first pure-uniform-forward-process method to outperform mask-based methods on this benchmark; it also remains competitive with SEDD despite using 2.6\times fewer training tokens (Section 5 ). To the best of our knowledge, we release the first open-source checkpoints for a uniform-noise discrete diffusion model. 2 Background 2.1 Continuous-Time Markov Chains Let \mathcal{S}=\{1,\ldots,S\} be a finite state space. A CTMC on \mathcal{S} over [0,T] ( 20 ) is characterized by a rate matrix R_{t} with R_{t}(i,j)\geq 0 for i\neq j and