Discrete Adjoint Schrödinger Bridge Sampler Wei Guo, Yuchen Zhu, Xiaochen Du, Juno Nam, Yongxin Chen, Rafael Gómez-Bombarelli, Guan-Horng Liu, Molei Tao, Jaemoo Choi Abstract Learning discrete neural samplers is challenging due to the lack of gradients and combinatorial complexity. While stochastic optimal control (SOC) and Schrödinger bridge (SB) provide principled solutions, efficient SOC solvers like adjoint matching (AM), which excel in continuous domains, remain unexplored for discrete spaces. We bridge this gap by revealing that the core mechanism of AM is state-space agnostic , and introduce discrete ASBS , a unified framework that extends AM and adjoint Schrödinger bridge sampler (ASBS) to discrete spaces. Theoretically, we analyze the optimality conditions of the discrete SB problem and its connection to SOC, identifying a necessary cyclic group structure on the state space to enable this extension. Empirically, discrete ASBS achieves competitive sample quality with significant advantages in training efficiency and scalability. † † affiliationnotice: Equal contribution \icmlEqualContributionSecond Equal advising 1 Introduction Sampling from unnormalized distributions is a fundamental problem across computational statistics ( Liu 2008 ; Brooks et al. 2011 ) , Bayesian inference ( Gelman et al. 2013 ) , and statistical mechanics ( Landau & Binder 2014 ) . The goal is to draw samples from a target distribution \nu on a state space \mathcal{X} , where \nu(x)\propto\mathrm{e}^{-\beta E(x)} is specified through an energy function E:\mathcal{X}\to\mathbb{R} and inverse temperature \beta>0 . In high-dimensional settings with complex energy landscapes, traditional methods such as Markov chain Monte Carlo (MCMC) suffer from slow mixing and poor scalability. Recent advances in neural samplers address these challenges by parameterizing sampling dynamics with deep neural networks, enabling efficient learning even without i.i.d. samples from the target. Crucially, these methods provide amortized inference, replacing costly MCMC iterations with rapid generation from a pretrained model. For continuous state space \mathcal{X}=\mathbb{R}^{D} , neural samplers have achieved remarkable success through diverse methodologies ( He et al. 2025 ; Sanokowski et al. 2025b ) , including sequential Monte Carlo ( Phillips et al. 2024 ) , escorted transport ( Vargas et al. 2024 ; Albergo & Vanden-Eijnden 2025 ; Chen et al. 2025 ; Blessing et al. 2025b ; Du et al. 2025 ) , stochastic optimal control (SOC, Zhang & Chen 2022 ; Vargas et al. 2023 ; Richter & Berner 2024 ), parallel tempering ( Rissanen et al. 2025 ; Akhound-Sadegh et al. 2025 ; Zhang et al. 2026 ) , etc. Among SOC approaches, adjoint matching ( AM , Domingo-Enrich et al. 2025a ; Havens et al. 2025 ) has emerged as a powerful solver, enabling the framework of adjoint Schrödinger bridge sampler ( ASBS , Liu et al. 2025a ), which offers fast convergence, scalability, and flexibility in reference dynamics. However, AM relies fundamentally on continuous calculus, making its extension to discrete state spaces highly nontrivial. Motivated by these successes, recent work has explored discrete neural samplers based on continuous-time Markov chains (CTMCs), proposing similar methods based on escorted transport ( Holderrieth et al. 2025 ; Ou et al. 2025b ) and SOC formulations ( Zhu et al. 2025a ; Guo et al. 2026 ) . Despite this progress, the Schrödinger Bridge (SB) problem – a distributionally constrained optimization framework central to optimal transport ( Léonard 2014 ; Chen et al. 2016b ; Chen et al. 2021 ) and continuous diffusion models ( Chen et al. 2021 ; De Bortoli et al. 2021 ; Chen et al. 2022 ; Liu et al. 2022 ; Shi et al. 2023 ) – remains underdeveloped for discrete spaces ( Ksenofontov & Korotin 2025 ; Kim et al. 2025 ) . The theoretical connection between discrete SB and SOC is not fully established, and no discrete SOC solver achieves the efficiency of continuous AM. While a recent work So et al. 2026 attempted to adapt AM to masked discrete diffusion, their approach yields complex training objectives, leaving a principled and efficient discrete AM framework an open challenge. In this work, we develop a unified theoretical framework for SB and SOC on discrete state spaces, introducing the discrete adjoint Schrödinger bridge sampler (DASBS) . We derive optimality conditions for the discrete SB problem that structurally mirror the continuous setting, and extend AM to discrete domains through novel controller and corrector learning objectives. Our approach reveals that a group structure on the state space and uniform reference dynamics are essential – requirements that parallel the additive noise assumption in continuous AM. Our key contributions are: I. Unified Discrete Framework : We formalize discrete neural sampling as an SB problem for CTMCs and establish its equivalent SOC formulation. II. Generalizing Adjoint Matching : We identify state-space agnostic principles underlying AM, providing conceptual clarity for extensions beyond continuous spaces. III. Discrete ASBS : We introduce discrete ASBS, a principled algorithm that alternates between adjoint and corrector matching, derived from variational characterizations of the learning objectives. IV. Empirical Validation : We validate DASBS on high-dimensional discrete benchmarks, demonstrating competitive performance and efficiency. Table 1 : Conceptual comparison between denoising matching and adjoint matching in continuous and discrete state spaces. Denoising matching holds for general reference dynamics while adjoint matching requires additive noise. Continuous state space \mathcal{X}=\mathbb{R}^{D} Discrete state space \mathcal{X}=\mathbb{Z}_{N}^{D} Ref. dyn. p^{r} \mathrm{d}X_{t}=b_{t}(X_{t})\mathrm{d}t+\sigma_{t}\mathrm{d}W_{t} , X_{0}\sim\mu CTMC (X_{t}) with transition rate (r_{t}) , X_{0}\sim\mu Ctrl. dyn. p^{u} \mathrm{d}X_{t}=(b_{t}+\sigma_{t}u_{t})(X_{t})\mathrm{d}t+\sigma_{t}\mathrm{d}W_{t} , X_{0}\sim\mu CTMC (X_{t}) with transition rate (u_{t}) , X_{0}\sim\mu SB Prob. \min\limits_{u~\text{s.t.}~X_{1}\sim\nu}\underset{X\sim p^{u}}{\mathbb{E}}\Big[\int\limits_{0}^{1}\frac{1}{2}\|u_{t}(X_{t})\|^{2}\mathrm{d}t\Big] \min\limits_{u~\text{s.t.}~X_{1}\sim\nu}\underset{X\sim p^{u}}{\mathbb{E}}\Big[\int\limits_{0}^{1}\sum\limits_{y\neq X_{t}}\big(u_{t}\log\frac{u_{t}}{r_{t}}+r_{t}-u_{t}\big)(y,X_{t})\mathrm{d}t\Big] SOC Prob. \min\limits_{u}\underset{X\sim p^{u}}{\mathbb{E}}\Big[\int\limits_{0}^{1}\frac{1}{2}\|u_{t}(X_{t})\|^{2}\mathrm{d}t+\log\frac{\widehat{\varphi}_{1}}{\nu}(X_{1})\Big] \min\limits_{u}\underset{X\sim p^{u}}{\mathbb{E}}\Big[\int\limits_{0}^{1}\sum\limits_{y\neq X_{t}}\big(u_{t}\log\frac{u_{t}}{r_{t}}+r_{t}-u_{t}\big)(y,X_{t})\mathrm{d}t+\log\frac{\widehat{\varphi}_{1}}{\nu}(X_{1})\Big] Opt. Ctrl. u^{\star}_{t}(x)=\sigma_{t}\nabla\log\varphi_{t}(x) u^{\star}_{t}(y,x)=r_{t}(y,x)\frac{\varphi_{t}(y)}{\varphi_{t}(x)} Corrector \nabla\log\widehat{\varphi}_{1}(x) \frac{\widehat{\varphi}_{1}(y)}{\widehat{\varphi}_{1}(x)} Example of Additive Noise b_{t}\equiv 0\Rightarrow\boxed{p^{r}_{1|t}(x_{1}|x)=q_{t}(x_{1}-x)} q_{t}(\varepsilon)=\mathcal{N}(\varepsilon;0,\widetilde{\sigma}_{t}^{2}I) r_{t}(y,x)=\frac{\gamma_{t}}{N}1_{d_{\mathrm{H}}(x,y)=1}\Rightarrow\boxed{p^{r}_{1|t}(x_{1}|x)=q_{t}(x_{1}-x)} q_{t}(\varepsilon)=A(t,1)^{d_{\mathrm{H}}(\varepsilon,0)}B(t,1)^{D-d_{\mathrm{H}}(\varepsilon,0)} Denoising Matching \nabla\log\varphi_{t}(x)=\mathbb{E}_{p^{\star}_{1|t}(x_{1}|x)}{\color[rgb]{0.0039,0.5195,0.4961}\nabla_{x}\log p^{r}_{1|t}(x_{1}|x)} (1) \nabla\log\widehat{\varphi}_{1}(x)=\mathbb{E}_{p^{\star}_{0|1}(x_{0}|x)}{\color[rgb]{0.0039,0.5195,0.4961}\nabla_{x}\log p^{r}_{1|0}(x|x_{0})} (2) \frac{\varphi_{t}(y)}{\varphi_{t}(x)}=\mathbb{E}_{p^{\star}_{1|t}(x_{1}|x)}{\color[rgb]{0.0039,0.5195,0.4961}\frac{p^{r}_{1|t}(x_{1}|y)}{p^{r}_{1|t}(x_{1}|x)}} \frac{\widehat{\varphi}_{1}(y)}{\widehat{\varphi}_{1}(x)}=\mathbb{E}_{p^{\star}_{0|1}(x_{0}|x)}{\color[rgb]{0.0039,0.5195,0.4961}\frac{p^{r}_{1|0}(y|x_{0})}{p^{r}_{1|0}(x|x_{0})}} Adjoint Matching \nabla\log\varphi_{t}(x)=\mathbb{E}_{p^{\star}_{1|t}(x_{1}|x)}{\color[rgb]{0.5742,0.0313,0.4453}\nabla\log\varphi_{1}(x_{1})} (3) \nabla\log\widehat{\varphi}_{1}(x)=\mathbb{E}_{p^{\star}_{0|1}(x_{0}|x)}{\color[rgb]{0.5742,0.0313,0.4453}\nabla\log\widehat{\varphi}_{0}(x_{0})} (4) \frac{\varphi_{t}(y)}{\varphi_{t}(x)}=\mathbb{E}_{p^{\star}_{1|t}(x_{1}|x)}{\color[rgb]{0.5742,0.0313,0.4453}\frac{\varphi_{1}(y+x_{1}-x)}{\varphi_{1}(x_{1})}} \frac{\widehat{\varphi}_{1}(y)}{\widehat{\varphi}_{1}(x)}=\mathbb{E}_{p^{\star}_{0|1}(x_{0}|x)}{\color[rgb]{0.5742,0.0313,0.4453}\frac{\widehat{\varphi}_{0}(y+x_{0}-x)}{\widehat{\varphi}_{0}(x_{0})}} 2 Preliminaries Diffusion Samplers on Continuous State Space \mathcal{X}=\mathbb{R}^{D} MCMC sampling based on equilibrium dynamics, e.g., Langevin Monte Carlo, is typically slow to mix when the target distribution is complex. Recent progress in non-equilibrium measure transport for generative modeling such as diffusion models ( Song et al. 2021 ) has motivated sampling methods based on controlled stochastic differential equations (SDEs), commonly referred to as diffusion neural samplers. The sampling dynamics are described by SDE: \displaystyle p^{u}:~\mathrm{d}X_{t}=(b_{t}+\sigma_{t}u_{t})(X_{t})\mathrm{d}t+\sigma_{t}\mathrm{d}W_{t},~X_{0}\sim\mu, (5) where b:[0,1]\times\mathcal{X}\rightarrow\mathcal{X} is the base drift, \sigma:[0,1]\rightarrow\mathbb{R}_{>0} is the noise schedule, and \mu is the initial source distribution. Given (b_{\cdot},\sigma_{\cdot},\mu) , the goal is to learn a parameterized control u:[0,1]\times\mathcal{X}\to\mathcal{X} such that the marginal distribution of X_{1} matches the target distribution \nu . We use p^{u} to denote the path measure induced by this SDE with control u . Formally, p^{u}(X_{[0,1]}) can be viewed as the limit of the joint distribution of (X_{t_{0}},X_{t_{1}},...,X_{t_{K}}) as the partition 0=t_{0}0 . We follow the typical strategy in discrete diffusion models ( Campbell et al. 2022 ; Lou et al. 2024 ; Schiff et al. 2025 ) to restrict the transition to pairs of x,y with Hamming distance d_{\mathrm{H}}(x,y)=1 , i.e., x and y differ at exactly one entry. Throughout this paper, we consider the reference path measure p^{r} starting from an arbitrary tractable initial distribution p^{r}_{0}=\mu and induced by the following uniform transition rate r that keeps the uniform distribution on \mathcal{X} ( p_{\mathrm{unif}}=\frac{1}{N^{D}} ) invariant: \displaystyle r_{t}(y,x)=\begin{cases}\frac{\gamma_{t}}{N},&\text{if }d_{\mathrm{H}}(y,x)=1,\\ -\gamma_{t}D\left(1-\frac{1}{N}\right),&\text{if }y=x,\\ 0,&\text{if otherwise,}\end{cases} (16) where \gamma_{\cdot}:[0,1]\to\mathbb{R}_{+} is a noise schedule. We remark that for two given time steps 0\leq s0 , and assume each dimension evolves independently. We defer the details to Section B.6 . Table 2 : Learning to sample from lattice Ising models with L=24 . Best and second best results among all uniform-based discrete neural samplers are highlighted. * : Measured on one A6000 GPU with largest feasible batch size for \beta_{\mathrm{high}} . \dagger : For \beta_{\mathrm{critical}} and \beta_{\mathrm{low}} , using warm-up strategy in PDNS ( Guo et al. 2026 ) . \ddagger : Failed to converge to meaningful distributions at \beta_{\mathrm{critical}} and \beta_{\mathrm{low}} even with warm-up. Inv. Temp. \beta_{\mathrm{high}}=0.28 \beta_{\mathrm{critical}}=0.4407 \beta_{\mathrm{low}}=0.6 Type Metrics \downarrow Steps ( \times 1\mathrm{e}3)^{*} Runtime (h) ∗ \Delta\mathrm{Mag.} \Delta\mathrm{Corr.} \mathrm{EW_{2}} \Delta\mathrm{Mag.} \Delta\mathrm{Corr.} \mathrm{EW_{2}} \Delta\mathrm{Mag.} \Delta\mathrm{Corr.} \mathrm{EW_{2}} DASBS \mathbf{\uline{3.75}} \mathbf{\uline{0.5}} \uline{2.7\mathrm{e}-3} \uline{1.8\mathrm{e}-3} \uline{8.6} \mathbf{\uline{5.7\mathrm{e}-2}} \mathbf{\uline{4.7\mathrm{e}-2}} \mathbf{\uline{12.1}} \mathbf{\uline{2.0\mathrm{e}-2}} \mathbf{\uline{1.8\mathrm{e}-3}} \mathbf{\uline{2.0}} LEAPS \uline{30} 8.4 \mathbf{\uline{1.8\mathrm{e}-3}} \mathbf{\uline{9.2\mathrm{e}-4}} \mathbf{\uline{3.1}} \uline{5.9\mathrm{e}-2} \uline{2.8\mathrm{e}-1} \uline{96.5} \uline{3.0\mathrm{e}-2} \uline{5.5\mathrm{e}-1} \uline{176.6} UDNS ‡ 50 11.9 9.0\mathrm{e}-3 8.7\mathrm{e}-3 23.6 – – – – – – Uniform DFNS ‡ 50 \uline{2.1} 9.3\mathrm{e}-1 8.0\mathrm{e}-1 661.6 – – – – – – Masked MDNS † 50 16.8 3.9\mathrm{e}-3 7.4\mathrm{e}-4 0.1 1.1\mathrm{e}-2 5.6\mathrm{e}-3 5.1 9.0\mathrm{e}-3 4.7\mathrm{e}-3 5.3 MCMC MH – – 8.9\mathrm{e}-4 2.9\mathrm{e}-4 1.2 2.5\mathrm{e}-2 3.7\mathrm{e}-3 293.3 4.0\mathrm{e}-2 6.6\mathrm{e}-4 109.9 5 Additional Theory and Insights of DASBS In this section, we provide further theory and insights to the DASBS framework. AM v.s. DM for Corrector Recall that our derivation of the AM losses Eqs. ctrl-AM and corr-AM leverages the relations Eqs. 19 and 22 , which rely explicitly on the additiveness of the reference transition kernel p^{r}_{1|t}(\cdot|x) Eq. 17 . In contrast, the DM loss Eq. corr-DM does not rely on this condition. AM v.s. DM for Controller A parallel relationship holds for the controller , which yields a different way of the alternating update by replacing the ratio in Eq. ctrl-AM with {\color[rgb]{0.0039,0.5195,0.4961}\frac{p^{r}_{1|t}(x_{1}|x^{d\leftarrow n})}{p^{r}_{1|t}(x_{1}|x)}} (see Sections B.8 and ctrl-DM for details). However, though theoretically grounded, this formulation may suffer from a weak mutual supervisory signal during alternating updates: we rely on the trained \widehat{\varPhi}^{(k-1)} to supervise the training of \varPhi^{(k)} , but such supervisory information only comes in from the implicit boundary relation \varPhi_{1}(x)_{d,n}\widehat{\varPhi}(x)_{d,n}=\frac{\nu(x^{d\leftarrow n})}{\nu(x)} , which is not explicitly enforced in the loss. Even when the reference dynamics is memoryless and there is no need to learn the corrector, we discover in Fig. 1 that AM Eq. ctrl-AM works significantly better than its DM counterpart Eq. ctrl-DM . Further Connection to Target Matching Such contrast resembles the distinction between target matching (TM) and denoising matching (DM) in the literature of learning scores of continuous probability distributions ( De Bortoli et al. 2024 ; Kahouli et al. 2025 ) : for two continuous random vectors x,y\sim p(x,y) , we can express the score as \displaystyle\underbrace{\mathbb{E}_{p(x|y)}{\color[rgb]{0.5742,0.0313,0.4453}\nabla_{x}\log p(x)}}_{\text{for additive}~p(y|x)}=\nabla_{y}\log p(y)=\underbrace{\mathbb{E}_{p(x|y)}{\color[rgb]{0.0039,0.5195,0.4961}\nabla_{y}\log p(y|x)}}_{\text{for general}~p(y|x)}, where additive means p(y|x)=q(y-x) for some distribution q . In other words, TM regresses onto the target score, whereas DM regresses onto the score of the transition kernel. TM leverages a more meaningful learning signal and avoids the numerical instability of DM when the noise level is very small (where \nabla_{y}\log p(y|x) becomes singular), thereby providing faster convergence of training, a benefit we observe directly in our discrete experiments ( Fig. 1 ). Unified View of Adjoint Matching Adjoint matching ( AM , Domingo-Enrich et al. 2025a ) is originally derived by analyzing the ODE of the adjoint state – the gradient of the cost-to-go from X_{t}=x with respect to x . This formulation connects the adjoint state to the gradient of the objective with respect to control parameters, yielding a learning objective whose unique fixed-point corresponds to the optimal control. However, such gradient-based perspective is not directly generalizable to discrete domains. Recently, So et al. 2026 made a first attempt by expressing the optimal control as an expectation under the optimal path measure; however, their reliance on masked transition rate resulted in a complex training objective, due to the lack of the additive property. In contrast, our derivation identifies that the additive reference noise is the key structural requirement that enables a TM-like loss in discrete domains. We refer readers to the lower half of Table 1 for a side-by-side comparison of DM and AM formulations across continuous and discrete settings, and conclude with a unified characterization of the intrinsic nature of AM: Adjoint matching: a fixed-point iteration driven by a target matching objective converging to the optimal \bm{p^{\star}} . DASBS Unifies Existing Memoryless SOC Solvers We further establish the connection between DASBS and the weighted denoising cross-entropy (WDCE) loss for solving memoryless SOC problems ( Zhu et al. 2025a ; Zhu et al. 2025b ) (see Propositions B.9 and B.10 for full statement and proof): Proposition 5.1 . Under a memoryless reference path measure p^{r} (encompassing both uniform Eq. 16 and masked Eq. 39 discrete diffusion), the denoising loss for the controller Eq. ctrl-DM , with trajectory importance reweighting, generalized KL divergence, 2 2 2 f(t)=t\log t\implies D_{f}(a\|b)=a\log\frac{a}{b}-a+b . and time weight w_{t}\leftarrow\frac{\gamma_{t}}{N} , is equivalent to the WDCE loss. Convergence Analysis Finally, following the continuous arguments ( Liu et al. 2025a , Thm. 4) , we establish the following convergence guarantee of DASBS. Theorem 5.2 . (1) The path measure induced by the unique fixed-point of Eq. ctrl-AM ( \varPhi^{(k)} ) solves a forward half bridge problem \min_{p~\text{s.t.}~p_{0}=\mu}\mathrm{KL}(p\|q^{\widehat{\varphi}^{(k-1)}_{1}}) for some path measure q^{\widehat{\varphi}^{(k-1)}_{1}} induced by \widehat{\varphi}^{(k-1)}_{1} ( Definition B.11 ). (2) The unique fixed-point of Eq. corr-DM is the same as the unique fixed-point of Eq. corr-DM . Denote it as \widehat{\varPhi}^{(k)} , which induces a path measure q^{\widehat{\varphi}^{(k)}_{1}} that solves a backward half bridge problem \min_{q~\text{s.t.}~q_{1}=\nu}\mathrm{KL}(p^{r\varPhi^{(k)}}\|q) . Consequently, convergence is guaranteed by the theory of iterative proportional fitting ( Rüschendorf 1995 ; Chen et al. 2016a ; De Bortoli et al. 2021 ) . See Section B.11 for the proof. Table 3 : Learning to sample from lattice Potts models with L=16 and N=4 . Best result among all uniform-based discrete neural samplers are highlighted. \dagger : For \beta_{\mathrm{critical}} and \beta_{\mathrm{low}} , using warm-up strategy in PDNS ( Guo et al. 2026 ) . Inv. Temp. \beta_{\mathrm{high}}=0.9 \beta_{\mathrm{critical}}=1.0986 \beta_{\mathrm{low}}=1.3 Type Metrics \downarrow \Delta\mathrm{Mag.} \Delta\mathrm{Corr.} \mathrm{EW_{2}} \Delta\mathrm{Mag.} \Delta\mathrm{Corr.} \mathrm{EW_{2}} \Delta\mathrm{Mag.} \Delta\mathrm{Corr.} \mathrm{EW_{2}} DASBS 8.7\mathrm{e}-3 6.6\mathrm{e}-3 \mathbf{\uline{5.3}} \mathbf{\uline{4.1\mathrm{e}-3}} \mathbf{\uline{2.9\mathrm{e}-2}} \mathbf{\uline{20.0}} \mathbf{\uline{4.2\mathrm{e}-3}} \mathbf{\uline{7.3\mathrm{e}-3}} \mathbf{\uline{3.6}} Uniform LEAPS \mathbf{\uline{5.7\mathrm{e}-3}} \mathbf{\uline{5.0\mathrm{e}-3}} 8.2 3.2\mathrm{e}-1 2.6\mathrm{e}-1 79.9 3.6\mathrm{e}-1 3.5\mathrm{e}-1 90.5 Mask MDNS 6.5\mathrm{e}-3 5.1\mathrm{e}-3 6.4 5.2\mathrm{e}-3 4.6\mathrm{e}-3 1.9 8.4\mathrm{e}-4 6.1\mathrm{e}-4 0.7 MCMC MH 5.2\mathrm{e}-2 4.7\mathrm{e}-2 98.6 4.9\mathrm{e}-1 4.0\mathrm{e}-1 273.2 6.8\mathrm{e}-1 6.4\mathrm{e}-1 313.1 6 Experiments In this section, we evaluate the effectiveness and efficiency of the proposed DASBS algorithm. We demonstrate that it achieves competitive sample quality across standard benchmarks while offering significant advantages in training speed. We further investigate the benefits of AM and non-memoryless reference dynamics through ablation studies. Additional details and results are provided in Appendix C . Experimental Setup We test our method on two discrete distributions from statistical physics: the Ising and Potts models on square lattices. They are well known for exhibiting phase transitions as a function of the inverse temperature ( Onsager 1944 ; Beffara & Duminil-Copin 2012 ) and serve as standard benchmarks for discrete sampling. For the Ising model, we use a lattice of size L=24 (i.e., sequence length D=L^{2}=576 ) with states \{\pm 1\} , and consider inverse temperatures \beta_{\mathrm{high}}=0.28 , \beta_{\mathrm{critical}}=\log(1+\sqrt{2})/2\approx 0.4407 , and \beta_{\mathrm{low}}=0.6 . For the Potts model, we use L=16 ( D=L^{2}=256 ) with N=4 states, and consider \beta_{\mathrm{high}}=0.9 , \beta_{\mathrm{critical}}=\log(1+\sqrt{q})\approx 1.0986 , and \beta=1.3 . We benchmark DASBS against leading discrete neural samplers, including LEAPS ( Holderrieth et al. 2025 ) , DFNS ( Ou et al. 2025b ) , UDNS ( Zhu et al. 2025a , App. F) , and MDNS ( Zhu et al. 2025a ) , as well as the classical Metropolis-Hastings (MH) algorithm. Results and Discussion Quantitative results for the Ising and Potts models are summarized in Tables 2 and 3 , respectively. We assess sample quality using three metrics: the deviation of the magnetization ( \Delta\mathrm{Mag.} ), the deviation of the 2-point correlation ( \Delta\mathrm{Corr.} ), and the energy Wasserstein-2 distance ( \mathrm{EW_{2}} ), all relative to ground-truth samples from the Swendsen-Wang (SW, Swendsen & Wang 1986 ; Swendsen & Wang 1987 ) algorithm. For Ising model with high temperature, we also report the number of training steps and runtime on a single A6000 GPU, utilizing the maximum feasible batch size. Across all regimes, DASBS delivers satisfactory sample fidelity that is highly competitive with state-of-the-art uniform-based discrete neural samplers. Notably, DASBS confers a distinct advantage in training efficiency . We attribute this speed-up to three factors: (1) the use of the discrete score as a highly informative first-order oracle; (2) a memory-efficient design that avoids storing full roll-outs or computing loss over full trajectories; and (3) the simplicity of the matching loss objective. Figure 1 : Ablation study of the adjoint matching (AM) and denoising matching (DM) training losses for the memoryless noise schedule \gamma_{t}=\frac{1}{t} on Potts model with L=8 , N=3 , \beta_{\mathrm{high}}=0.5 . Reweighting means using trajectory importance weight p^{\star}/p^{\operatorname{sg}(u)} in the training losses. DM with reweighting corresponds to UDNS ( Zhu et al. 2025a , App. F) . Left : Energy Wasserstein-2 distance to the ground-truth samples from SW algorithm. Right : Effective sample size computed from the trajectory importance weights. Figure 2 : Ablation study of the hyperparameters \alpha and \gamma for the modified log-linear noise schedule \gamma_{t}=\frac{\gamma}{t+\alpha} on Ising model with L=24 and \beta_{\mathrm{high}}=0.28 . The case of \alpha=0 is memoryless . NFE is the number of function evaluations during generation for both training and inference. Top : fix \gamma=1 and vary \alpha . Bottom : fix \alpha=1 and vary \gamma . Left : average number of jumps for each dimension during generation. Right : 2-point correlation error and energy Wasserstein-2 distance to ground-truth samples drawn from SW algorithm. Ablation Study: AM v.s. DM in Learning Controller In Fig. 2 , we empirically validate the claim that AM is more efficient than DM. We focus on an 8\times 8 Potts model ( N=3 , \beta_{\mathrm{high}}=0.5 ). We choose the standard memoryless noise schedule \gamma_{t}=\frac{1}{t} ( Ou et al. 2025a ; Zhu et al. 2025a ) to isolate the impact of the training objectives Eq. ctrl-AM v.s. Eq. ctrl-DM . Fig. 1 shows that, while all three methods eventually converge, AM exhibits significantly faster convergence than DM when trajectory importance reweighting is enabled. Furthermore, we observe that the importance reweighting can inadvertently slow down the convergence due to small effective sample sizes (even after convergence), likely stemming from variance of the estimated RND. Ablation Study: Memoryless v.s. Non-Memoryless We investigate the impact of the noise schedule \gamma_{t} in Fig. 2 , and in particular, we show that non-memoryless noise schedule performs better than the memoryless one. We adopt the modified log-linear schedule \gamma_{t}=\frac{\gamma}{t+\alpha} on the 24\times 24 Ising model with \beta_{\mathrm{high}}=0.28 , which is memoryless when \alpha=0 . Fig. 2 shows that when either hyperparameter is fixed at 1 , the error metrics exhibit a distinct U-shaped curve as a function of the other parameter. Deviating from the optimal regime leads to degradation in sample quality: small \gamma or large \alpha reduces the transition rate magnitude and may hinder exploration, while large \gamma or small \alpha (particularly the memoryless case \alpha=0 ) induces excessive jumps during generation, also degrading performance. Notably, these trends remain consistent across different computational budgets, demonstrating the robustness of the optimal configuration. A similar study for the constant noise schedule \gamma_{t}\equiv\gamma is provided in Section C.3 . 7 Conclusion and Future Work In this work, we introduced a unified framework for discrete SB and SOC, proposing DASBS as an optimal-policy fixed-point iteration. By leveraging an additive noise scheme based on group structure, DASBS effectively extends AM to discrete domains. Several limitations remain: our evaluation is currently restricted to synthetic benchmarks, and performance on more complex distributions remains unknown. Additionally, the first-order nature of DASBS may be costly to implement if computing energy is expensive or not parallelizable. Future directions include extending the framework to discrete SOC with running costs ( Domingo-Enrich et al. 2025a ) , exploring non-uniform reference dynamics like the Ehrenfest process ( Winkler et al. 2024 ) , and broadening our theoretical insights of AM to general state (e.g., Park et al. 2024 ; Woo et al. 2025 ; Park et al. 2025 ). Appendix A Related Works 1. Adjoint Matching The idea of AM ( Domingo-Enrich et al. 2025a ) can be traced back to the adjoint method in optimal control theory ( Pontryagin 1987 ) , and a few of its earlier applications in machine learning ( Han & E 2016 ; Chen et al. 2018 ; Li et al. 2020 ; Domingo-Enrich et al. 2024 ) . The core idea is to define the adjoint state a_{t}(X;u) associated with a control u and trajectory X=(X_{t})_{t\in[0,1]} as \nabla_{X_{t}}J_{t}(X) , where J_{t}(X) the cost-to-go along the trajectory starting from X_{t} . Then, one can establish the dynamics of the adjoint state as an ODE backward in time starting from a_{1} being the gradient of the terminal cost. Furthermore, the gradient of the full cost-to-go at the initial time t=0 with respect to the control parameter can be written as an integral associated with the adjoint state, thus leading to a matching objective using the stop-gradient operator. It is shown in Domingo-Enrich et al. 2025a that the optimal control is the unique fixed-point of the learning objective. AM-based methods have been applied to multiple tasks including continuous neural sampler training ( Havens et al. 2025 ; Liu et al. 2025a ; Choi et al. 2025 ; Blessing et al. 2025a ) , fine-tuning diffusion/flow-based models ( Blessing et al. 2025a ; Liu et al. 2025b ; Domingo-Enrich et al. 2025b ) , and transition path sampling ( Pidstrigach et al. 2025 ; Howard et al. 2025 ) , showing competitive performance. While AM is popularly applied in continuous state spaces, its generalization to discrete state spaces remains unexplored. Recently, So et al. 2026 made a first attempt by defining the discrete adjoint state as an estimator of the exponential of the value difference, and establishing its connection with the optimal transition rate, leading to a matching objective whose unique fixed-point is the optimal transition rate. However, their training loss requires row-out from intermediate states given the samples in the buffer, which is complicated. 2. Discrete Diffusion Neural Samplers The study of continuous neural samplers has inspired the construction of similar algorithms for learning discrete distributions. For uniform-based discrete diffusion, Holderrieth et al. 2025 employed the discrete Jarzynski equality and learns the transport via locally equivariant neural networks, Ou et al. 2025b followed and refined this line of study by proposing a different loss formulation, and Kholkin et al. 2025 proposed a neural sampler based on target concrete score identity. For mask-based discrete diffusion, Zhu et al. 2025a formulated the sampling problem as an SOC problem similar to Zhang & Chen 2022 , and proposed samplers based on masked and uniform discrete diffusion. Finally, discrete diffusion neural samplers are also used for solving combinatorial optimization problems via sampling from a low-temperature target distribution, e.g., Sanokowski et al. 2023 ; Sanokowski et al. 2024 ; Sanokowski et al. 2025a ; Ou et al. 2025b ; Guo et al. 2026 . Appendix B Theoretical Derivation B.1 Kolmogorov Equations for Continuous-time Markov Chains Proposition B.1 . Suppose p_{t|s}(y|x) , 0\leq s0 , \overline{\gamma}_{s,t}=\gamma(t-s) . • Modified log-linear schedule: \gamma_{t}=\frac{\gamma}{t+\alpha} for some \gamma,\alpha>0 , \overline{\gamma}_{s,t}=\gamma\log\frac{t+\alpha}{s+\alpha} . A larger \alpha means a stronger memory effect, and \alpha=0 recovers the memoryless case. The ablation studies of the noise schedules can be found at Figs. 3 and 2 . B.6 Inference via \tau -leaping Proposition B.7 . Using \tau -leaping to discretize the controlled CTMC, the transition probability for any dimension d is approximated as \displaystyle\Pr(X_{t+h}^{d}=n|X_{t}=x)\approx \displaystyle\begin{cases}\frac{\overline{\gamma}_{t,t+h}}{N}\varPhi_{t}(x)_{d,n},&\text{if}~n\neq x^{d},\\ 1-\frac{\overline{\gamma}_{t,t+h}}{N}\sum_{n^{\prime}\neq x^{d}}\varPhi_{t}(x)_{d,n^{\prime}},&\text{if}~n=x^{d}.\end{cases} The approximate transition probability can be computed as \displaystyle p^{u}_{t+h|t}(y|x) \displaystyle\approx\prod_{d=1}^{D}\Pr(X_{t+h}^{d}=y^{d}|X_{t}=x) \displaystyle=\prod_{d=1}^{D}\left(\frac{\overline{\gamma}_{t,t+h}}{N}\varPhi_{t}(x)_{d,y^{d}}\right)^{1_{y^{d}\neq x^{d}}}\left(1-\frac{\overline{\gamma}_{t,t+h}}{N}\sum_{n^{\prime}\neq x^{d}}\varPhi_{t}(x)_{d,n^{\prime}}\right)^{1_{y^{d}=x^{d}}}. (34) We summarize the sampling procedure in Algorithm 1 . Note that for uniform discrete diffusion models, other samplers such as uniformization ( Chen & Ying 2025 ; Ren et al. 2025a ) and higher-order \tau -leaping ( Ren et al. 2025b ) can also be applied, which we leave as future works. Algorithm 1 Sampling of discrete adjoint Schrödinger bridge sampler (DASBS) via \tau -leaping 0: Model \varPhi , initial distribution \mu , time discretization 0=t_{0}0 is the inverse temperature, and Z=\sum_{x\in\mathcal{X}}\mathrm{e}^{-\beta E(x)} is the partition function. For Ising model with interaction parameter J\in\mathbb{R} and external magnetic field h\in\mathbb{R} , the energy is \displaystyle E_{\mathrm{Ising}}(x)=-J\sum_{i\sim j}x^{i}x^{j}-h\sum_{i}x^{i},~x\in\{\pm 1\}^{\Lambda}. We keep J=1 and h=0 through out the experiments. For Potts model with N states and interaction parameter J\in\mathbb{R} , the energy is \displaystyle H_{\mathrm{Potts}}(x)=-J\sum_{i\sim j}1_{x^{i}=x^{j}},~x\in[N]^{\Lambda}. We keep J=1 through out the experiments. Finally, we can compute the discrete score of these two distributions as follows: \displaystyle\frac{\nu(x^{i\leftarrow n})}{\nu(x)}=\begin{cases}\exp\left(\beta(n-x^{i})\left(J\sum_{j:~j\sim i}x^{j}+h\right)\right),~\forall n\in\{\pm 1\},&\text{Ising};\\ \exp\left(\beta J\left(\sum_{j:~j\sim i}\left(1_{x^{j}=n}-1_{x^{j}=x^{i}}\right)\right)\right),~\forall n\in[N],&\text{Potts}.\end{cases} C.2 Implementation Details Model Backbone We follow the implementation of MDNS ( Zhu et al. 2025a ) to use vision transformers (ViT, Dosovitskiy et al. 2021 ) to serve as the backbone for the discrete diffusion model. In particular, we use the DeiT (Data-efficient image Transformers) framework ( Touvron et al. 2021 ) with 2-dimensional rotary position embedding ( Heo et al. 2025 ) , which better captures the 2-dimensional spatial structure of the Ising and Potts models. While MDNS’s model only requires the position input x\in[N]^{D} , in our learning objectives, the controller also receives time input t\in[0,1] . Hence, we adopt the adaptive layer normalization (adaLN) mechanism in the DiT ( Peebles & Xie 2023 ) and SiT ( Ma et al. 2024 ) to deal with the time conditioning. For learning 24\times 24 Ising model and 16\times 16 Potts model with 4 states, we use a model with 6 blocks, hidden dimensions 32 and 4 heads. The total number of parameters in the model is around 144\mathrm{k} (controller, with time conditioning) or 95\mathrm{k} (corrector, without time conditioning). Training Among all the training tasks, we use the AdamW optimizer ( Loshchilov & Hutter 2019 ) with a constant learning rate of 1\mathrm{e}-3 ( \beta_{\mathrm{high}} ) and 5\mathrm{e}-4 ( \beta_{\mathrm{critical}},\beta_{\mathrm{low}} ). We always use exponential moving average (EMA) to stabilize the training, with a decay rate of 0.9999 . All experiments are trained on an NVIDIA RTX A6000 GPU. For all distributions, we always use the generalized KL divergence 2 as the Bregman divergence, always use uniform time weight w_{t}\equiv 1 , and adpot the modified log-linear noise schedule with \gamma=1 and \alpha=0.5 . We train for 5 stages with 500 steps for controller and 250 steps for corrector. We keep a running buffer of size 512 ( \beta_{\mathrm{high}} ) or 4096 ( \beta_{\mathrm{critical}},\beta_{\mathrm{low}} ), and resampling a batch of 128 pairs of (x_{0},x_{1}) using the current controller every 20 ( \beta_{\mathrm{high}} ) or 10 ( \beta_{\mathrm{critical}},\beta_{\mathrm{low}} ) gradient updates. Finally, for \beta_{\mathrm{high}} , we use \mu=p_{\mathrm{unif}} as an initialization and adopt AM loss Eq. corr-AM for the corrector; for \beta_{\mathrm{critical}},\beta_{\mathrm{low}} , we observe that uniform initialization does not lead to good performance, and thus initialize \mu as the zero-temperature distribution (i.e., \operatorname{Unif}\{\pm\mathbf{1}\} for Ising and \operatorname{Unif}\{\mathbf{1},2\mathbf{1},...,N\mathbf{1}\} for Potts, where \mathbf{1} is the all-one vector). We use DM loss Eq. corr-DM for training the corrector as \mu is not positive everywhere. Generating Baseline and Ground Truth Samples We follow the implementation in existing literature ( Guo et al. 2026 ) for baselines. For the learning-based baseline, we train LEAPS and MDNS on 24\times 24 Ising model and 16\times 16 Potts model for up to 150\mathrm{k} steps for each temperature. For MDNS, we apply the warm-up strategy ( Zhu et al. 2025a ) to initialize the training under \beta_{\mathrm{critical}} from the pretrained checkpoint for \beta_{\mathrm{high}} , and initialize the training under \beta_{\mathrm{low}} from the pretrained checkpoint for \beta_{\mathrm{critical}} . The Metropolis-Hastings (MH) and Swendsen-Wang (SW) sampling exactly follows the implementation in Guo et al. 2026 that ensures sufficient mixing. Evaluation We follow the procedure detailed in Zhu et al. 2025a for the computation of magnetization and 2-point correlation error . To compute the empirical energy Wasserstein-2 distance for two set of samples \{x_{i}\} and \{y_{j}\} , we obtain the energies of the datasets \mathcal{E}_{1}=\{E(x_{i})\} and \mathcal{E}_{2}=\{E(y_{j})\} , and use the function \mathtt{np.sqrt(ot.wasserstein\_1d(\mathcal{E}_{1},~\mathcal{E}_{2},~p=2))} from the POT package ( Flamary et al. 2021 ) . Effective Sample Size (ESS) We follow the practice in existing literature on neural samples ( Zhang & Chen 2022 ; Holderrieth et al. 2025 ; Zhu et al. 2025a ) . For a batch of i.i.d. samples \{x_{i}\}_{i\in[B]} from p , suppose we associate each sample x_{i} with a weight w_{i}=\frac{\widehat{q}(x_{i})}{p(x_{i})} , where \widehat{q} is the unnormalized probability density / mass function of a probability distribution q , then the (normalized) effective sample size (ESS) of the samples with respect to q is defined as \frac{(\frac{1}{B}\sum_{i}w_{i})^{2}}{\frac{1}{B}\sum_{i}w_{i}^{2}}\in\left[\frac{1}{B},1\right] . Ablation Studies on TM v.s. DM ( Fig. 1 ) We use a model with 4 blocks, hidden dimension 32 and 4 heads. We use a batch size of 256 and in Eqs. ctrl-DM and ctrl-AM , we sample 32 t ’s following \operatorname{Unif}[0,1] for each pair of (x_{0},x_{1}) . All three cases are trained under the same random seed for 5000 steps, with a buffer size of 1024 and resampling frequency 20 with generation NFE 100 . Ablation Studies on Noise Schedules ( Figs. 2 and 3 ) We use a model with 4 blocks, hidden dimension 32 and 4 heads. We use a batch size of 64 and in Eq. ctrl-AM , we sample 8 t ’s following \operatorname{Unif}[0,1] for each pair of (x_{0},x_{1}) . All runs are trained under the same random seed for 5 stages with 200 controller update steps and 200 corrector update steps. The buffer size is 256 and resampling frequency is 20 . C.3 Further Experimental Results Ablation Study: Noise Schedule We provide further ablation study for the constant noise schedule \gamma_{t}\equiv\gamma in Fig. 3 . A similar trend happens as the modified log-linear schedule: the generated samples reach the best quality at around \gamma\in[0.5,1] . Figure 3 : Ablation study of the hyperparameter \gamma for the constant noise schedule \gamma_{t}\equiv\gamma on Ising model with L=24 and \beta_{\mathrm{high}}=0.28 . NFE is the number of function evaluations during generation for both training and inference. Left : average number of jumps for each dimension during generation. Right : 2-point correlation error and energy Wasserstein-2 distance to ground-truth samples drawn from SW algorithm.