Kink Localization in Diffusion-Based Speech Enhancement: A Variational-Flow Analysis of StoRM under Noise-Power Mismatch
Shuubham Ojha · 2026
Read Kink Localization in Diffusion-Based Speech Enhancement: A Variational-Flow Analysis of StoRM under Noise-Power Mismatch by Shuubham Ojha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24035.txt.
Introduction
Ojha studies a puzzling flaw in diffusion-based speech cleaning, where a computer removes noise from recorded speech. Systems such as StoRM, which pairs a first-guess predictor with a learned score network, show a sharp kink in quality once test noise rises past the level used in training. Writing alone in 2026, Ojha uses a variational-flow analysis, a way of tracking how tiny changes flow through the system, to locate where that kink begins.
Careful factorisation of the sensitivity shows the roughness must come from the predictor stage, not from the learned score network downstream. Ojha proves the output loses smoothness exactly when the predictor output does, under three stated assumptions about the reverse process. The result also extends to the step-by-step sampler used in practice. Instead of running experiments, the paper lays out a concrete testing programme, leaving hands-on validation to a planned companion report.
Catalog record
| CREATOR | Shuubham Ojha |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.24035
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Kink Localization in Diffusion-Based Speech Enhancement: A Variational-Flow Analysis of StoRM under Noise-Power Mismatch Shuubham Ojha Abstract Diffusion-based speech enhancement architectures that pair a deterministic predictor with a learned score network, exhibit a sharp non-smooth transition (“kink”) in the SI-SDR degradation curve at the training-time noise amplitude. We give a pathwise variational-flow analysis that localizes this non-smoothness to the predictor stage. The central identity is an exact factorization of the parametric sensitivity, ∂ s ^ ( M ) / ∂ M = K ( M ) ⋅ ∂ C M / ∂ M \partial\widehat{s}^{(M)}/\partial M=K(M)\cdot\partial C_{M}/\partial M , where K ( M ) K(M) is a continuous matrix-valued functional of the score Jacobian along the reverse trajectory and C M = Π ( y ( M ) ) C_{M}=\Pi(y^{(M)}) is the predictor output. Under three hypotheses on the reverse-process flow (score-Jacobian continuity, conditioning-Jacobian continuity, non-degeneracy of K K ), failure of M ↦ s ^ ( M ) M\mapsto\widehat{s}^{(M)} to be C 1 C^{1} at M ∗ M^{\ast} holds if and only if M ↦ Π ( y ( M ) ) M\mapsto\Pi(y^{(M)}) fails to be C 1 C^{1} at M ∗ M^{\ast} . We extend the localization to the finite-step Euler–Maruyama sampler actually run at inference. The hypotheses translate into a concrete experimental program; this paper specifies the program and presents the variational structure. The empirical validation is deferred to a companion experimental report. 1 Introduction Score-based diffusion models for speech enhancement have converged on a hybrid architecture in which a deterministic predictor produces an initial estimate that initializes and conditions a learned reverse diffusion. StoRM ( Lemercier et al. 2023 ) is the canonical instance: a predictor network \Pi produces C=\Pi(y) from the noisy observation y , and the reverse SDE is run on a learned score s_{\theta}(x,t,C) with C as conditioning and X_{T}=C+\sigma_{T}\varepsilon as initialization. This decomposition has delivered substantial empirical gains over predictor-only and score-only baselines on standard benchmarks ( Lemercier et al. 2023 ; Richter et al. 2023 ) . The behavior of such architectures under distributional shift , specifically under perturbations of the noise power away from the training condition, is poorly understood theoretically. Empirically, the SI-SDR degradation curve as a function of noise scaling exhibits a striking phenomenon: a sharp non-smooth transition at the highest training-time noise amplitude that we call a kink . The transition is consistent across structurally diverse noise types (six in our experimental setup) and is absent from predictor-removed and score-network-removed ablations of the same architecture trained on the same data. This paper asks: which component of the StoRM architecture produces the kink, and why does it appear at the training amplitude ? We give a partial answer to the first question: the kink is localized to the predictor stage through a pathwise variational analysis of the reverse SDE. Approach. Rather than compare the learned reverse process to an oracle reverse process via path-space KL divergence (the standard tool for diffusion-model generalization bounds; Chen et al. 2022 ), we differentiate the learned reverse process with respect to the noise-scaling parameter M and analyze its parametric sensitivity directly. The reverse process depends on M only through the predictor output C_{M} , and parameter-dependence of ODE flows gives an exact factorization of the output sensitivity into a downstream amplification matrix K(M) (determined by the score Jacobian) and the upstream predictor sensitivity \mathrm{d}C_{M}/\mathrm{d}M . The multiplicative form of this factorization yields an iff localization of non-smoothness, in contrast to the one-sided bounds produced by additive Girsanov-style decompositions. Contributions. 1. We derive an exact pathwise factorization V_{0}=K(M)\cdot\mathrm{d}C_{M}/\mathrm{d}M for the parametric sensitivity of a StoRM output to the noise-scaling parameter (Lemma 1 ). 2. Under three hypotheses on the reverse-process flow, we state an iff localization theorem (Theorem 2 ) attributing non-smoothness of the enhancement output to non-smoothness of the predictor map. The hypotheses translate into measurable quantities along the reverse trajectory. 3. We extend the localization to the discrete-time Euler–Maruyama sampler (Corollary 4 ), closing the gap between the continuous-time theorem and the discrete-time experimental object. 4. We specify a complete experimental program (§ 6 ) that substantiates the hypotheses and rules out discretization as the cause of the kink. Each table and measurement is enumerated; existing data substantiates one of the four required pillars, and three additional measurements are identified. 2 Setup 2.1 Notation and the three-process formulation Let s\in\mathbb{R}^{d} denote a clean speech signal and n\in\mathbb{R}^{d} an additive noise sample. For a noise-scaling parameter M>0 define the noisy observation y^{(M)}\;:=\;s+\sqrt{M}\,n, (1) so that M=1 recovers the training-time noise level. We hold s and n fixed throughout; all M -dependence is parametric. The predictor map \Pi produces an initial estimate C_{M}\;:=\;\Pi(y^{(M)}), (2) which is used both to initialize the reverse SDE and as a conditioning input to the score network. The StoRM reverse SDE is \mathrm{d}X_{t}^{(M)}\;=\;b_{\theta}\!\left(X_{t}^{(M)},t,C_{M}\right)\mathrm{d}t\;+\;g(t)\,\mathrm{d}W_{t},\qquad t\in[T,0], (3) where the drift decomposes as b_{\theta}(x,t,C)=f(x,t)-g(t)^{2}\,s_{\theta}(x,t,C) , s_{\theta} is the learned score, W_{t} is a Brownian motion held fixed across M (synchronous coupling), and the initial condition is X_{T}^{(M)}=C_{M}+\sigma_{T}\varepsilon with \varepsilon\sim\mathcal{N}(0,I) held fixed. The enhanced output is \widehat{s}^{(M)}:=X_{0}^{(M)} . 2.2 Object of interest The SI-SDR degradation curve is a deterministic functional of the enhancement output: \Psi(M)\;:=\;\mathrm{SI\text{-}SDR}\!\left(\widehat{s}^{(M)},\,s\right). (4) A kink in \Psi at M^{\ast} is a failure of \Psi to be C^{1} at M^{\ast} : \Psi is continuous at M^{\ast} but \Psi^{\prime} has a jump. Since \mathrm{SI\text{-}SDR}(\cdot,s) is smooth on \mathbb{R}^{d}\setminus\{0\} , kinks in \Psi at non-degenerate operating points are inherited from kinks in M\mapsto\widehat{s}^{(M)} . We work with the latter and recover statements about \Psi by the chain rule. 2.3 Structural assumption Assumption 1 (Single-channel M -dependence) . The drift b_{\theta}(\cdot,\cdot,\cdot) , the diffusion coefficient g(\cdot) , the schedule \sigma_{\cdot} , and the Brownian motion W_{\cdot} are M -independent as functions of their explicit arguments. The map M\mapsto C_{M} is the unique channel through which M enters the reverse dynamics. Assumption 1 is the structural fact that powers the factorization in Lemma 1 ; an explicit \partial_{M}b_{\theta} term would produce additional forcing that does not factor through the predictor map. Verification that the noise schedule and architecture used in our experiments satisfy Assumption 1 is part of the experimental program (§ 6 , item E1). Assumption 2 (Regularity) . The drift b_{\theta}:\mathbb{R}^{d}\times[0,T]\times\mathbb{R}^{d}\to\mathbb{R}^{d} is jointly C^{2} in (x,C) , with \nabla_{x}b_{\theta} , \nabla_{C}b_{\theta} , and their derivatives bounded on the compact set traced out by the trajectories \{(X_{t}^{(M)},t,C_{M}):t\in[0,T],\,M\in\mathcal{M}\} for any compact \mathcal{M}\subset[1,\infty) . 3 Variational-flow analysis Under Assumption 2 , the flow M\mapsto X_{t}^{(M)} is C^{1} in M on any subset where M\mapsto C_{M} is C^{1} (standard parameter-dependence for ODEs; Hartman 2002 , Ch. V). Define the sensitivity process V_{t}\;:=\;\frac{\partial X_{t}^{(M)}}{\partial M}. (5) Lemma 1 (Variational identity) . Under Assumptions 1 and 2 , the sensitivity process satisfies the linear ODE \frac{\mathrm{d}V_{t}}{\mathrm{d}t}\;=\;\nabla_{x}b_{\theta}\!\left(X_{t}^{(M)},t,C_{M}\right)V_{t}\;+\;\nabla_{C}b_{\theta}\!\left(X_{t}^{(M)},t,C_{M}\right)\frac{\mathrm{d}C_{M}}{\mathrm{d}M}, (6) with terminal condition V_{T}=\mathrm{d}C_{M}/\mathrm{d}M . Let \Phi(t,\tau) denote the state-transition matrix of the homogeneous part \dot{Z}=\nabla_{x}b_{\theta}\,Z along the trajectory, with \Phi(\tau,\tau)=I . Then V_{0}\;=\;\underbrace{\left[\Phi(0,T)\;+\;\int_{T}^{0}\Phi(0,\tau)\,\nabla_{C}b_{\theta}\!\left(X_{\tau}^{(M)},\tau,C_{M}\right)\mathrm{d}\tau\right]}_{=:\;K(M)}\cdot\frac{\mathrm{d}C_{M}}{\mathrm{d}M}. (7) Proof. Differentiate ( 3 ) with respect to M . By Assumption 1 , the Brownian increment is M -independent and b_{\theta} has no explicit M -argument; the chain rule gives ( 6 ). The terminal condition follows from differentiating X_{T}^{(M)}=C_{M}+\sigma_{T}\varepsilon , since