Time-Annealed Perturbation Sampling: Diverse Generation for Diffusion Language Models
Jingxuan Wu * 1 Zhenglin Wan * 2 Xingrui Yu † 3 Yuzhe Yang 4 Yiqiao Huang 5 Ivor Tsang 3 Yang You 2 1 The University of North Carolina at Chapel Hill 2 National University of Singapore 3 CFAR, Agency for Science, Technology and Research 4 University of California, Santa Barbara 5 Harvard University · 2026
Read Time-Annealed Perturbation Sampling: Diverse Generation for Diffusion Language Models by Jingxuan Wu * 1 Zhenglin Wan * 2 Xingrui Yu † 3 Yuzhe Yang 4 Yiqiao Huang 5 Ivor Tsang 3 Yang You 2 1 The University of North Carolina at Chapel Hill 2 National University of Singapore 3 CFAR, Agency for Science, Technology and Research 4 University of California, Santa Barbara 5 Harvard University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22629.txt.
Introduction
Jingxuan Wu and a large team coax more variety from diffusion language models with a timed noise trick. Diffusion models build text by cleaning noise; for language, that path can yield samey outputs. Their 2026 preprint uses time-annealed perturbation sampling: noise added on a schedule that fades as the text firms up.
Early noise opens many paths; late calm locks a clean result. More variety, at no quality cost, helps drafting and brainstorming tools. The method is a sampling tweak, not a new model. That makes it cheap to adopt. The work targets a known dullness.
Catalog record
| CREATOR | Jingxuan Wu * 1 Zhenglin Wan * 2 Xingrui Yu † 3 Yuzhe Yang 4 Yiqiao Huang 5 Ivor Tsang 3 Yang You 2 1 The University of North Carolina at Chapel Hill 2 National University of Singapore 3 CFAR, Agency for Science, Technology and Research 4 University of California, Santa Barbara 5 Harvard University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22629
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Time-Annealed Perturbation Sampling: Diverse Generation for Diffusion Language Models Jingxuan Wu * 1 Zhenglin Wan * 2 Xingrui Yu † 3 Yuzhe Yang 4 Yiqiao Huang 5 Ivor Tsang 3 Yang You 2 1 The University of North Carolina at Chapel Hill 2 National University of Singapore 3 CFAR, Agency for Science, Technology and Research 4 University of California, Santa Barbara 5 Harvard University * Equal contribution † Corresponding author [email protected], [email protected] Abstract Abstract: Diffusion language models (Diffusion-LMs) introduce an explicit temporal dimension into text generation, yet how this structure can be leveraged to control generation diversity for exploring multiple valid semantic or reasoning paths remains underexplored. In this paper, we show that Diffusion-LMs, like diffusion models in image generation, exhibit a temporal division of labor: early denoising steps largely determine the global semantic structure, while later steps focus on local lexical refinement. Building on this insight, we propose T ime- A nnealed P erturbation S ampling ( TAPS ) , a training-free inference strategy that encourages semantic branching early in the diffusion process while progressively reducing perturbations to preserve fluency and instruction adherence. TAPS is compatible with both non-autoregressive and semi-autoregressive Diffusion backbones, demonstrated on LLaDA and TraDo in our paper, and consistently improves output diversity across creative writing and reasoning benchmarks without compromising generation quality. 1 Introduction Figure 1 : Comparison between TAPS and the base models across diversity, generation quality, and reasoning performance. Quality is assessed by GPT, and reasoning is measured via majority voting accuracy on GSM8K (Sec. 4 ). Diffusion language models (Diffusion-LMs) have recently emerged as a promising paradigm for natural language generation [ 1 , 2 , 3 , 4 , 5 ] . A growing body of work has proposed diverse architectures, ranging from models initialized from pretrained large language model weights to approaches trained entirely from scratch. Across a wide range of tasks, including creative writing, reasoning, and instruction following, these models have demonstrated competitive or even superior performance compared to autoregressive language models [ 6 , 7 ] . Despite recent progress, Diffusion-LMs face a limitation shared with autoregressive models, frequently generating repetitive or conservative outputs under diversity-promoting instructions [ 8 ] . Diffusion-LMs use different inference dynamics from autoregressive language models, and existing diversity control methods do not transfer well. Output diversity in diffusion-based language generation, therefore, remains underexplored and insufficiently addressed in text generation. Prior work on improving generation diversity in large language models can be broadly categorized into training-time and decoding-time approaches. Training-time methods typically modify the optimization objective during supervised fine-tuning or reinforcement learning [ 9 , 10 , 11 ] . While effective in certain settings, these approaches often require carefully curated datasets tailored to the modified objective and tend to possibly generalize poorly beyond the training distribution. Moreover, retraining or fine-tuning models for diversity can be costly and inflexible in practice. Alternatively, decoding-time approaches offer greater adaptability by operating directly at inference time, but they commonly face a fundamental trade-off between diversity and generation quality. Furthermore, prompt-based approaches encourage diversity by conditioning on prior generations or auxiliary instructions; however, their effectiveness depends heavily on the model’s inherent inference capabilities [ 12 , 13 ] . Sampling-based methods increase diversity by modifying token sampling, such as temperature scaling or nucleus sampling [ 14 , 15 , 16 ] . However, aggressive tuning often harms coherence or fluency, making it difficult to achieve both high diversity and stable quality. To address this limitation, we introduce a simple yet effective technique termed Time-Annealed Perturbation Sampling (TAPS). From a diffusion perspective, conditional generation can be viewed as sampling trajectories conditioned on a signal derived from the prompt. In standard Diffusion-LMs inference, this conditioning signal remains fixed throughout the denoising process, leading the model to repeatedly converge to similar semantic outcomes under multiple samplings. On the contrary, TAPS perturbs the conditioning signal during inference with a magnitude that decays over denoising steps. Intuitively, injecting stronger perturbations at early denoising steps reduces the model’s reliance on a single conditioning trajectory, enabling semantic branching when global structure is formed. As denoising progresses, the perturbation strength is gradually reduced, allowing the model to recover alignment with the original prompt and refine local lexical and stylistic details. This time-aware design allows TAPS to improve output diversity while preserving generation quality and instruction adherence. To illustrate the effect of TAPS, Figure 1 provides an overview comparison between TAPS and the base models across diversity, quality, and reasoning performance. Our contributions are three-fold: (i) We empirically identify a temporal semantic structure in Diffusion-LMs, where early denoising steps shape high-level semantics while later steps refine lexical realization. (ii) Based on this insight, we propose Time-Annealed Perturbation Sampling (TAPS), a simple, training-free, and easily scalable inference strategy that leverages diffusion time semantics to improve output diversity without sacrificing generation quality. (iii) We validate TAPS across diverse tasks, including story generation, instruction following, open-ended generation, and mathematical reasoning. Experiments on multiple diffusion-based backbones show consistent gains in both semantic-level and token-level diversity with negligible overhead, where increased diversity translates into improved exploration of alternative semantic or reasoning paths. 2 Related work Diversity is a fundamental property of conditional text generation, as a single input prompt often admits multiple valid and informative outputs in many tasks [ 17 , 18 , 19 , 20 ] . Beyond improving surface-level variation, diversity directly affects the effectiveness of downstream usage, such as selecting high-quality candidates from multiple generations [ 21 ] , supporting iterative refinement, and enabling exploration in both text-only and multimodal inference settings [ 22 , 23 , 24 ] , which is crucial for broadening rollout trajectories in self-training or feedback-driven loops [ 25 , 26 , 27 , 28 ] . As a result, improving generation diversity has become an important objective in language modeling research. As discussed above, existing efforts to improve diversity in language models can be broadly categorized into two lines of work: training-free methods and training-based methods. Training-free Methods For Diversity. In training-free settings, efforts to improve LLM output diversity largely focus on decoding-time by modifying token selection to better navigate the quality–diversity trade-off. Deterministic decoding, such as greedy decoding and beam search, tends to follow the highest-probability trajectories, often yielding repetitive and generic outputs, while beam search additionally incurs non-trivial inference overhead [ 29 ] . In contrast, stochastic sampling injects randomness to broaden the space of continuations: temperature sampling rescales distribution sharpness to balance coherence and diversity [ 30 ] , but overly high temperatures can degrade coherence; top- k sampling restricts candidates to a fixed set of the k most probable tokens [ 18 ] , and may over-prune under high uncertainty since the truncation does not adapt to context-dependent confidence; top- p sampling preserves the probability “nucleus” by keeping the smallest set whose cumulative mass exceeds p [ 14 ] , yet under high-temperature regimes it can still admit low-probability tail tokens and thus produce incoherent outputs. To better adapt across contexts with varying uncertainty, recent work explores uncertainty-aware dynamic schemes. One line leverages global statistics such as entropy—e.g., \eta -sampling and mirostat dynamically regulate the sampling pool/information rate to maintain a target uncertainty level [ 31 , 32