ILRR: Inference-Time Steering Method for Masked Diffusion Language Models
Eden Avrahami, Eliya Nachmani · 2026
Read ILRR: Inference-Time Steering Method for Masked Diffusion Language Models by Eden Avrahami, Eliya Nachmani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21647.txt.
Introduction
Eden Avrahami and Eliya Nachmani steer masked diffusion language models while they generate, without any training. These models build text by filling in blanks in parallel, a real alternative to word-by-word writing. Controls for steering them at run time are still little explored.
Their method refines the model's inner representation step by step, guided by one reference sequence. The reference pulls the output toward a desired style or content. Because nothing is retrained, the steering can be swapped per request. Run-time control matters for products that must adapt tone or obey fresh constraints on the fly.
Catalog record
| CREATOR | Eden Avrahami, Eliya Nachmani |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21647
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ILRR: Inference-Time Steering Method for Masked Diffusion Language Models Eden Avrahami, Eliya Nachmani Abstract Discrete Diffusion Language Models (DLMs) offer a promising non-autoregressive alternative for text generation, yet effective mechanisms for inference-time control remain relatively underexplored. Existing approaches include sampling-level guidance procedures or trajectory optimization mechanisms. In this work, we introduce Iterative Latent Representation Refinement (ILRR), a learning-free framework for steering DLMs using a single reference sequence. ILRR guides generation by dynamically aligning the internal activations of the generated sequence with those of a given reference throughout the denoising process. This approach captures and transfers high-level semantic properties, with a tunable steering scale enabling flexible control over attributes such as sentiment. We further introduce Spatially Modulated Steering, an extension that enables steering long texts using shorter references by regulating guidance intensity across the sequence. Empirically, we demonstrate that ILRR achieves effective attribute steering on LLaDA and MDLM architectures with a minor computational overhead, requiring only one additional parallel forward pass per denoising step. Under the same compute budget, ILRR improves attribute accuracy over comparable baselines by 10 % \% to 60 % \% points, while maintaining high generation quality. 1 Introduction Discrete diffusion language models (DLMs) have recently gained significant traction as a viable non-autoregressive framework for text generation ( 2 ; 22 ) . With recent advancements in model scaling and training methodologies, architectures such as Dream ( 35 ) and LLaDA ( 16 ) have demonstrated capabilities matching those of established autoregressive baselines, even on complex tasks such as mathematical reasoning and code synthesis. Unlike the sequential text generation of autoregressive models ( 31 ; 4 ; 21 ) , DLMs generate text via a global iterative procedure, reconstructing masked tokens by sampling from a learned reverse denoising process. Despite this progress in generation quality, the domain of controllable generation for DLMs remains relatively underexplored. While methods for steering autoregressive models’ generations are well-established ( 7 ; 33 ; 11 ; 12 ) , certain paradigms for efficient inference-time guidance in discrete diffusion have yet to be fully realized. Inference-time steering is particularly appealing as it allows for the flexible modulation of model behaviors, such as enforcing safety constraints or stylistic attributes, without the substantial computational resources required for parameter fine-tuning. Recent work has demonstrated that DLMs can be effectively steered at inference time through a variety of sampling level guidance strategies ( 25 ; 6 ; 23 ; 32 ; 10 ) . These approaches range from classifier guided and classifier free mechanisms to trajectory optimization methods, many of which require maintaining multiple parallel candidate sequences or performing iterative resampling, thereby incurring a substantial computational overhead to achieve effective control. This creates a clear opportunity for exploring low overhead, dynamic steering that operates directly in a model’s latent activation space, leveraging internal representations to guide generation adaptively. In this work, we propose Iterative Latent Representation Refinement (ILRR) , an efficient, adaptable framework for steering the generation of DLMs. Inspired by the Iterative Latent Variable Refinement (ILVR) technique in continuous diffusion ( 5 ) , ILRR guides generation using a single reference sequence that exemplifies the desired attribute or style. ILRR operates in the model’s continuous activation space. At each denoising step, within a targeted subset of layers, we compute semantic guidance signals from the activations of a noise-corrupted reference and inject them into the generated sequence’s activations. This dynamically nudges the generation trajectory toward the reference’s high-level semantics while allowing the model to fill in the specific syntax and details. Crucially, ILRR operates with a minimal computational overhead, requiring only one additional forward pass per generation step. We evaluate ILRR on standard controlled generation benchmarks, including toxicity and sentiment attribute steering, using LLaDA and MDLM as base models. Our results show that ILRR consistently outperforms baselines at comparable compute budgets, indicating that ILRR offers an efficient and effective approach to inference-time steering in DLMs. Our contributions are summarized as follows: • We introduce ILRR, an adaptation of ILVR to discrete diffusion, enabling effective text reference based steering via representation refinement, with tunable parameters controlling steering intensity. • We further propose the spatially modulated steering extension, which allows effective guidance when the reference sequence is significantly shorter than the target output. • We demonstrate that ILRR achieves strong control with minimal overhead, improving steering accuracy by 10 \% to 60 \% points, while maintaining high generation quality. 2 Related Work Discrete diffusion language models have emerged as a robust non-autoregressive alternative for text generation, employing diverse architectures that typically utilize iterative denoising or remasking processes to reconstruct masked sequences ( 2 ; 22 ; 16 ; 35 ; 14 ; 24 ; 37 ) . Controllable generation is a profound and well-established research topic in autoregressive modeling. Methods include utilization of gradients or auxiliary models to bias sampling distributions ( 7 ; 33 ; 11 ) . Research into the interpretability of internal representations has also demonstrated that learned features can be directly manipulated for semantic control, a technique known as activation steering ( 30 ; 38 ; 17 ; 1 ) . In diffusion language models, controllable generation at inference time remains an evolving area. Current approaches in this domain include reward-guided sampling and search algorithms ( 25 ; 6 ; 34 ; 36 ) , classifier-based and classifier-free guidance ( 23 ) , learned unmasking policies ( 10 ) , or trajectory scaling mechanisms ( 32 ) . In the continuous diffusion domain, approaches have demonstrated the effectiveness of controllable generation by utilizing reference inputs to steer the generation process within the latent space ( 5 ; 15 ; 29 ) . 3 Background 3.1 Diffusion Generative Models Diffusion models are a class of generative models that learn to reverse a gradual corruption process. The generation begins with a sample from a high-entropy prior distribution x_{T} (e.g., pure noise) and iteratively refines it over timesteps t=T,\dots,1 to produce a clean data sample x_{0} . Formally, this framework consists of two main processes: • The forward process q(x_{t}|x_{0}) , which gradually corrupts clean data x_{0} into noise x_{T} according to a fixed noise schedule. • The reverse process p_{\theta}(x_{t-1}|x_{t}) , a model trained to reverse this corruption process, by estimating the clean data or the noise component at each step. While the high-level structure is shared, the mathematical definition of these processes differs between continuous and discrete domains. 3.2 Continuous Diffusion Models In continuous domains (e.g., images), the forward process q(x_{t}|x_{0}) typically adds Gaussian noise to the data. For a clean data point x_{0} , the noisy state x_{t} is defined as: x_{t}=\sqrt{\bar{\beta}_{t}}x_{0}+\sqrt{1-\bar{\beta}_{t}}\epsilon,\quad\epsilon\sim\mathcal{N}(0,I) (1) where \bar{\beta}_{t} is the noise schedule. The reverse process p_{\theta}(x_{t-1}|x_{t}) is a network trained to remove this noise by predicting \epsilon to gradually recover the original data ( 26 ; 9 ; 27 ) . 3.3 Discrete Diffusion Language Models DLMs ( 2 ) adapt the framework to the discrete nature of language. We consider a sequence x_{0}=(x_{0}^{1},x_{0}^{2},\dots,x_{0}^{N}) where each token x_{0}^{i} belongs to a vocabulary \mathcal{V} , and introduce a special mask token [M] . Forward Process: The forward process q gradually corrupts the clean sequence x_{0} by substituting discrete tokens with the mask token [M] . The marginal distribution q(x_{t}|x_{0}) allows