Improving Text Style Transfer using Masked Diffusion Language Models with Inference-time Scaling

Tejomay Kishor Padole, Suyash P. Awate, Pushpak Bhattacharyya · 2025

Read Improving Text Style Transfer using Masked Diffusion Language Models with Inference-time Scaling by Tejomay Kishor Padole, Suyash P. Awate, Pushpak Bhattacharyya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10995.txt.

Introduction

Tejomay Padole, Suyash Awate, and Pushpak Bhattacharyya use masked diffusion models to rewrite text in a new style. Their 2025 paper builds on a fresh breed of text generators that fill in masked words step by step, rather than writing left to right. Such models train well and now lead their class.

Generation with them can be honed at run time by taking more steps or by grading each draft. The authors add a soft grader, built from off-the-shelf word-vector models, that steers each cleanup step toward a better draft. On standard style-swap tasks their models beat the classic left-to-right kind. The grader lifted quality on top of the guidance tricks already in use.

Catalog record

CREATORTejomay Kishor Padole, Suyash P. Awate, Pushpak Bhattacharyya
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-10995

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improving Text Style Transfer using Masked Diffusion Language Models with Inference-time Scaling Tejomay Kishor Padole, Suyash P. Awate, Pushpak Bhattacharyya Abstract Masked diffusion language models (MDMs) have recently gained traction as a viable generative framework for natural language. This can be attributed to its scalability and ease of training compared to other diffusion model paradigms for discrete data, establishing itself as the state-of-the-art non-autoregressive generator for discrete data. Diffusion models, in general, have shown excellent ability to improve the generation quality by leveraging inference-time scaling either by increasing the number of denoising steps or by using external verifiers on top of the outputs of each step to guide the generation. In this work, we propose a verifier-based inference-time scaling method that aids in finding a better candidate generation during the denoising process of the MDM. Our experiments demonstrate the application of MDMs for standard text-style transfer tasks and establish MDMs as a better alternative to autoregressive language models. Additionally, we show that a simple soft-value-based verifier setup for MDMs using off-the-shelf pre-trained embedding models leads to significant gains in generation quality even when used on top of typical classifier-free guidance setups in the existing literature. † † paperid: 6946 Figure 1 : Diagram showing a single denoising step (i.e., the reverse process) of MDM with the soft-value diffusion decoding method paired with a pre-trained sentence-embedding-based verifier at an arbitrary timestep t . An intermediate noisy sample x_{t} is passed through the denoiser, and M candidates for x_{t-1} are sampled. The M candidates pass through the verifier which follows three steps: (1) x_{0}-\text{prediction} for each candidate, (2) detokenize x_{0} to form a sentence, and (3) pass the sentence through the embedding model to obtain sentence embedding. The input sentence embedding and the candidate embeddings are used to calculate the value function v_{t-1}(\cdot) (i.e., the expected reward as defined in 3.2 ). The final x_{t-1} is chosen such that it maximizes the value function. 1 Introduction The current landscape of natural language generation is dominated by pre-trained autoregressive large language models (LLMs). The next-token prediction strategy these models employ has proven to be very effective for generative modeling on language data that is typically provided with large-scale corpora ( Brown and et al. 2020 ; Dubey and et al. 2024 ) . However, sequential sampling also comes with limitations. Specifically, such a strategy suffers from ”sampling drifts”, meaning that the generation degrades as it progresses due to error accumulation Lou et al. 2024 . Diffusion language modeling offers an alternative strategy by proposing non-autoregressive sampling of tokens with iterative denoising, potentially mitigating these downsides. Recently, the masked diffusion language modeling (MDM) paradigm has been proposed as a scalable approach that has been quite competitive with autoregressive models on the same parameter scale ( Sahoo et al. 2024 ; Nie et al. 2025a ; Nie et al. 2025b ) . Apart from non-autoregressive generation, diffusion models have also demonstrated excellent abilities in guiding the generation towards specific outputs. Diffusion guidance techniques can be mainly classified as: (1) classifier guidance Dhariwal and Nichol 2021 where an external classifier is trained, which provides gradient-based guidance signals to the diffusion model during sampling, (2) classifier-free guidance (CFG) Ho and Salimans 2021 where a diffusion model is trained jointly for conditional and unconditional generation which improves fidelity during sampling, and (3) training-free guidance (TFG) Ye and et al. 2024 where off-the-shelf pre-trained models are used directly to provide gradient-based guidance signals to a diffusion model. Apart from these, derivative-free guidance techniques have recently emerged as an alternative to classifier guidance and TFG, eliminating the gradient-computation step during sampling and easing the adaptation of off-the-shelf pre-trained models for guidance. Such techniques either follow a sequential Monte Carlo approach to improve the conditioning Dou and Song 2024 or perform explicit reward maximization by setting the pre-trained model’s likelihood/ classifier logits as rewards Li et al. 2024 . Guidance mechanisms in diffusion models are effective methods to scale the inference-time compute in diffusion models Ma et al. 2025 . For instance, external models (either trained specifically for a task or used off-the-shelf) that offer guidance signals to diffusion models are seen as verifiers that consume extra compute. In return, they provide more control and potentially improve generation quality when combined with search algorithms. Existing work on diffusion models for discrete data has proposed methods to apply guidance mechanisms in discrete spaces ( Schiff et al. 2025 ; Nisonoff et al. 2024 ; Li et al. 2024 ) . However, their experiments are mostly restricted to discrete data modalities such as small molecules, DNA sequences, and protein sequences, while the language modality remains largely unexplored. The work of Lee et al. 2025 showcases discrete diffusion guidance on language with sequential Monte Carlo but only applies it to attribute control for unconditional text generation. The work of Lyu et al. 2023 is conceptually closest to ours, which explores style transfer with seq-to-seq continuous diffusion Gong et al. 2023 , but they do not explore any guidance mechanisms or discuss inference-time scaling with external verifier-based search algorithms. In this paper, we propose verifier-based inference-time scaling with masked diffusion language models (MDMs) for text-style transfer, one of the well-studied and important conditional language generation tasks. Specifically, we design a novel derivative-free guidance method with MDMs using pre-trained sentence-embedding models as external verifiers. We demonstrate the effectiveness of this setup using two standard text-style transfer tasks. To the best of our knowledge, we are the first to propose this setting for any conditional language generation task. 1 1 1 Code can be found here . Our contributions are 1. a novel derivative-free guidance method for MDMs using guidance signals from off-the-shelf pre-trained sentence embedding models to enhance conditional language generation. (Section 3.2 ). 2. demonstration (for the first time, to the best of our knowledge) of the utility of MDMs for text style transfer (with available parallel data for training) by performing seq-to-seq fine-tuning on pre-trained MDMs (Section 3 ). 3. extensive experiments with autoregressive and diffusion baselines establishing MDMs as a better alternative and highlighting the impact of inference-time scaling in MDMs (Section 5 ). 4. empirical analysis of inference-time compute scaling methods along different scaling axes, namely denoising steps and number of samples considered during the verification step to obtain guidance signals (Section 5.2 ). 2 Background 2.1 Text Style Transfer Text style transfer (TST) is a natural language generation task that involves modifying the stylistic properties of a given input text (e.g., sentiment, formality, or dialect) while preserving its underlying semantic content. TST is considered an important task in NLP since the choice of style plays a vital role in understanding user intent Jin et al. 2022 . Formally, given a source sentence x with style s_{1} , the goal of TST is to generate a new sentence x^{\prime} such that x^{\prime}\approx x in content and exhibits a target style s_{2} . The task has been explored in various supervised, unsupervised, and semi-supervised settings. When parallel corpora are available—that is, sentence pairs (x,y) where x is a sentence in style s_{1} and y is its corresponding rewriting in style s_{2} with the same semantic content—the task can be cast as a supervised

Read the complete text