Steering Large Language Models with Register Analysis for Arbitrary Style Transfer
Xinchen Yang, Marine Carpuat · 2025
Read Steering Large Language Models with Register Analysis for Arbitrary Style Transfer by Xinchen Yang, Marine Carpuat (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00679.txt.
Introduction
Xinchen Yang and Marine Carpuat tackle style transfer with large language models in a paper from twenty twenty-five. The task is to rewrite a text so it matches the style of a sample text the user gives. The hard part is telling the model what that style is. A poor account of style leads to weak rewrites.
The authors use register analysis, a way of describing how word choice fits a setting and a goal. They turn that account into a prompt for the model. Tests across several style tasks show their prompts work well. Rewrites matched the target style more strongly than with older prompt styles. They also kept the source sense intact more often. The method needs no extra training of the model.
Catalog record
| CREATOR | Xinchen Yang, Marine Carpuat |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00679
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Steering Large Language Models with Register Analysis for Arbitrary Style Transfer Xinchen Yang, Marine Carpuat Abstract Large Language Models (LLMs) have demonstrated strong capabilities in rewriting text across various styles. However, effectively leveraging this ability for example-based arbitrary style transfer—where an input text is rewritten to match the style of a given exemplar—remains an open challenge. A key question is how to describe the style of the exemplar to guide LLMs toward high-quality rewrites. In this work, we propose a prompting method based on register analysis to guide LLMs to perform this task. Empirical evaluations across multiple style transfer tasks show that our prompting approach enhances style transfer strength while preserving meaning more effectively than existing prompting strategies. 1 Introduction Text style transfer (TST) refers to the task of transforming an input text into a target style (e.g. formality) while preserving non-style attributes such as meaning and fluency ( Mir et al. 2019 ; Krishna et al. 2020 ; Jin et al. 2022 ) . TST has many downstream applications. For example, one application is the intelligent writing assistant, which helps rewrite texts to meet users’ personalized requests (e.g. more professional, polite, etc.) ( Jin et al. 2022 ) . Other applications include text simplification, text detoxification, authorship obfuscation and so on ( Jin et al. 2022 ; Mukherjee et al. 2024 ; Fisher et al. 2024 ) . Recent advances in natural language generation (NLG) and large language models (LLMs) have made it possible to perform TST tasks automatically at scale ( Jin et al. 2022 ) . In response to a growing need for TST methods with reduced data requirements and broader style coverage ( Jin et al. 2022 ; Hu et al. 2023 ) , research community has increasingly focused on a general formulation of style transfer, arbitrary TST , in which an LLM rewrites an input text into an arbitrary style specified by the user at inference-time ( Suzgun et al. 2022 ; Reif et al. 2022 ; Patel et al. 2024 ) . Reif et al. 2022 shows promise in framing arbitrary TST as a sentence rewriting task by using natural language instructions such as ”make this melodramatic”. Despite of its flexibility, end-users are left with the task of constructing the right prompt for a desired style, which often requires opaque prompt engineering, and is particularly difficult for non-native speakers or other users unfamiliar with how to express exact stylistic nuances in technical terms. Reacting to this, example-based arbitrary TST comes as a solution, where representative target-style exemplars are provided at inference-time, allowing LLM to infer the desired style from exemplars without requiring users to explicitly characterize it. For example, Patel et al. 2024 introduces STYLL, an example-based abitrary TST method, where the LLM is prompted to summarize a few target-style exemplars provided at inference-time into a list of open-ended style descriptors (e.g. ”clear, concise, persuasive, intelligent”) before applying them to rewrite the input text. However, relying on such open-ended descriptions, whether user-provided or model-inferred, may poses challenges. While these descriptors may help move the text away from the source style, they do not always ensure faithful reproduction of the target style ( Patel et al. 2024 ) . Moreover, as the style descriptors are unconstrained , it is unclear whether they may have side effects such as muddying the line between style and content and thus causing unintended meaning alteration. To address the above challenges, we propose prompting LLMs to analyze exemplars’ style using Biber’s multidimensional register analysis (MDA) framework. Our modeling hypothesis is that Biber’s register analysis provides a structured and effective way to generate accurate target style descriptors that LLMs can reliably use in TST generation. First, because Biber’s register analysis framework is widely available online and used in educational and linguistic contexts, LLMs are likely to have been exposed to examples of such analyses during training. Second, Biber’s approach is data-driven, grounded in empirical analysis of large corpora, with its key register dimensions found across multiple languages and in online texts ( Biber 1995 ; Biber & Egbert 2018 ) , suggesting that Biber’s framework is useful to highlight style variations that are salient in LLM pre-training data, of which online texts constitute a large portion. As a result, using Biber’s register analysis to describe examplars may produce theory-grounded, easy-to-follow style descriptors for LLMs. Additionally, we explore whether contrasting the style of input and target exemplars yield better results than characterizing the style of target exemplar only . In this work, we evaluate two prompting variants, with one of them based on Biber’s register analysis and input-target style contrast while the other one based on register analysis only, against several baselines on a diverse range of style transfer tasks, including authorship imitation, formality transfer and text simplification. Empirical results show that our prompting approach enhances style transfer quality: (1) Our prompting variants show similar to improved style transfer strength compared to the baselines; (2) Our prompting variants show a large gain in meaning preservation across the tasks. Our main contributions are as follows: • We propose a prompting method based on register analysis to enhance the quality of example-based arbitrary TST. In addition, we investigate the impact of input-target contrast v.s. characterizing target only across different use cases. • Experiments across diverse style transfer tasks show that our approach enhances rewriting quality, with similar to better style transfer strength and remarkable gains in meaning preservation, suggesting better decoupling of style and content. 2 Background 2.1 Style and Register in Corpus Linguistics In linguistics, style refers to the language habits of one person (e.g. Shakespeare), or a group of people at one time or over a period of time (e.g. Old English ”heroic” poetry) ( Crystal & Davy 1969 ) . Style reflects an individual’s linguistic idiosyncrasies, and thus has applications in disputed authorship resolution, forensic linguistics and so on ( Crystal & Davy 1969 ; Rudman 2005 ; Coulthard et al. 2016 ) . Register , on the other hand, refers to linguistic variation associated with the situational use of language and are generally described by three components: situational context, linguistic features (e.g. lexical and grammatical characteristics), and functional relationships between the first two ( Biber 1988 ; Halliday & Hasan 1989 ; Biber & Conrad 2009 ) . For example, registers can be characterized by speech / writing situation and communicative purposes (e.g. personal letter, academic, narrate, etc.) ( Biber & Conrad 2009 ) . In this view, linguistic features are always functional : they tend to occur in a register because they are suited to the situational and communicative context of the register ( Biber & Conrad 2009 ) . One framework to analyze authorship style is stylometry . Typically, stylometric analysis involves statistical analysis of relative frequencies of common words, especially functional words (i.e. words with little lexical meaning and expressing grammatical relationships among other words) ( Binongo 2003 ; Argamon 2018 ; Grieve 2023 ) . Stylometric analysis has been successful in distinguishing authorship styles ( Shakespeare 2016 ; Taylor & Egan 2017 ) . However, it lacks explainability and backing of linguistic theories, making it insufficient in applications such as forensic investigation, where such requirements are