Learning to Translate from Soft to Hard LLM Prompts
Pitipat Kongsomjit Suryansh Goyal Jacob Whitehill · 2026
Read Learning to Translate from Soft to Hard LLM Prompts by Pitipat Kongsomjit Suryansh Goyal Jacob Whitehill (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27642.txt.
Introduction
Pitipat Kongsomjit, Suryansh Goyal, and Jacob Whitehill train a model to translate soft prompt embeddings into plain language. Their translator verbalizes what a soft prompt learned, and those wordings used as standalone prompts beat baselines, showing they carry genuine task information. On average the wordings retain 32 percent of the original soft prompt's performance.
Catalog record
| CREATOR | Pitipat Kongsomjit Suryansh Goyal Jacob Whitehill |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53800 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27642
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to Translate from Soft to Hard LLM Prompts Pitipat Kongsomjit Suryansh Goyal Jacob Whitehill Abstract Soft prompt tuning is a parameter-efficient method for adapting LLMs to specific tasks, but suffers from a lack of interpretability. Building on recent work on interpreting soft prompts 23 , we explore how training a dedicated soft prompt to natural language translation model can yield higher translation quality. In particular, in both quantitative and qualitative comparisons on multiple Datasets of Datasets (DoDs), we demonstrate that our translator produces fluent, accurate verbalizations that outperforms existing training-free methods like InSPEcT. In addition to advancing interpretability, our work suggests a promising downstream application: soft prompts optimized on small, open-source models can be translated into portable text prompts that, when deployed on larger closed-API models, exceed the performance of the original soft prompt and, in some cases, even few-shot learning. 1 Introduction As an alternative to manual prompt engineering, LLM researchers and practitioners sometimes employ soft prompt tuning , whereby a sequence of learnable embeddings is prepended to the input sequence and then fed to an LLM for fine-tuning on some downstream task. Soft prompt tuning matches, and in some cases, surpasses fine-tuning of LLMs while containing significantly fewer parameters ( 16 ; 12 ) . Due to their ease of implementation and training, soft prompts are versatile and can be applied to a wide variety of tasks such as text classification ( 4 ) , relation extraction ( 20 ) , and even drug discovery ( 17 ) . Further, because soft prompts do not modify the model weights themselves, there is reduced risk of catastrophic forgetting ( 28 ) . In contrast to LLM parameters or adapters, soft prompts share the same embedding space as natural language tokens, and it is thus tempting to hope that they might be more interpretable than other LLM fine-tuning methods. Unfortunately, naive projections of soft prompts into discrete token space are often misleading and yield contradictory results ( 11 ) . Some works have found that soft prompts occupy regions in the embedding space that are distinct from those containing natural language ( 2 ) . Methods designed to optimize soft prompts for interpretability often incur reduced task performance ( 19 ) . Until recently, it was widely thought that soft prompts, while useful as a light-weight LLM optimization method, were fundamentally not interpretable. However, the InSPEcT technique 23 showed that the same LLM that uses soft prompts for prediction can also be utilized to elicit textual verbalizations of soft prompts. The technique is training-free: it simply relies on the model’s in-context learning ability to continue generating tokens after being fed the soft prompt as input. Such verbalizations, it turns out, often provide a glimpse into how the soft prompt operates. Nonetheless, InSPEcT leaves much to be desired in terms of reliable, clear descriptions of what the learned soft prompt means and what behaviors it induces in the LLM using it. In this paper, we explore whether there are stronger, more effective methods of interpreting soft prompts. In particular, instead of relying on in-context learning, we train a dedicated translation model, using the same architecture (but different model weights) as the LLM on which the soft prompts were trained. We find that our approach is promising and outperforms InSPEcT. Contributions : (1) We train a soft-to-hard prompt translator by constructing a Dataset of Datasets (DoD) from which many ( soft prompt , hard prompt ) pairs can be trained; we then show that the resulting translation model can verbalize soft prompts into natural language that is grammatically fluent and has substantial agreement with ground-truth task descriptions. As a baseline, we compare with InSPEcT and observe a clear improvement. (2) Beyond just greater interpretability, the translator’s verbalizations also show utility – they can be successfully used as prompts and given to larger LLMs. On a variety of tasks, verbalized prompts achieved superior performance to soft-prompting and even few-shot learning, indicating that the verbalizations are relevant and useful for the intended task. (3) We discuss how the existence of an accurate translator could open the door for novel LLM prompt tuning workflows whereby a small LLM is used to train a soft prompt, which is then translated to a hard prompt and given to a larger more powerful LLM for inference—potentially achieving superior inference performance than the small LLM. Figure 1: Our proposed hypothetical workflow: From left to right, first a soft prompt is trained on some supervised downstream task on a small-open source LLM. Once trained, the soft prompt is passed to our translator model, which produces a natural language translation. As a possible use case, the translation can then be used on its own as a portable prompt for a large, closed-source LLM for example. 2 Related Works A number of works have attempted to interpret soft prompts into natural language via obtaining their nearest discrete token projections. However, 11 showed that these naive projections of soft prompts into discrete token space are often misleading, completely uninformative, and in some cases contradictory to the underlying task through a phenomenon they termed prompt waywardness . Other works support this finding, showing that soft prompt embeddings occupy regions in the embedding space that are distinct from those containing natural language ( 2 ) . A number of methods designed to optimize soft prompts for interpretability have found a trade-off between task performance and interpretability ( 19 ) , ( 5 ) . Closer to the idea of translating a soft prompt into natural language, 23 recently proposed InSPEcT, a training-free method of eliciting textual descriptions of soft prompts. InSPEcT works by utilizing the Patchscopes 7 framework to patch soft prompt activations into a target prompt designed to verbalize descriptions of the task. While InSPEcT can successfully verbalize correct class labels for a given task, we found that verbalizations are often unreliable, sensitive to the specific source and target layers used for patching, and often contain unnatural language. Their experiments were also quite limited and assessed verbalization on only a handful of datasets. To date, there is no method which can reliably, fluently, and robustly (without any performance-interpretability trade-off) translate soft prompts into natural language. We thus explore whether a more powerful translation model can help. 3 Translating from Soft to Hard Prompts We explore a simple workflow (see Figure 1 ) for translating soft prompts to natural language whereby a dedicated translation model is trained with supervised learning on a dataset of ( soft prompt, hard prompt ) pairs. Here, each soft prompt was itself optimized for a specific task – e.g., sentiment classification – on a fixed LLM (typically small and open-source, e.g., Llama-8B) using a dataset of ( input , output ) pairs. The trained translation model, given some soft prompt trained on the same LLM, can produce a corresponding “hard prompt”, i.e., a natural language translation of the soft prompt. For a sentiment classification soft prompt, the hard prompt might be, ‘‘Examine the input sentence and classify it as positive or negative. A sentence is positive if...’’ Optionally, the generated hard prompt can then be fed to another LLM (typically larger and with a closed API, e.g., GPT-5.5). Given