Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness
Tingchen Fu, Fazl Barez · 2025
Read Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness by Tingchen Fu, Fazl Barez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01345.txt.
Description
Tingchen Fu and Fazl Barez present, in a 2025 paper, a training method that makes language models steady when a prompt is reworded. The same question in new words can trip a model, yet fixes so far rely on hand-tuned prompts or costly run-time tricks. Their insight is that the worst rewordings push the model's inner code off course.
Their framework, Latent Adversarial Paraphrasing, runs two loops. The inner loop learns a small shift that acts like a hard rewording while keeping the sense intact. The outer loop tunes the model to withstand those shifts. On a robustness test set, the method beat plain fine-tuning on worst-case win rates by half a point to four points. Gains held across several model families.
Catalog record
| CREATOR | Tingchen Fu, Fazl Barez |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-01345