Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness

Tingchen Fu, Fazl Barez · 2025

Read Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustness by Tingchen Fu, Fazl Barez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01345.txt.

Description

Tingchen Fu and Fazl Barez present, in a 2025 paper, a training method that makes language models steady when a prompt is reworded. The same question in new words can trip a model, yet fixes so far rely on hand-tuned prompts or costly run-time tricks. Their insight is that the worst rewordings push the model's inner code off course.

Their framework, Latent Adversarial Paraphrasing, runs two loops. The inner loop learns a small shift that acts like a hard rewording while keeping the sense intact. The outer loop tunes the model to withstand those shifts. On a robustness test set, the method beat plain fine-tuning on worst-case win rates by half a point to four points. Gains held across several model families.

Catalog record

CREATORTingchen Fu, Fazl Barez
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-01345

Browse the full library · About the Tower of Babel