How Persuasive is Your Context?
Tu Nguyen Kevin Du Alexander Miserlis Hoyle Ryan Cotterell ETH Zürich [email protected] [email protected] [email protected] [email protected] · 2025
Read How Persuasive is Your Context? by Tu Nguyen Kevin Du Alexander Miserlis Hoyle Ryan Cotterell ETH Zürich [email protected] [email protected] [email protected] [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17879.txt.
Description
Tu Nguyen and 3 co-authors score how strongly a prompt text can sway a language model. Their 2025 paper sets two skills side by side: use of stored facts, and use of new facts given in the prompt. A prompt that clashes with stored facts may or may not move the model's answer.
Their score, TPS, goes past just reading the top answer. It tracks how far the whole spread of likely answers moves toward a target spread. Tests show the score picks up fine shifts that blunt checks miss. That gives a sharper tool to study when models yield to context.
Catalog record
| CREATOR | Tu Nguyen Kevin Du Alexander Miserlis Hoyle Ryan Cotterell ETH Zürich [email protected] [email protected] [email protected] [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17879