Trick or Neat: Adversarial Ambiguity and Language Model Evaluation
Antonia Karamolegkou Oliver Eberle Phillip Rust Carina Kauf Anders Søgaard · 2025
Read Trick or Neat: Adversarial Ambiguity and Language Model Evaluation by Antonia Karamolegkou Oliver Eberle Phillip Rust Carina Kauf Anders Søgaard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01205.txt.
Description
Antonia Karamolegkou and four co-authors tested whether language models can spot double meanings, in a paper published in 2025. A word or line can be read two ways, and spotting that helps with jokes, traps in text, and readings of doubt. Their test set holds sound, word, and structure twists, plus altered foils: word swaps, synonym swaps, and random changes.
Asked directly, models failed to flag the twists with any strength. But thin probes trained on the models' own internal states read the twists with high accuracy, at times over nine in ten. The relevant code lives in set layers of the network. The authors release the data and code. They say the gap shows that prompts miss what models in fact know, a fact that test design must face.
Catalog record
| CREATOR | Antonia Karamolegkou Oliver Eberle Phillip Rust Carina Kauf Anders Søgaard |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-01205