Trick or Neat: Adversarial Ambiguity and Language Model Evaluation

Antonia Karamolegkou Oliver Eberle Phillip Rust Carina Kauf Anders Søgaard · 2025

Read Trick or Neat: Adversarial Ambiguity and Language Model Evaluation by Antonia Karamolegkou Oliver Eberle Phillip Rust Carina Kauf Anders Søgaard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01205.txt.

Description

Antonia Karamolegkou and four co-authors tested whether language models can spot double meanings, in a paper published in 2025. A word or line can be read two ways, and spotting that helps with jokes, traps in text, and readings of doubt. Their test set holds sound, word, and structure twists, plus altered foils: word swaps, synonym swaps, and random changes.

Asked directly, models failed to flag the twists with any strength. But thin probes trained on the models' own internal states read the twists with high accuracy, at times over nine in ten. The relevant code lives in set layers of the network. The authors release the data and code. They say the gap shows that prompts miss what models in fact know, a fact that test design must face.

Catalog record

CREATORAntonia Karamolegkou Oliver Eberle Phillip Rust Carina Kauf Anders Søgaard
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-01205

Browse the full library · About the Tower of Babel