IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions
Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz, Jiahuan Pei, Kfir Bar · 2026
Read IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions by Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz, Jiahuan Pei, Kfir Bar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22247.txt.
Description
Hashiloni and colleagues introduce IdioLink, a retrieval benchmark that tests whether models can link idioms to the same meaning stated literally or in paraphrase. Idioms resist word-by-word reading, so the test demands meaning beyond surface overlap. The set holds 10,700 documents and 2,140 queries across 107 idioms, each used literally and figuratively. Strong embedding models still struggle, leaning on topic and shallow cues instead of true equivalence.
Catalog record
| CREATOR | Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz, Jiahuan Pei, Kfir Bar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53901 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22247