IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions

Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz, Jiahuan Pei, Kfir Bar · 2026

Read IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions by Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz, Jiahuan Pei, Kfir Bar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22247.txt.

Description

Hashiloni and colleagues introduce IdioLink, a retrieval benchmark that tests whether models can link idioms to the same meaning stated literally or in paraphrase. Idioms resist word-by-word reading, so the test demands meaning beyond surface overlap. The set holds 10,700 documents and 2,140 queries across 107 idioms, each used literally and figuratively. Strong embedding models still struggle, leaning on topic and shallow cues instead of true equivalence.

Catalog record

CREATORKai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz, Jiahuan Pei, Kfir Bar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53901
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22247

Browse the full library · About the Tower of Babel