OBLIQ-Bench: Exposing O verlooked B ottlenecks in Modern Retrievers with L atent and I mplicit Q ueries

Diane Tchuindjo, Devavrat Shah, Omar Khattab · 2026

Read OBLIQ-Bench: Exposing O verlooked B ottlenecks in Modern Retrievers with L atent and I mplicit Q ueries by Diane Tchuindjo, Devavrat Shah, Omar Khattab (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06235.txt.

Description

Diane Tchuindjo, Devavrat Shah, and Omar Khattab argue that modern search fails a class of queries they call oblique. An oblique query seeks documents that fit a latent pattern, such as tweets voicing an implicit stance or logs showing a failure mode. Retrieval benchmarks look saturated, yet the authors say efficient search is far from solved once such hidden pattern requests are counted.

They study three mechanisms that make queries oblique and build OBLIQ-Bench, five search problems over real long tail collections. A sharp asymmetry appears: reasoning models reliably verify latent relevance once a document is surfaced. Even sophisticated retrieval pipelines, though, fail to surface most relevant documents in the first place. The benchmark aims to push retrieval design toward latent pattern matching at scale.

Catalog record

CREATORDiane Tchuindjo, Devavrat Shah, Omar Khattab
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06235

Browse the full library · About the Tower of Babel