CresOWLve : Benchmarking Creative Problem-Solving Over Real-World Knowledge

Mete Ismayilzada Renqing Cuomao Daniil Yurshevich Anna Sotnikova, Lonneke van der Plas Antoine Bosselut · 2026

Read CresOWLve : Benchmarking Creative Problem-Solving Over Real-World Knowledge by Mete Ismayilzada Renqing Cuomao Daniil Yurshevich Anna Sotnikova, Lonneke van der Plas Antoine Bosselut (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03374.txt.

Description

Ismayilzada and colleagues introduce CresOWLve, a benchmark of 2,061 examples for testing creative problem-solving in language models. Problems span five difficulty levels and demand factual recall plus non-obvious connections across domains. Models score far better on factual questions than creative ones, dropping up to 17 percent, showing retrieval is easier than creative integration.

Catalog record

CREATORMete Ismayilzada Renqing Cuomao Daniil Yurshevich Anna Sotnikova, Lonneke van der Plas Antoine Bosselut
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62649
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03374

Browse the full library · About the Tower of Babel