Do Vision-Language-Models show human-like logical problem-solving capability in point and click puzzle games?

Maximilian Triebel, Marco Menner, Dominik Helfenstein · 2026

Read Do Vision-Language-Models show human-like logical problem-solving capability in point and click puzzle games? by Maximilian Triebel, Marco Menner, Dominik Helfenstein (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11223.txt.

Description

Maximilian Triebel, Marco Menner, and Dominik Helfenstein introduce VLATIM, a benchmark testing whether vision-language models can solve point-and-click puzzle games the way people reason through them. Existing benchmarks often overlook the physical reasoning these games demand, and VLATIM targets the divide between abstract logical reasoning and continuous action spaces that need precise mouse control.

The benchmark uses the classic physics puzzle game TIM and runs in five progressive parts, from basic visual grounding and domain understanding through multi-step manipulation to full puzzle solving. Results show a clear split between reasoning and execution: large proprietary models plan well but struggle with precise visual grounding. They still lack human-like problem-solving capability. Benchmark designers get a test that separates planning skill from execution skill.

Catalog record

CREATORMaximilian Triebel, Marco Menner, Dominik Helfenstein
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50013
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11223

Browse the full library · About the Tower of Babel