Bongards at the Boundary of Perception and Reasoning: Programs or Language?

Cassidy Langenfeld ([email protected]), Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu, Yewen Pu, Kevin Ellis · 2026

Read Bongards at the Boundary of Perception and Reasoning: Programs or Language? by Cassidy Langenfeld ([email protected]), Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu, Yewen Pu, Kevin Ellis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03038.txt.

Description

Classic visual puzzles test a neurosymbolic solver in a 2026 paper by Cassidy Langenfeld and 6 co-authors. Bongard problems show two sets of images separated by a hidden rule. Humans solve radically new cases easily, while vision-language models, strong at captioning and commonsense questions, struggle with this kind of abstract visual reasoning under novel rules.

Given a hypothesized rule, the authors use language models to generate parameterized programs expressing it. Bayesian optimization then fits the program's parameters. They evaluate the method in two ways. First, classifying images when the true rule is given. Second, solving problems from scratch without that help. The approach links language-based hypotheses with program-based precision for visual reasoning.

Catalog record

CREATORCassidy Langenfeld ([email protected]), Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu, Yewen Pu, Kevin Ellis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03038

Browse the full library · About the Tower of Babel