Bongards at the Boundary of Perception and Reasoning: Programs or Language?
Cassidy Langenfeld ([email protected]), Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu, Yewen Pu, Kevin Ellis · 2026
Read Bongards at the Boundary of Perception and Reasoning: Programs or Language? by Cassidy Langenfeld ([email protected]), Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu, Yewen Pu, Kevin Ellis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03038.txt.
Description
Classic visual puzzles test a neurosymbolic solver in a 2026 paper by Cassidy Langenfeld and 6 co-authors. Bongard problems show two sets of images separated by a hidden rule. Humans solve radically new cases easily, while vision-language models, strong at captioning and commonsense questions, struggle with this kind of abstract visual reasoning under novel rules.
Given a hypothesized rule, the authors use language models to generate parameterized programs expressing it. Bayesian optimization then fits the program's parameters. They evaluate the method in two ways. First, classifying images when the true rule is given. Second, solving problems from scratch without that help. The approach links language-based hypotheses with program-based precision for visual reasoning.
Catalog record
| CREATOR | Cassidy Langenfeld ([email protected]), Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu, Yewen Pu, Kevin Ellis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03038