OrigamiBench: An Interactive Environment to Synthesize Flat-Foldable Origamis

Naaisha Agarwal, Yihan Wu, Yichang Jian, Yifei Peng, Yao-Xiang Ding, Nishad Mansoor, Yikuan Hu, Mohan Li, Wang-Zhou Dai, Emanuele Sansone · 2026

Read OrigamiBench: An Interactive Environment to Synthesize Flat-Foldable Origamis by Naaisha Agarwal, Yihan Wu, Yichang Jian, Yifei Peng, Yao-Xiang Ding, Nishad Mansoor, Yikuan Hu, Mohan Li, Wang-Zhou Dai, Emanuele Sansone (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13856.txt.

Introduction

Agarwal and co-authors present OrigamiBench, a benchmark that tests whether AI models understand how origami shapes get made. Folding demands vision, geometry, physical limits, and step-by-step planning at once. The benchmark uses a high-level language of fold actions grounded in real physics. Tests with modern vision-language models show that bigger models do not reliably reason better about folds. Models also struggle to link program steps to what they see, which points to weak ties between vision and language.

Catalog record

CREATORNaaisha Agarwal, Yihan Wu, Yichang Jian, Yifei Peng, Yao-Xiang Ding, Nishad Mansoor, Yikuan Hu, Mohan Li, Wang-Zhou Dai, Emanuele Sansone
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65311
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13856

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OrigamiBench: An Interactive Environment to Synthesize Flat-Foldable Origamis Naaisha Agarwal, Yihan Wu, Yichang Jian, Yifei Peng, Yao-Xiang Ding, Nishad Mansoor, Yikuan Hu, Mohan Li, Wang-Zhou Dai, Emanuele Sansone Abstract Building AI systems that can plan, act, and create in the physical world requires more than pattern recognition. Such systems must understand the causal mechanisms and constraints governing physical processes in order to guide sequential decisions. This capability relies on internal representations, analogous to an internal language model, that relate observations, actions, and resulting environmental changes. However, many existing benchmarks treat visual perception and programmatic reasoning as separate problems, focusing either on visual recognition or on symbolic tasks. The domain of origami provides a natural testbed that integrates these modalities. Constructing shapes through folding operations requires visual perception, reasoning about geometric and physical constraints, and sequential planning, while remaining sufficiently structured for systematic evaluation. We introduce OrigamiBench , an interactive benchmark in which models iteratively propose folds and receive feedback on physical validity and similarity to a target configuration. Experiments with modern vision–language models show that scaling model size alone does not reliably produce causal reasoning about physical transformations. Models fail to generate coherent multi-step folding strategies, suggesting that visual and language representations remain weakly integrated. 1 Introduction Building AI systems that can reliably act in the physical world requires more than pattern recognition. Models must develop a causal understanding of physical processes while making sequential decisions under geometric and physical constraints. Evaluating such abilities therefore requires benchmarks that jointly test visual perception and structured reasoning about physical transformations. Existing benchmarks typically evaluate perception or reasoning in isolation. Visual question answering benchmarks ( 10 ; 18 ) focus on visual understanding but often lack structured reasoning constraints, while symbolic benchmarks emphasize programmatic reasoning with little perceptual grounding ( 5 ; 21 ; 14 ; 19 ; 6 ) . More recent work explores hybrid benchmarks in physics-based simulation environments ( 3 ; 15 ) . However, designing such benchmarks remains challenging due to the tension between achieving realistic physical environments and maintaining the structured representations needed for systematic evaluation and symbolic supervision. Origami synthesis provides a domain that naturally captures structured physical transformations grounded in visual perception. In origami, a flat sheet of paper is transformed into a target 2D shape through a sequence of folds constrained by geometric validity and foldability 2 . Despite relying on a single primitive action, the fold, origami can generate highly complex structures, making it a compact domain for reasoning about geometric transformations. The folding process also reflects recursive composition, a key concept in programming and formal reasoning ( 8 ) , while the open-ended design space supports the evaluation of generalization and creative problem solving. To leverage these properties, we introduce OrigamiBench , an interactive benchmark for evaluating whether AI models can reason about geometric transformations while synthesizing shapes through folding operations. In OrigamiBench , models iteratively propose folds and receive feedback on physical validity and similarity to a target shape, requiring the integration of perception, constraint reasoning, and multi-step planning. Experiments with modern vision–language models reveal three key findings: scaling model size alone does not reliably produce causal reasoning about transformations, models struggle to generate coherent multi-step folding plans, and visual and language representations remain weakly integrated. 2 OrigamiBench 2.1 Data Organization The origami dataset comprises 366 distinct origami designs collected from the publicly available online resource associated with the “Flat-Folder” project ( 1 ) . Each design is encoded in the .fold file format ( 2 ; 7 ) , a standardized data structure for representing origami crease patterns. The .fold format captures four components of an origami model: vertex coordinates ( vertices_coords ), edge connectivity ( edges_vertices ), fold type assignments ( edges_assignment ), and face definitions ( faces_vertices ). For visual inspection, we developed a rendering pipeline that converts each .fold file into SVG and PNG image representations of the corresponding folded configurations. Each sample in the dataset is organized along two dimensions: semantic category and complexity level. The semantic category captures the representational type of the origami model, with classes including roles , animals , plants , geometry , and so on. The complexity level ( Easy , Medium , or Hard ) is determined by the structural complexity of the crease pattern, primarily based on the counts of vertices and crease lines. This two-dimensional organization allows us to evaluate model performance across different semantic domains and complexity levels. The full taxonomy of these semantic and complexity classes is detailed in Appendix B . 2.2 Environment Figure 1 : Visual summary of OrigamiBench . In the top-left corner ( data ), examples of crease patterns ( .fold ) from the animal class are shown together with their corresponding rendered origami images ( PNG ), ordered by increasing complexity. In the top-right ( environment ), we illustrate a single-step transition in the execution environment. The state consists of a crease pattern, where blue and red lines denote mountain and valley folds, respectively, along with its rendered origami. After receiving the output from the VLM model, the execution engine performs a foldability check for the given action; if successful, it generates a new state. The VLM model observes as input the initial prompt, the current environment state, and the target origami. Once the simulation is complete, the final state is compared against the target state using the proposed metrics, also leveraging the hidden target crease pattern. Finally, at the bottom ( tasks ), the two evaluation tasks are shown from the model’s perspective, highlighting the inputs and the corresponding desired outputs. We introduce an interactive environment to evaluate VLMs on geometric reasoning and sequential planning through the task of origami design. The agent must incrementally fold a blank sheet into a target shape, capturing the physical constraints of real-world origami. Environment Workflow. The environment operates as a closed-loop system. Each episode starts from a blank paper and a target origami. In the loop, each interaction follows a strict sequence: the environment presents a multimodal input; the agent responds with a structured command; and the environment validates and executes it, subsequently updating its state to produce the next input. State, Observation and Action. The environment maintains a precise internal state , implemented as a CreasePattern object, which is the complete geometric representation of the task and can be serialized to a .fold file. At each step, the agent receives a structured observation based on this state. In practice, this is delivered as a multimodal prompt that includes few-shot examples followed by the current task context: the three visual inputs as PNG images (the target folded shape, the current folded state and the 2D crease pattern) along with binary feedback on the feasibility of the previous action. The detailed prompt design can be found in Supplementary. To update the state, the agent must output a single, structured action . This action is a JSON object that precisely defines a new crease to be added: A_t = { action: "add_crease", edge_vertices: [v_i, v_j], assignment: m } where v_{i} and v_{j} are vertex indices and m\in\{\text{M},\text{V}\} denoting Mountain or Valley folds. Action Validation and Execution. Upon receiving an action, the environment performs a two-stage validation

Read the complete text