Planning with Vision-Language Models and a Use Case in Robot-Assisted Teaching
Xuzhe Dang, Lada Kudláčková, Stefan Edelkamp · 2025
Read Planning with Vision-Language Models and a Use Case in Robot-Assisted Teaching by Xuzhe Dang, Lada Kudláčková, Stefan Edelkamp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17665.txt.
Description
Xuzhe Dang, Lada Kudláčková, and Stefan Edelkamp introduced Image2PDDL in twenty twenty-five, a framework that turns pictures into planning problems. Classical planners need problems written in PDDL, a formal language whose authoring demands expertise. Their system uses a vision-language model to convert an image of an initial scene plus a goal description into a PDDL problem file, given the domain rules.
They evaluate on classic domains like blocksworld and sliding tile puzzles at several difficulty levels, grading both grammar and factual correctness of the generated files. Results were promising across complexity levels. The authors discuss a use case in robot-assisted teaching for students with autism, where automatically staged planning tasks could personalize practice. The work links perception to symbolic reasoning with less human setup.
Catalog record
| CREATOR | Xuzhe Dang, Lada Kudláčková, Stefan Edelkamp |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-17665