Benchmarking Affordance Generalization with BusyBox
Dean Fortier, Timothy Adamson, Tess Hellebrekers, Teresa LaScala, Kofi Ennin, Michael Murray, Andrey Kolobov, Galen Mullins · 2026
Read Benchmarking Affordance Generalization with BusyBox by Dean Fortier, Timothy Adamson, Tess Hellebrekers, Teresa LaScala, Kofi Ennin, Michael Murray, Andrey Kolobov, Galen Mullins (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05441.txt.
Description
Robots that follow language commands must learn to handle new objects that share familiar features, such as switches or dials. Dean Fortier, Timothy Adamson, and 6 co-authors present BusyBox, a hands-on test kit for measuring that skill in vision-language-action models. The kit has six modules with switches, sliders, wires, buttons, a display, and a dial, and the modules can be swapped and turned to make many new layouts.
Even strong open models did poorly when the layout changed while the parts stayed the same, which shows how hard this kind of generalization still is. To help other labs run the same tests, the team shares files for printing the parts and a list of parts for the electronics. They also share a data set of language-labeled demonstrations, gathered with a two-armed mobile robot on the standard setup.
Catalog record
| CREATOR | Dean Fortier, Timothy Adamson, Tess Hellebrekers, Teresa LaScala, Kofi Ennin, Michael Murray, Andrey Kolobov, Galen Mullins |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05441