Benchmarking Affordance Generalization with BusyBox

Dean Fortier, Timothy Adamson, Tess Hellebrekers, Teresa LaScala, Kofi Ennin, Michael Murray, Andrey Kolobov, Galen Mullins · 2026

Read Benchmarking Affordance Generalization with BusyBox by Dean Fortier, Timothy Adamson, Tess Hellebrekers, Teresa LaScala, Kofi Ennin, Michael Murray, Andrey Kolobov, Galen Mullins (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05441.txt.

Description

Robots that follow language commands must learn to handle new objects that share familiar features, such as switches or dials. Dean Fortier, Timothy Adamson, and 6 co-authors present BusyBox, a hands-on test kit for measuring that skill in vision-language-action models. The kit has six modules with switches, sliders, wires, buttons, a display, and a dial, and the modules can be swapped and turned to make many new layouts.

Even strong open models did poorly when the layout changed while the parts stayed the same, which shows how hard this kind of generalization still is. To help other labs run the same tests, the team shares files for printing the parts and a list of parts for the electronics. They also share a data set of language-labeled demonstrations, gathered with a two-armed mobile robot on the standard setup.

Catalog record

CREATORDean Fortier, Timothy Adamson, Tess Hellebrekers, Teresa LaScala, Kofi Ennin, Michael Murray, Andrey Kolobov, Galen Mullins
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05441

Browse the full library · About the Tower of Babel