IndEgo: A Dataset of Ind ustrial Scenarios and Collaborative Work for Ego centric Assistants

Vivek Chavan, Yasmina Imgrund, Tung Dao, Sanwantri Bai, Bosong Wang, Ze Lu, Oliver Heimann, Jörg Krüger, [0.75em] Fraunhofer IPK, Berlin · 2025

Read IndEgo: A Dataset of Ind ustrial Scenarios and Collaborative Work for Ego centric Assistants by Vivek Chavan, Yasmina Imgrund, Tung Dao, Sanwantri Bai, Bosong Wang, Ze Lu, Oliver Heimann, Jörg Krüger, [0.75em] Fraunhofer IPK, Berlin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19684.txt.

Introduction

Vivek Chavan and seven co-authors release IndEgo, a data set of factory work filmed from the worker's own viewpoint. It covers assembly and disassembly, logistics, inspection and repair, and woodworking, with a special focus on two people doing hard tasks together. Such paired work is rarely captured for AI training.

The set holds about three and a half thousand first-person recordings, near two hundred hours, plus about a thousand outside-view recordings. Eye gaze, narration, sound, and motion ride along, with detailed labels for actions and mistakes. Benchmarks on mistake detection and question answering show today's multimodal models still struggle with the material.

Catalog record

CREATORVivek Chavan, Yasmina Imgrund, Tung Dao, Sanwantri Bai, Bosong Wang, Ze Lu, Oliver Heimann, Jörg Krüger, [0.75em] Fraunhofer IPK, Berlin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE132 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-19684

Browse the full library · About the Tower of Babel