HD-EPIC: A Highly-Detailed Egocentric Video Dataset

Toby Perrett Ahmad Darkhalil Saptarshi Sinha Omar Emara Sam Pollard, Kranti Kumar Parida Kaiting Liu, Prajwal Gatti Siddhant Bansal Kevin Flanagan, Jacob Chalk Zhifan Zhu Rhodri Guerrier Fahd Abdelazim Bin Zhu, Davide Moltisanti Michael Wray Hazel Doughty Dima Damen · 2025

Read HD-EPIC: A Highly-Detailed Egocentric Video Dataset by Toby Perrett Ahmad Darkhalil Saptarshi Sinha Omar Emara Sam Pollard, Kranti Kumar Parida Kaiting Liu, Prajwal Gatti Siddhant Bansal Kevin Flanagan, Jacob Chalk Zhifan Zhu Rhodri Guerrier Fahd Abdelazim Bin Zhu, Davide Moltisanti Michael Wray Hazel Doughty Dima Damen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04144.txt.

Description

Toby Perrett and co-authors released HD-EPIC in a 2025 paper, a dataset of first-person kitchen videos labeled in unusual depth. Volunteers cooked unscripted in nine home kitchens, and every clip was annotated by hand: recipe steps, fine actions, ingredients with nutrition values, moving objects, and sounds. All labels are anchored in 3D digital twins of each kitchen, down to fixtures and gaze direction.

The set holds 41 hours of video, 69 recipes, and tens of thousands of actions, sounds, and object tracks, averaging 263 labels per minute. A question-answering benchmark of 26,000 items tests recipe, ingredient, and spatial understanding. A leading long-context model scored only 38.5 percent, exposing wide gaps in current video AI, the authors note.

Catalog record

CREATORToby Perrett Ahmad Darkhalil Saptarshi Sinha Omar Emara Sam Pollard, Kranti Kumar Parida Kaiting Liu, Prajwal Gatti Siddhant Bansal Kevin Flanagan, Jacob Chalk Zhifan Zhu Rhodri Guerrier Fahd Abdelazim Bin Zhu, Davide Moltisanti Michael Wray Hazel Doughty Dima Damen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04144

Browse the full library · About the Tower of Babel