HD-EPIC: A Highly-Detailed Egocentric Video Dataset
Toby Perrett Ahmad Darkhalil Saptarshi Sinha Omar Emara Sam Pollard, Kranti Kumar Parida Kaiting Liu, Prajwal Gatti Siddhant Bansal Kevin Flanagan, Jacob Chalk Zhifan Zhu Rhodri Guerrier Fahd Abdelazim Bin Zhu, Davide Moltisanti Michael Wray Hazel Doughty Dima Damen · 2025
Read HD-EPIC: A Highly-Detailed Egocentric Video Dataset by Toby Perrett Ahmad Darkhalil Saptarshi Sinha Omar Emara Sam Pollard, Kranti Kumar Parida Kaiting Liu, Prajwal Gatti Siddhant Bansal Kevin Flanagan, Jacob Chalk Zhifan Zhu Rhodri Guerrier Fahd Abdelazim Bin Zhu, Davide Moltisanti Michael Wray Hazel Doughty Dima Damen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04144.txt.
Description
Toby Perrett and co-authors released HD-EPIC in a 2025 paper, a dataset of first-person kitchen videos labeled in unusual depth. Volunteers cooked unscripted in nine home kitchens, and every clip was annotated by hand: recipe steps, fine actions, ingredients with nutrition values, moving objects, and sounds. All labels are anchored in 3D digital twins of each kitchen, down to fixtures and gaze direction.
The set holds 41 hours of video, 69 recipes, and tens of thousands of actions, sounds, and object tracks, averaging 263 labels per minute. A question-answering benchmark of 26,000 items tests recipe, ingredient, and spatial understanding. A leading long-context model scored only 38.5 percent, exposing wide gaps in current video AI, the authors note.
Catalog record
| CREATOR | Toby Perrett Ahmad Darkhalil Saptarshi Sinha Omar Emara Sam Pollard, Kranti Kumar Parida Kaiting Liu, Prajwal Gatti Siddhant Bansal Kevin Flanagan, Jacob Chalk Zhifan Zhu Rhodri Guerrier Fahd Abdelazim Bin Zhu, Davide Moltisanti Michael Wray Hazel Doughty Dima Damen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04144