Predicting Implicit Arguments in Procedural Video Instructions
Anil Batra, Laura Sevilla-Lara, Marcus Rohrbach, Frank Keller · 2025
Read Predicting Implicit Arguments in Procedural Video Instructions by Anil Batra, Laura Sevilla-Lara, Marcus Rohrbach, Frank Keller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21068.txt.
Description
Anil Batra, Laura Sevilla-Lara, Marcus Rohrbach and Frank Keller build a dataset for the unspoken parts of video instructions, in their 2025 arXiv paper. Cooking steps often leave arguments implicit: add sliced tomatoes leaves unstated where they go, though the prior step named the bowl. Standard labeling benchmarks miss these hidden pieces.
Their dataset, Implicit-VidSRL, requires models to infer both stated and implicit arguments from visual and text context in cooking videos, tracking entities as recipes change them. Recent multimodal models struggled with the implicit roles. Their tuned model improved scores for the hidden what and where roles by clear margins over GPT-4o.
Catalog record
| CREATOR | Anil Batra, Laura Sevilla-Lara, Marcus Rohrbach, Frank Keller |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-21068