Interact with me: Joint Egocentric Forecasting of Intent to Interact, Attitude and Social Actions
Tongfei Bian, Yiming Ma, Mathieu Chollet, Victor Sanchez, Tanaya Guha · 2024
Read Interact with me: Joint Egocentric Forecasting of Intent to Interact, Attitude and Social Actions by Tongfei Bian, Yiming Ma, Mathieu Chollet, Victor Sanchez, Tanaya Guha (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16698.txt.
Description
Tongfei Bian and co-authors teach a system to forecast, from a robot view, whether a person wants to engage with it, in a paper from 2024. A good agent should spot its user early and get ready for the exchange.
Their graph based frame reads whole body pose points from just one second of video. It jointly predicts intent to engage, stance toward the agent, and the act the person will take. Task links are used in a layered multi task design. On an enriched test set the model ran in real time and beat rival baselines on average scores.
Catalog record
| CREATOR | Tongfei Bian, Yiming Ma, Mathieu Chollet, Victor Sanchez, Tanaya Guha |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-16698