Interact with me: Joint Egocentric Forecasting of Intent to Interact, Attitude and Social Actions

Tongfei Bian, Yiming Ma, Mathieu Chollet, Victor Sanchez, Tanaya Guha · 2024

Read Interact with me: Joint Egocentric Forecasting of Intent to Interact, Attitude and Social Actions by Tongfei Bian, Yiming Ma, Mathieu Chollet, Victor Sanchez, Tanaya Guha (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16698.txt.

Description

Tongfei Bian and co-authors teach a system to forecast, from a robot view, whether a person wants to engage with it, in a paper from 2024. A good agent should spot its user early and get ready for the exchange.

Their graph based frame reads whole body pose points from just one second of video. It jointly predicts intent to engage, stance toward the agent, and the act the person will take. Task links are used in a layered multi task design. On an enriched test set the model ran in real time and beat rival baselines on average scores.

Catalog record

CREATORTongfei Bian, Yiming Ma, Mathieu Chollet, Victor Sanchez, Tanaya Guha
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-16698

Browse the full library · About the Tower of Babel