IntenBot: Flexible and Imprecise Multimodal Input for LLMs to Understand User Intentions for Casual and Human-Like HRI Journal: International Journal of Human-Computer Studies

Yen-Ting Liu, Chiu-Hsuan Wang, TzuLing Chen, Ting-Ying Lee, Tzu-Hua Wang, ChienMing Lin, Bing-Yu Chen, Hsin-Ruey Tsai · 2026

Read IntenBot: Flexible and Imprecise Multimodal Input for LLMs to Understand User Intentions for Casual and Human-Like HRI Journal: International Journal of Human-Computer Studies by Yen-Ting Liu, Chiu-Hsuan Wang, TzuLing Chen, Ting-Ying Lee, Tzu-Hua Wang, ChienMing Lin, Bing-Yu Chen, Hsin-Ruey Tsai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04585.txt.

Description

Yen-Ting Liu and seven co-authors build a robot interaction system that accepts the casual, imprecise way people naturally communicate. Saying a vague phrase while glancing or pointing at an object is clear to a human partner, but robots usually demand exact, explicit commands.

Their system, designed for extended reality settings, combines voice, gaze, and finger-pointing, and uses a language model to filter out irrelevant channels and noisy readings. It then generates candidate instructions for the user to confirm, rather than acting on a guess. The flexible input is meant to cut the time, effort, and attention that human-like robot interaction normally demands.

Catalog record

CREATORYen-Ting Liu, Chiu-Hsuan Wang, TzuLing Chen, Ting-Ying Lee, Tzu-Hua Wang, ChienMing Lin, Bing-Yu Chen, Hsin-Ruey Tsai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04585

Browse the full library · About the Tower of Babel