Simulating Human Audiovisual Search Behavior Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI:
Hyunsung Cho, Xuejing Luo, Byungjoo Lee, David Lindlbauer, Antti Oulasvirta · 2026
Read Simulating Human Audiovisual Search Behavior Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: by Hyunsung Cho, Xuejing Luo, Byungjoo Lee, David Lindlbauer, Antti Oulasvirta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02790.txt.
Description
Hyunsung Cho and 4 co-authors model how people search with eyes and ears jointly, balancing effort against accuracy, in a 2026 paper. Finding a car in a crowded lot or a speaker in a virtual meeting requires coordinating movement with hearing and vision under uncertainty. Existing models treat perception and action separately, missing that coordination.
Their computational model, Sensonaut, assumes searchers deploy body and senses as they believe will most efficiently raise the chance of finding the target. Search becomes resource-rational choice-making under partial observability, where the world is only partly visible. Validated against newly collected human data, the model reproduces how search time and effort scale with complexity, occlusion, and distraction. It also reproduces characteristic human errors. The authors aim the simulation at interface design: audiovisual systems should minimize search cost and cognitive load.
Catalog record
| CREATOR | Hyunsung Cho, Xuejing Luo, Byungjoo Lee, David Lindlbauer, Antti Oulasvirta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02790