Understanding Pedestrian Gesture Misrecognition: Insights from Vision-Language Model Reasoning Conference: 17th International Conference on Automotive User Interfaces and Interactive Vehicular Applications; September 21–25, 2025; Brisbane, QLD, Australia 17th International Conference on Automotive U
Tram Thi Minh Tran, Xinyan Yu, Callum Parker, Julie Stephany Berrio Perez, Stewart Worrall, Martin Tomitsch · 2025
Read Understanding Pedestrian Gesture Misrecognition: Insights from Vision-Language Model Reasoning Conference: 17th International Conference on Automotive User Interfaces and Interactive Vehicular Applications; September 21–25, 2025; Brisbane, QLD, Australia 17th International Conference on Automotive U by Tram Thi Minh Tran, Xinyan Yu, Callum Parker, Julie Stephany Berrio Perez, Stewart Worrall, Martin Tomitsch (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06801.txt.
Description
Tram Thi Minh Tran and five co-authors study how machines misread pedestrian hand signals, in a 2025 arXiv paper. Walkers wave, point, and hold up palms to talk with drivers, and self-driving cars have to read those signs. The signs are small, brief, and shaped by the scene, so machines often get them wrong.
Rather than grade a vision model, the team used one as a probe. They fed it a public video set of walker and car meetings, read its stated reasons, and sorted the errors by theme. Poor sight of the gesture, the walker's own acts, scene context, and weather all drove mistakes. The authors draw design lessons, such as making signals stand out and backing them with context.
Catalog record
| CREATOR | Tram Thi Minh Tran, Xinyan Yu, Callum Parker, Julie Stephany Berrio Perez, Stewart Worrall, Martin Tomitsch |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-06801