Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning Conference: 30th International Conference on Intelligent User Interfaces; March 24–27, 2025; Cagliari, Italy 30th International Conference on Intelligent User Interfaces (IUI ’25), March 24–27, 2025, Cagli
Michael Xieyang Liu, Savvas Petridis, Vivian Tsai, Alexander J. Fiannaca, Alex Olwal, Michael Terry, Carrie J. Cai · 2025
Read Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning Conference: 30th International Conference on Intelligent User Interfaces; March 24–27, 2025; Cagliari, Italy 30th International Conference on Intelligent User Interfaces (IUI ’25), March 24–27, 2025, Cagli by Michael Xieyang Liu, Savvas Petridis, Vivian Tsai, Alexander J. Fiannaca, Alex Olwal, Michael Terry, Carrie J. Cai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15727.txt.
Description
Michael Xieyang Liu and six colleagues built Gensors, a system letting ordinary users create personalized visual sensors from camera feeds. A user might want an alert when a toddler gets into mischief; multimodal models can reason about such requests, but a formative study showed users struggle to specify requirements and debug prompts.
Gensors helps elicit requirements as explicit sensor criteria, mixing automatically generated and user-written ones. Users can test individual criteria in parallel, get suggested criteria from their own photos, and generate stress-test cases. In a user study, participants felt significantly more control and understanding than with plain prompting. The system also exposed users' blind spots, revealing overlooked criteria and unexpected failure modes.
Catalog record
| CREATOR | Michael Xieyang Liu, Savvas Petridis, Vivian Tsai, Alexander J. Fiannaca, Alex Olwal, Michael Terry, Carrie J. Cai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15727