Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning Conference: 30th International Conference on Intelligent User Interfaces; March 24–27, 2025; Cagliari, Italy 30th International Conference on Intelligent User Interfaces (IUI ’25), March 24–27, 2025, Cagli

Michael Xieyang Liu, Savvas Petridis, Vivian Tsai, Alexander J. Fiannaca, Alex Olwal, Michael Terry, Carrie J. Cai · 2025

Read Gensors: Authoring Personalized Visual Sensors with Multimodal Foundation Models and Reasoning Conference: 30th International Conference on Intelligent User Interfaces; March 24–27, 2025; Cagliari, Italy 30th International Conference on Intelligent User Interfaces (IUI ’25), March 24–27, 2025, Cagli by Michael Xieyang Liu, Savvas Petridis, Vivian Tsai, Alexander J. Fiannaca, Alex Olwal, Michael Terry, Carrie J. Cai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15727.txt.

Description

Michael Xieyang Liu and six colleagues built Gensors, a system letting ordinary users create personalized visual sensors from camera feeds. A user might want an alert when a toddler gets into mischief; multimodal models can reason about such requests, but a formative study showed users struggle to specify requirements and debug prompts.

Gensors helps elicit requirements as explicit sensor criteria, mixing automatically generated and user-written ones. Users can test individual criteria in parallel, get suggested criteria from their own photos, and generate stress-test cases. In a user study, participants felt significantly more control and understanding than with plain prompting. The system also exposed users' blind spots, revealing overlooked criteria and unexpected failure modes.

Catalog record

CREATORMichael Xieyang Liu, Savvas Petridis, Vivian Tsai, Alexander J. Fiannaca, Alex Olwal, Michael Terry, Carrie J. Cai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-15727

Browse the full library · About the Tower of Babel