Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Users Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CH

Farnaz Zamiri Zeraati, Yang Trista Cao, Yuehan Qiao, Hal Daumé III, Hernisa Kacorri · 2026

Read Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Users Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CH by Farnaz Zamiri Zeraati, Yang Trista Cao, Yuehan Qiao, Hal Daumé III, Hernisa Kacorri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16930.txt.

Description

Farnaz Zamiri Zeraati and co-authors explore user control in conversational visual question answering with blind users. Prompting and steering techniques are well established in general-purpose generative AI, yet assistive visual question answering tools for blind users still follow rigid patterns. User control helps when system replies misalign with goals and contexts, a gap especially consequential for blind users who may rely on these systems for access.

Eleven blind users were invited to customize interactions with a real-world conversational visual question answering system. The authors analyze prompting techniques participants adopted. Exchanges often ran long, averaging three turns and sometimes reaching twenty-one, with input text typically tenfold shorter than replies heard. The system lacked verbosity controls, struggled estimating distance in space and time, relied on inaccessible image framing, and offered little camera guidance. Prompt engineering helped participants work around those limits, alongside a new public dataset.

Catalog record

CREATORFarnaz Zamiri Zeraati, Yang Trista Cao, Yuehan Qiao, Hal Daumé III, Hernisa Kacorri
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-16930

Browse the full library · About the Tower of Babel