Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studies

Ziyi Xuan, Yiwen Wu, Xuhai Xu, Vinod Namboodiri, Mooi Choo Chuah, Yu Yang · 2025

Read Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studies by Ziyi Xuan, Yiwen Wu, Xuhai Xu, Vinod Namboodiri, Mooi Choo Chuah, Yu Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09938.txt.

Introduction

Ziyi Xuan and co-authors build a platform of AI agents for studying how people work with smart assistants. Their twenty twenty-five paper reports ten user studies run on the system. Testing proactive, personal assistants on real people is slow, costly, and raises privacy issues.

Simulated worlds help, but rule-based scenes are stiff and still need heavy human guiding. Generative agents, powered by large language models, can act out human-like reasoning and social play. The platform lets researchers design assistant studies around such agents. The ten-study tale weighs where agent stand-ins match people and where they drift, a map for cheaper, safer design research.

Catalog record

CREATORZiyi Xuan, Yiwen Wu, Xuhai Xu, Vinod Namboodiri, Mooi Choo Chuah, Yu Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE135 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-09938

Browse the full library · About the Tower of Babel