Synthetic Cognitive Walkthrough: Aligning Large Language Model’s Performance with Human Cognitive Walkthrough DOI: XXXXXXX.XXXXXXX Conference: Proceedings of the CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the CHI Conference on Human Facto
Ruican Zhong, David W. McDonald, Gary Hsieh · 2025
Read Synthetic Cognitive Walkthrough: Aligning Large Language Model’s Performance with Human Cognitive Walkthrough DOI: XXXXXXX.XXXXXXX Conference: Proceedings of the CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the CHI Conference on Human Facto by Ruican Zhong, David W. McDonald, Gary Hsieh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03568.txt.
Description
Usability walkthroughs are useful but costly to run with people. Ruican Zhong, David McDonald, and Gary Hsieh test whether language models can simulate them in this 2025 work. A cognitive walkthrough steps through an interface as a new user would.
The authors compared walkthroughs by GPT-4 and Gemini against human participants. They asked how closely model performance aligns with human behavior in the task. Synthetic walkthroughs could give design teams cheap early feedback. They would not replace human testing, but could triage issues sooner. Alignment with human walkthroughs is the test, since a synthetic user must stumble where people stumble, not where models find code paths.
Catalog record
| CREATOR | Ruican Zhong, David W. McDonald, Gary Hsieh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-03568