Human-Centered Evaluation of an LLM-Based Process Modeling Copilot: A Mixed-Methods Study with Domain Experts DOI: XXXXXXX.XXXXXXX Conference: conference on Human Factors in Computing Systems ; April 13–17, 2026; Barcelona, ES ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Human computer interaction (HCI)-Empirical studies in HCI CCS: Human-centered computing Human computer interaction (HCI) Interactive systems and tools
Chantale Lauer, Peter Pfeiffer, Nijat Mehdiyev · 2026
Read Human-Centered Evaluation of an LLM-Based Process Modeling Copilot: A Mixed-Methods Study with Domain Experts DOI: XXXXXXX.XXXXXXX Conference: conference on Human Factors in Computing Systems ; April 13–17, 2026; Barcelona, ES ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Human computer interaction (HCI)-Empirical studies in HCI CCS: Human-centered computing Human computer interaction (HCI) Interactive systems and tools by Chantale Lauer, Peter Pfeiffer, Nijat Mehdiyev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12895.txt.
Description
Chantale Lauer and co-authors evaluate a language model copilot for business process modeling with domain experts. Automated checks cover syntax and meaning, yet miss trust, usability, and fit with practice. Five experts tested the BPMN copilot in focus groups and questionnaires. Usability scored as acceptable, while trust ran notably lower. Reliability was the top concern among the group. Output quality and prompting proved hard, and experts wanted deeper clarifying questions from the tool.
Catalog record
| CREATOR | Chantale Lauer, Peter Pfeiffer, Nijat Mehdiyev |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32907 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.12895